-- Logs begin at Thu 2022-06-16 13:56:39 UTC, end at Thu 2022-06-16 15:21:29 UTC. -- Jun 16 14:42:24.904295 dv-cinder-837163-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 16 14:42:24.911477 dv-cinder-837163-3-smb devstack@keystone.service[80266]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 16 14:42:24.914514 dv-cinder-837163-3-smb devstack@keystone.service[80266]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 14:42:24 2022] *** Jun 16 14:42:24.914514 dv-cinder-837163-3-smb devstack@keystone.service[80266]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 14:42:24.914514 dv-cinder-837163-3-smb devstack@keystone.service[80266]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 14:42:24.914514 dv-cinder-837163-3-smb devstack@keystone.service[80266]: nodename: dv-cinder-837163-3-smb Jun 16 14:42:24.914514 dv-cinder-837163-3-smb devstack@keystone.service[80266]: machine: x86_64 Jun 16 14:42:24.914514 dv-cinder-837163-3-smb devstack@keystone.service[80266]: clock source: unix Jun 16 14:42:24.914514 dv-cinder-837163-3-smb devstack@keystone.service[80266]: pcre jit disabled Jun 16 14:42:24.914514 dv-cinder-837163-3-smb devstack@keystone.service[80266]: detected number of CPU cores: 4 Jun 16 14:42:24.914514 dv-cinder-837163-3-smb devstack@keystone.service[80266]: current working directory: / Jun 16 14:42:24.914514 dv-cinder-837163-3-smb devstack@keystone.service[80266]: detected binary path: /usr/bin/uwsgi-core Jun 16 14:42:24.914514 dv-cinder-837163-3-smb devstack@keystone.service[80266]: your processes number limit is 47680 Jun 16 14:42:24.915119 dv-cinder-837163-3-smb devstack@keystone.service[80266]: your memory page size is 4096 bytes Jun 16 14:42:24.915119 dv-cinder-837163-3-smb devstack@keystone.service[80266]: detected max file descriptor number: 2048 Jun 16 14:42:24.915119 dv-cinder-837163-3-smb devstack@keystone.service[80266]: lock engine: pthread robust mutexes Jun 16 14:42:24.915119 dv-cinder-837163-3-smb devstack@keystone.service[80266]: thunder lock: enabled Jun 16 14:42:24.915119 dv-cinder-837163-3-smb devstack@keystone.service[80266]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 16 14:42:24.915119 dv-cinder-837163-3-smb devstack@keystone.service[80266]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 14:42:24.959130 dv-cinder-837163-3-smb devstack@keystone.service[80266]: Python main interpreter initialized at 0x55f9ce44f9c0 Jun 16 14:42:24.959130 dv-cinder-837163-3-smb devstack@keystone.service[80266]: python threads support enabled Jun 16 14:42:24.959130 dv-cinder-837163-3-smb devstack@keystone.service[80266]: your server socket listen backlog is limited to 100 connections Jun 16 14:42:24.959130 dv-cinder-837163-3-smb devstack@keystone.service[80266]: your mercy for graceful operations on workers is 90 seconds Jun 16 14:42:24.959484 dv-cinder-837163-3-smb devstack@keystone.service[80266]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 14:42:24.959568 dv-cinder-837163-3-smb devstack@keystone.service[80266]: *** Operational MODE: preforking *** Jun 16 14:42:24.959835 dv-cinder-837163-3-smb devstack@keystone.service[80266]: *** uWSGI is running in multiple interpreter mode *** Jun 16 14:42:24.959835 dv-cinder-837163-3-smb devstack@keystone.service[80266]: spawned uWSGI master process (pid: 80266) Jun 16 14:42:24.963534 dv-cinder-837163-3-smb devstack@keystone.service[80266]: spawned uWSGI worker 1 (pid: 80273, cores: 1) Jun 16 14:42:24.963534 dv-cinder-837163-3-smb devstack@keystone.service[80266]: spawned uWSGI worker 2 (pid: 80274, cores: 1) Jun 16 14:42:24.963534 dv-cinder-837163-3-smb devstack@keystone.service[80266]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 14:42:24.960023 dv-cinder-837163-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 16 14:42:30.535889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:42:30.535889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: from cryptography.utils import int_from_bytes Jun 16 14:42:30.536691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:42:30.536691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: from cryptography.utils import int_from_bytes Jun 16 14:42:30.539102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:42:30.539102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: from cryptography.utils import int_from_bytes Jun 16 14:42:30.539658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:42:30.539658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: from cryptography.utils import int_from_bytes Jun 16 14:42:30.586698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:42:30.586891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:42:30.587071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] command line args: [] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:42:30.587343 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:42:30.587523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ================================================================================ {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:42:30.587780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] admin_token = **** {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.588029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] config_dir = [] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.588114 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:42:30.588220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.588308 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:42:30.588405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] config_source = [] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.588485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] command line args: [] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:42:30.588589 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] debug = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.588670 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:42:30.588791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.589039 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ================================================================================ {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:42:30.589110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] admin_token = **** {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.589210 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.589360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.589469 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] config_dir = [] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.589567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.589676 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.589780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] config_source = [] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.589886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.590003 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] debug = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.590107 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] list_limit = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.590213 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.590341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] log_config_append = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.590458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.590565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.590692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.590797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] log_dir = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.590901 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.591013 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] log_file = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.591013 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.591220 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.591220 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] list_limit = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.591413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.591489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] log_config_append = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.591606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.591694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.591767 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.591888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] log_dir = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.591970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.592043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] log_file = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.592107 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.592189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.592262 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.592382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.592457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.592580 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.592700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.592789 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.592936 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.593088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.593208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.593289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.593417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.593500 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.593634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.593876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.594117 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.594356 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.594593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.594849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.680232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.680522 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.680837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.681197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.681405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.681547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.681634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] publish_errors = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.681845 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.682087 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.682166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.682277 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.682368 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] publish_errors = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.682537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.682621 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.682786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.682865 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.682979 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.683066 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] standard_threads = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.683251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.683337 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.683507 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.683591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.683695 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.683780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] standard_threads = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.683879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] use_journal = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.683993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.684071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] use_json = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.684231 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] use_stderr = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.684320 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.684400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] use_syslog = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.684477 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.684604 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] use_journal = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.684681 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.684790 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] use_json = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.684950 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.685031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] use_stderr = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.685151 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.685279 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] use_syslog = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.685407 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:42:30.685524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.685670 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.685792 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.685914 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.686037 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.686160 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.686274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.686399 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.686516 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.686637 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.686759 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.686875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.686990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.687113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.687229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.687376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.687503 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.687619 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.687740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.687865 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.687987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.688103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.688217 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.688331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.688445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.688569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.688694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.688810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.688925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.689038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.689189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.689309 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.689424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.689563 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.689683 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.689798 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.689921 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.690038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.690152 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.690312 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.690438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.690575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.690773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.690899 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.691016 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.691131 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.691247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.691361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.691489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.691612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.691734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.691850 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.691964 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.692079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.692201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.692318 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.692438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.693190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.693320 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.693438 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.693561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.693678 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.693800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.693916 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.694037 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.694153 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.694280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.694402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.694524 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.694640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.694761 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.694884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.695008 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.695125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.695239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.695354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.695498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.695624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.695752 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.695876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.695876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.696078 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.696182 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.696288 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.696288 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.696469 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.696566 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.696662 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.696758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.696867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.696987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.697092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.697231 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.697333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.697431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.697528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.697646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.697771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.697894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.698000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.698114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.698230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.698335 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.698458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.698586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.698703 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.698824 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.698929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.699043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.699167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.699279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.699394 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.699510 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.699634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.699757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.699864 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.699977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.700093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.700207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.700338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.700457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.700583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.700700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.700812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.700933 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.701049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.701181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.701303 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.701421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.701545 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.701662 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.701777 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.701888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.702011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.702130 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.702245 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.702366 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.702483 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.702598 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.702790 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.702915 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.703031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.703147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.703262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.703384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.703508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.703625 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.703740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.703855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.703970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.704085 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.704216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.704346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.704470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.704587 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.704714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.704832 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.704958 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.705083 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.705211 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.705328 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.705453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.705571 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.705686 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.705810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.705928 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.706050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.706172 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.706288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.706405 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.706529 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.706646 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.706762 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.706877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.706999 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.707115 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.707239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.707357 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.707473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.707588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.707702 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.707817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.708011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.708139 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.708255 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.708371 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.708488 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.708603 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.708728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.708845 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.708960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.709076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.709224 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.709340 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.709469 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.709588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.709709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.709826 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.709941 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.710056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.710180 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.710297 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.710413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] auth.external = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.710529 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.710643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.710768 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.710896 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.711014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.711130 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.711245 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.711360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] auth.password = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.711502 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] auth.external = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.711630 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] auth.token = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.711747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.711872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.711872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.712092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.712208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.712323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.712438 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.712563 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] auth.password = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.712682 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.712799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] auth.token = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.712914 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.713030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.713166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.713297 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.713432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] credential.caching = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.713550 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.713667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.713797 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.713916 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.714043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.714161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.714277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.714392 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.714509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.714624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.714750 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] credential.caching = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.714867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.714983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.715098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.715214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.715338 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.715571 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.715687 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.715803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.715926 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.715926 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.716154 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.716270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.716386 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.716511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.716639 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.716830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.716960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.717078 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.717284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.717284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] federation.caching = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.717503 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.717636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.717755 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.717755 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.717974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.718090 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.718206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.718477 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.718601 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.718717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] federation.caching = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.718834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.718952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.719075 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.719201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.719319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.719436 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.719559 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.719677 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.719793 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.719918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.720038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.720154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.720270 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.720386 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.720502 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity.caching = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.720627 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.720757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.720877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.720994 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.720994 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.721280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.721410 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.721529 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.721646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.721762 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity.caching = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.721878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.721995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.722120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.722238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.722354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.722470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.722586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.722747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.722875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.722993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.723111 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.723226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.723341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.723458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.723582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.723718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.723837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.723954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.724070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.724187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.724312 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.724431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.724547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.724664 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.724780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.724895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.725020 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.725160 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.725291 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.725412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.725528 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.725656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.725775 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.725891 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.726014 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.726131 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.726248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.726373 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.726490 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.726606 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.726728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.726845 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.726961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.727085 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.727203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.727321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.727436 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.727551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.727667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.727791 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.727909 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.728025 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.728140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.728257 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.728373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.728502 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.728619 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.728735 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.728860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.728978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.729093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.729276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.729398 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.729515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.729631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.729748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.729864 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.729988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.730112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.730229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.730352 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.730471 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.730587 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.730712 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.730835 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.730952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.731067 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.731183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.731299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.731424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.731544 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.731660 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.731776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.731893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.732009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.732134 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.732258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.732375 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.732491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.732615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.732731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.732859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.732977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.733094 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.733236 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.733354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.733471 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.733598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.733716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.733832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.733948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.734064 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.734179 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.734304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.734412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.734509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.734625 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.734741 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.734857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.734981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.735099 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.735099 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.735316 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.735432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.735547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.735672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.735790 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.735905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.736020 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.736136 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.736252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.736252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.736479 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.736596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.736711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.736827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.736942 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.737056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.737212 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.737331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.737446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.737446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.737664 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.737794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.737913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.738029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.738145 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.738261 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.738377 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.738500 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.738618 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.738734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.738851 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.738966 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.739090 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.739209 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.739839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.739959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.740074 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.740190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.740382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.740509 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.740626 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.740747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.740864 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.740982 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.741106 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.741250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.741370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.741485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.741602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.741718 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.741842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.741961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] resource.caching = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.742078 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.742194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.742309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.742426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.742551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.742669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.742785 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.742902 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.743019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.743134 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.743259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.743377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.743494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] resource.caching = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.743610 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.743726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.743842 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.743966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.744086 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.744202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.744318 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] role.caching = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.744435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.744551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] role.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.744680 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.744800 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.744917 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.745033 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.745170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.745289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.745418 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.745537 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.745653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.745769 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.745884 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] role.caching = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.746000 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.746125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] role.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.746250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.746367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.746483 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.746599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.746715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.746839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.746958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.747073 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.747189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.747306 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.747428 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.747554 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.747678 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.747796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.747912 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.748028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.748150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.748276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.748394 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.748510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.748626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.748742 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.748867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.748984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.749101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.749260 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.749379 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.749495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.749623 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.749742 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.749858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.749974 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.750089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.750205 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.750329 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.750448 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.750563 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.750679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.750797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.750797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.751023 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.751023 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.751243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.751358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.751481 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.751481 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.751708 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.751825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.751941 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.752057 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.752172 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.752287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.752411 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.752529 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] token.caching = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.752645 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.752760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.752875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.752991 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.753115 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.753252 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.753368 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.753526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.753646 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.753762 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.753891 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.754010 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.754126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.754240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.754356 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] token.caching = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.754472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.754601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.754719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.754835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.754981 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.755626 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.755747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.755874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.755993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.756109 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.756226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.756341 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.756341 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.756568 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.756687 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.756803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.756803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.757020 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.757020 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.757300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.757420 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.757536 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.connection = **** {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.757662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.757790 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.757908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.758025 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.758150 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.758267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.758383 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.758499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.758615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.758731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.758731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.758960 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.759076 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.759192 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.connection = **** {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.759316 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.759442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.759561 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.759750 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.759871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.759988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.760104 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.760220 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.760335 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.760461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.760579 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.760695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.760815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.760932 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.761048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.761194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.761314 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.761430 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.761546 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.761662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.761778 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.761903 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.762021 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:42:30.762139 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.762139 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.762139 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.762139 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.762139 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.762669 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.762669 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:42:30.762886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:42:30.792048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.792048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.792048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.792909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.793157 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.793397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.799976 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.803117 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.828578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.828803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.832194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.832597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.885780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.886167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.934556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.934786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.935665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:30.935908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.001831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.002063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.002170 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.002299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.002397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.002526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.002609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.002744 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.002825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.002960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.003043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.003177 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.026407 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.026641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.026741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.026870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.026954 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.027092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.027174 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.027306 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.027397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.027520 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.027602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.027733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.027814 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.027944 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.039323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.039527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.052389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.052537 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.052633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.052773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.052855 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.052996 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.053078 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.053239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.053339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.053456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.053538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.053671 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.053758 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.053878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 14:42:31.071393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.071612 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 14:42:31.071828 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.071952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.072092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 14:42:31.072177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 14:42:31.072363 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.072444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.072569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 14:42:31.072657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.072840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.072930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.073105 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.073256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.073401 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.073661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.084494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.084771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.084963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.085046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.085269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.085366 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.085541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.085824 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.093558 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.094009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.096838 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.097122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.097291 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.097431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.097573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.097717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.097858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.098004 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.098138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.098266 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.098418 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.098536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.098698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.098833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.098969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.099104 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.099242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.099379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.099512 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.099648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.099784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.100050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.125988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.126242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.127850 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.128128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.128827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.129310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.134244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.134641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.135142 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.138858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.139263 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.139552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.142743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.143028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.147196 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.147483 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.147825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.148114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.148397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.148680 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.148956 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.149264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.149539 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.149806 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.151975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.152264 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.152549 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.152830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.153106 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.153414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.153688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.153960 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.168861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.169153 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.173155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.173448 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.173708 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.177918 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.178319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.178567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.182234 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.182640 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.183314 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.186911 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.187671 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.190561 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.190863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.191150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.191311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.191432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.191712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.191992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.195127 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.195431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.195715 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.195998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.196276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.196558 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.212861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.213151 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.213431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.213705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.217470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.217757 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.218026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.218292 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.221571 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.223284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.223562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.226816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.227301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.227591 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.227872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.228161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.228449 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.228531 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.228797 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.231984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.232267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.232550 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.232843 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.233147 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.242247 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.242526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.242817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.243099 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.243470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.243751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.244029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.246926 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.247212 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.247498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.247783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.248162 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.248445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.248727 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.262419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.265697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.267138 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.268971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.270708 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.270992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.272642 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.272924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.273241 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.274041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.275780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.277487 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.277774 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.278063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.280467 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.282121 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.285346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.285429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.285640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.286025 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.286331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.287008 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.290361 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.290825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.290939 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.291222 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.295378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.295666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.295949 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.303570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.303814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.304098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.304325 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.304607 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.304887 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.305183 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.305460 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.305852 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.306141 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.306421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.306700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.306975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.307249 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.307525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.307804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.308080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.311967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 14:42:31.312252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.312536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.312814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.313089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.313499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.313786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.314070 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.314352 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.314626 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.314907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.315179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.315458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.315724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 14:42:31.346061 dv-cinder-837163-3-smb devstack@keystone.service[80274]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f9ce44f9c0 pid: 80274 (default app) Jun 16 14:42:31.349542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd07b59-281b-4a17-8f80-947628efea09 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:31.349846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd07b59-281b-4a17-8f80-947628efea09 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:31.350130 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd07b59-281b-4a17-8f80-947628efea09 None None] PATH_INFO: `/v3` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:31.353966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f9ce44f9c0 pid: 80273 (default app) Jun 16 14:42:31.354363 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Thu Jun 16 14:42:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:40.119512 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021304f-b37a-42af-a637-7776e3c2d3f5 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.120084 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021304f-b37a-42af-a637-7776e3c2d3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.120084 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021304f-b37a-42af-a637-7776e3c2d3f5 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.124455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:42:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:40.129869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7494f-868c-4d86-8b18-dd9ca02f10b3 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:40.132907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7494f-868c-4d86-8b18-dd9ca02f10b3 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:40.132907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7494f-868c-4d86-8b18-dd9ca02f10b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:40.201441 dv-cinder-837163-3-smb devstack@keystone.service[80274]: INFO dbcounter [None req-9ce7494f-868c-4d86-8b18-dd9ca02f10b3 None None] Registered counter for database keystone Jun 16 14:42:40.222390 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG oslo_db.sqlalchemy.engines [None req-9ce7494f-868c-4d86-8b18-dd9ca02f10b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:42:40.228779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writer thread running {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:42:40.413187 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG passlib.handlers.bcrypt [None req-9ce7494f-868c-4d86-8b18-dd9ca02f10b3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80274) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 14:42:40.413608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG passlib.handlers.bcrypt [None req-9ce7494f-868c-4d86-8b18-dd9ca02f10b3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80274) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 14:42:40.468133 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-9ce7494f-868c-4d86-8b18-dd9ca02f10b3 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:40.469751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9ce7494f-868c-4d86-8b18-dd9ca02f10b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:40.631529 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 14:42:40.783065 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021304f-b37a-42af-a637-7776e3c2d3f5 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:40.853479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: INFO dbcounter [None req-c021304f-b37a-42af-a637-7776e3c2d3f5 None None] Registered counter for database keystone Jun 16 14:42:40.872370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG oslo_db.sqlalchemy.engines [None req-c021304f-b37a-42af-a637-7776e3c2d3f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:42:40.878473 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writer thread running {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:42:40.998019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021304f-b37a-42af-a637-7776e3c2d3f5 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.002257 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746eb63-001e-493e-9150-9aa5faca7de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.002920 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746eb63-001e-493e-9150-9aa5faca7de2 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.003204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746eb63-001e-493e-9150-9aa5faca7de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.003481 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746eb63-001e-493e-9150-9aa5faca7de2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.012150 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746eb63-001e-493e-9150-9aa5faca7de2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:41.064418 dv-cinder-837163-3-smb devstack@keystone.service[80273]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0746eb63-001e-493e-9150-9aa5faca7de2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 14:42:41.064759 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746eb63-001e-493e-9150-9aa5faca7de2 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:41.074922 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Jun 16 14:42:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 14:42:41.080758 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7494f-868c-4d86-8b18-dd9ca02f10b3 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:41.095224 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7494f-868c-4d86-8b18-dd9ca02f10b3 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:41.099688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ce923-a1d9-4f42-aac0-2fb6cbfe045f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:41.100803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ce923-a1d9-4f42-aac0-2fb6cbfe045f admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:41.101096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ce923-a1d9-4f42-aac0-2fb6cbfe045f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:41.101420 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ce923-a1d9-4f42-aac0-2fb6cbfe045f admin admin] PATH_INFO: `/v3/projects/8bf0562aee55477696055292ce72d79e` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:41.102918 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ce923-a1d9-4f42-aac0-2fb6cbfe045f admin admin] RBAC: Authorizing `identity:get_project(project_id=8bf0562aee55477696055292ce72d79e)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:41.154443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4a1ce923-a1d9-4f42-aac0-2fb6cbfe045f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 14:42:41.154969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ce923-a1d9-4f42-aac0-2fb6cbfe045f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:41.159402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Thu Jun 16 14:42:41 2022] GET /identity/v3/projects/8bf0562aee55477696055292ce72d79e => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:43.260039 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80a0df-2002-47d0-bded-979cb7e0fd4d None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:43.260535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80a0df-2002-47d0-bded-979cb7e0fd4d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:43.260624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80a0df-2002-47d0-bded-979cb7e0fd4d None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:43.265042 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:42:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:43.270590 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d011c58-d599-41b2-aadf-5220ecfbd64f None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:43.270969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d011c58-d599-41b2-aadf-5220ecfbd64f None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:43.271151 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d011c58-d599-41b2-aadf-5220ecfbd64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:43.289448 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-9d011c58-d599-41b2-aadf-5220ecfbd64f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:43.290977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9d011c58-d599-41b2-aadf-5220ecfbd64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:43.298765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 16 14:42:43.321755 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80a0df-2002-47d0-bded-979cb7e0fd4d None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:43.333545 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80a0df-2002-47d0-bded-979cb7e0fd4d None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:43.337813 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77aff5-d3c9-4587-8f5c-7dbab63b39b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:43.338439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77aff5-d3c9-4587-8f5c-7dbab63b39b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:43.338726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77aff5-d3c9-4587-8f5c-7dbab63b39b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:43.339011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77aff5-d3c9-4587-8f5c-7dbab63b39b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:43.347068 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77aff5-d3c9-4587-8f5c-7dbab63b39b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:43.348906 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77aff5-d3c9-4587-8f5c-7dbab63b39b2 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:43.357551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Thu Jun 16 14:42:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 14:42:43.363007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d011c58-d599-41b2-aadf-5220ecfbd64f None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:43.372487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d011c58-d599-41b2-aadf-5220ecfbd64f None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:43.376881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd67ce-1a59-483d-a475-fb2e2c3df21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:43.377785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd67ce-1a59-483d-a475-fb2e2c3df21f admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:43.378077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd67ce-1a59-483d-a475-fb2e2c3df21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:43.378361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd67ce-1a59-483d-a475-fb2e2c3df21f admin admin] PATH_INFO: `/v3/users/7bd0a21fa70d4ea3afe606ec912fd867` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:43.379758 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd67ce-1a59-483d-a475-fb2e2c3df21f admin admin] RBAC: Authorizing `identity:get_user(user_id=7bd0a21fa70d4ea3afe606ec912fd867)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:43.382275 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd67ce-1a59-483d-a475-fb2e2c3df21f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:43.383826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Thu Jun 16 14:42:43 2022] GET /identity/v3/users/7bd0a21fa70d4ea3afe606ec912fd867 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:45.539624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad365e-ab48-4a48-aa21-eb0f0cd5a7e1 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.540186 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad365e-ab48-4a48-aa21-eb0f0cd5a7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.540304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad365e-ab48-4a48-aa21-eb0f0cd5a7e1 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.541776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:45.547656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b295c3-e08f-4c6d-aa88-1db8f524c939 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.548165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b295c3-e08f-4c6d-aa88-1db8f524c939 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.548246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b295c3-e08f-4c6d-aa88-1db8f524c939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.566813 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-16b295c3-e08f-4c6d-aa88-1db8f524c939 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:45.568006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-16b295c3-e08f-4c6d-aa88-1db8f524c939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:45.596539 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f9d27-30fb-4bf3-92d5-fadd63df3629 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.596832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f9d27-30fb-4bf3-92d5-fadd63df3629 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.597334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f9d27-30fb-4bf3-92d5-fadd63df3629 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.598695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:45.603784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875be33-c27d-4230-969d-0834512c26a0 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.604080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875be33-c27d-4230-969d-0834512c26a0 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.604366 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875be33-c27d-4230-969d-0834512c26a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.645475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG passlib.handlers.bcrypt [None req-a875be33-c27d-4230-969d-0834512c26a0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80273) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 14:42:45.645920 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG passlib.handlers.bcrypt [None req-a875be33-c27d-4230-969d-0834512c26a0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80273) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 14:42:45.647485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:45.669996 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b295c3-e08f-4c6d-aa88-1db8f524c939 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.692357 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-a875be33-c27d-4230-969d-0834512c26a0 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:45.694716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a875be33-c27d-4230-969d-0834512c26a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:45.695287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:45.777614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b295c3-e08f-4c6d-aa88-1db8f524c939 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.812130 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619422b2-8d6d-4b03-a61e-aec5622bfe63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.812853 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619422b2-8d6d-4b03-a61e-aec5622bfe63 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.813183 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619422b2-8d6d-4b03-a61e-aec5622bfe63 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.813470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619422b2-8d6d-4b03-a61e-aec5622bfe63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.819984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:45.824425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619422b2-8d6d-4b03-a61e-aec5622bfe63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:45.835658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-619422b2-8d6d-4b03-a61e-aec5622bfe63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:45.835658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:45.835658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:45.835658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:45.835658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:45.835658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:45.835658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:45.835658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:45.835658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:45.835658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:45.835658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:45.835658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:45.835658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:45.835658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:45.835658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:45.835658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:45.836694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:45.836694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:45.836694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:45.836694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:45.836694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:45.836694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:45.836694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:45.836694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:45.836694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:45.836694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:45.836694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:45.836694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:45.836694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:45.836694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:45.836694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:45.836694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:45.837549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:45.837549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:45.837549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:45.837549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:45.837549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:45.837549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:45.837549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:45.837549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:45.837549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:45.837549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:45.837549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:45.837549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:42:45.837549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:45.841548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875be33-c27d-4230-969d-0834512c26a0 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.842537 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619422b2-8d6d-4b03-a61e-aec5622bfe63 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:45.922265 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:45.941833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875be33-c27d-4230-969d-0834512c26a0 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.944730 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:45.945385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619422b2-8d6d-4b03-a61e-aec5622bfe63 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:45.980775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b84ed-8e99-49c6-b94c-68c687776fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.981934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b84ed-8e99-49c6-b94c-68c687776fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.982500 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b84ed-8e99-49c6-b94c-68c687776fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.982784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b84ed-8e99-49c6-b94c-68c687776fb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.984528 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174444-b1bd-4be8-aeb1-19c09653a7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:45.985240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174444-b1bd-4be8-aeb1-19c09653a7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:45.985542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174444-b1bd-4be8-aeb1-19c09653a7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:45.985829 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174444-b1bd-4be8-aeb1-19c09653a7a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:45.986587 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88174444-b1bd-4be8-aeb1-19c09653a7a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:45.986903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88174444-b1bd-4be8-aeb1-19c09653a7a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:45.988373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88174444-b1bd-4be8-aeb1-19c09653a7a1 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.000732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:46.006164 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174444-b1bd-4be8-aeb1-19c09653a7a1 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:46.054298 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b84ed-8e99-49c6-b94c-68c687776fb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.055810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b84ed-8e99-49c6-b94c-68c687776fb2 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.111149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174444-b1bd-4be8-aeb1-19c09653a7a1 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.146056 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cef3a1-3f0c-492a-a182-dd48e28234cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.147635 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cef3a1-3f0c-492a-a182-dd48e28234cb None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.147955 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cef3a1-3f0c-492a-a182-dd48e28234cb None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.148235 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cef3a1-3f0c-492a-a182-dd48e28234cb None admin] PATH_INFO: `/v3/users/7bd0a21fa70d4ea3afe606ec912fd867` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.149469 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cef3a1-3f0c-492a-a182-dd48e28234cb None admin] RBAC: Authorizing `identity:get_user(user_id=7bd0a21fa70d4ea3afe606ec912fd867)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.150922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cef3a1-3f0c-492a-a182-dd48e28234cb None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.152554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 9/16] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:46 2022] GET /identity/v3/users/7bd0a21fa70d4ea3afe606ec912fd867 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:46.157873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cef3a1-3f0c-492a-a182-dd48e28234cb None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:46.159142 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 8/17] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:42:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:42:46.164597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b84ed-8e99-49c6-b94c-68c687776fb2 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:46.167307 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:46.172013 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:46.257039 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cef3a1-3f0c-492a-a182-dd48e28234cb None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.260785 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b84ed-8e99-49c6-b94c-68c687776fb2 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.289686 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98600345-c608-4018-af9d-5b72063eb116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.290472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98600345-c608-4018-af9d-5b72063eb116 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.290757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98600345-c608-4018-af9d-5b72063eb116 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.291031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98600345-c608-4018-af9d-5b72063eb116 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.292198 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98600345-c608-4018-af9d-5b72063eb116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.293966 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98600345-c608-4018-af9d-5b72063eb116 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.294892 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6df1e-da1e-43ca-905f-2e86114a0b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.295650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 10/18] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:46.295776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6df1e-da1e-43ca-905f-2e86114a0b87 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.296128 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6df1e-da1e-43ca-905f-2e86114a0b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.296414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6df1e-da1e-43ca-905f-2e86114a0b87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.301376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98600345-c608-4018-af9d-5b72063eb116 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:46.315290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6df1e-da1e-43ca-905f-2e86114a0b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.316775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6df1e-da1e-43ca-905f-2e86114a0b87 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.337770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-d0f6df1e-da1e-43ca-905f-2e86114a0b87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:46.337770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:46.337770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:46.337770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:46.337770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:46.337770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:46.337770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:46.337770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:46.337770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:46.337770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:46.337770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:46.337770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:46.337770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:46.337770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:46.337770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:46.338629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:46.339438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:46.339438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:46.339438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:46.339438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:42:46.339438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 9/19] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:46.344763 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6df1e-da1e-43ca-905f-2e86114a0b87 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:46.381111 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:46.400723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:46.407795 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98600345-c608-4018-af9d-5b72063eb116 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.447395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c876d73-7b8e-4903-94e8-edd715649c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.448152 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c876d73-7b8e-4903-94e8-edd715649c2e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.448448 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c876d73-7b8e-4903-94e8-edd715649c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.448599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6df1e-da1e-43ca-905f-2e86114a0b87 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:46.448733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c876d73-7b8e-4903-94e8-edd715649c2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.449597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c876d73-7b8e-4903-94e8-edd715649c2e None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.domain.id=default, user.id=7bd0a21fa70d4ea3afe606ec912fd867) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:46.449913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c876d73-7b8e-4903-94e8-edd715649c2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.451375 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c876d73-7b8e-4903-94e8-edd715649c2e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.458056 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 11/20] 10.222.0.23 () {56 vars in 1322 bytes} [Thu Jun 16 14:42:46 2022] GET /identity/v3/role_assignments?user.id=7bd0a21fa70d4ea3afe606ec912fd867&scope.domain.id=default&role.id=c865040abd6c4b099381557da21c471d => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:46.483043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29feb905-958b-43e6-b1f3-2058e27af3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:46.483735 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feb905-958b-43e6-b1f3-2058e27af3ae None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:46.484026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feb905-958b-43e6-b1f3-2058e27af3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:46.484311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feb905-958b-43e6-b1f3-2058e27af3ae None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:46.485062 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29feb905-958b-43e6-b1f3-2058e27af3ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:46.485411 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29feb905-958b-43e6-b1f3-2058e27af3ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:46.486858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29feb905-958b-43e6-b1f3-2058e27af3ae None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:46.507157 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 10/21] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:49.005654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22d70d-0f3a-48f8-b12a-1ddee36dbe20 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.007268 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22d70d-0f3a-48f8-b12a-1ddee36dbe20 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.007768 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22d70d-0f3a-48f8-b12a-1ddee36dbe20 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.009635 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:42:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:49.015388 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1edf9-0042-477f-8d57-91a4c9c8d605 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.016204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1edf9-0042-477f-8d57-91a4c9c8d605 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.016685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1edf9-0042-477f-8d57-91a4c9c8d605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.046349 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-b3a1edf9-0042-477f-8d57-91a4c9c8d605 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:49.047916 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b3a1edf9-0042-477f-8d57-91a4c9c8d605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:49.139678 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:49.177538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22d70d-0f3a-48f8-b12a-1ddee36dbe20 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:49.322456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22d70d-0f3a-48f8-b12a-1ddee36dbe20 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:49.370357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8593ea-68cc-4da5-a6a2-a317b2cc6c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:49.371497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8593ea-68cc-4da5-a6a2-a317b2cc6c6d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.371985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8593ea-68cc-4da5-a6a2-a317b2cc6c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.372477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8593ea-68cc-4da5-a6a2-a317b2cc6c6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.390191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8593ea-68cc-4da5-a6a2-a317b2cc6c6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:49.391989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8593ea-68cc-4da5-a6a2-a317b2cc6c6d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:49.394908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:49.412987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-df8593ea-68cc-4da5-a6a2-a317b2cc6c6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:49.412987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:49.412987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:49.412987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:49.412987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:49.412987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:49.412987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:49.412987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:49.412987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:49.412987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:49.412987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:49.412987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:49.412987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:42:49.412987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:42:49.412987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:49.417158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:49.417981 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:42:49.417981 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:42:49.417981 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:42:49.417981 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:42:49.417981 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 13/24] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:49.420011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1edf9-0042-477f-8d57-91a4c9c8d605 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:49.454327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e59de-f091-422b-88d5-8d2088a10cda None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.454655 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e59de-f091-422b-88d5-8d2088a10cda None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.454907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e59de-f091-422b-88d5-8d2088a10cda None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.456331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 14/25] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:49.474178 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524ed11-b267-4f27-ab13-4c9e3a3fa87c None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.474512 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524ed11-b267-4f27-ab13-4c9e3a3fa87c None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.474754 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524ed11-b267-4f27-ab13-4c9e3a3fa87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.512313 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-8524ed11-b267-4f27-ab13-4c9e3a3fa87c None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:49.513557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-8524ed11-b267-4f27-ab13-4c9e3a3fa87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:49.524855 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:49.599096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1edf9-0042-477f-8d57-91a4c9c8d605 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:49.646885 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4eae55-2a04-4e20-be1d-c4c7f6ecacf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:49.647572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4eae55-2a04-4e20-be1d-c4c7f6ecacf9 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.647863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4eae55-2a04-4e20-be1d-c4c7f6ecacf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.648148 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4eae55-2a04-4e20-be1d-c4c7f6ecacf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.648886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4eae55-2a04-4e20-be1d-c4c7f6ecacf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:49.649227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4eae55-2a04-4e20-be1d-c4c7f6ecacf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:49.650631 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4eae55-2a04-4e20-be1d-c4c7f6ecacf9 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:49.669804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 15/26] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 16 14:42:49.671622 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 12/27] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:49.671856 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5876f-c1e8-4767-a1b5-739a4858d0c1 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.672162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5876f-c1e8-4767-a1b5-739a4858d0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.672444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5876f-c1e8-4767-a1b5-739a4858d0c1 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.673593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34350f-d623-4a60-b650-70e4589ef85e None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.673888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 16/28] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:49.674232 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34350f-d623-4a60-b650-70e4589ef85e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.674697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34350f-d623-4a60-b650-70e4589ef85e None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.676327 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 13/29] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:49.679743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5876f-c1e8-4767-a1b5-739a4858d0c1 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:49.682283 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c137ba-c899-4826-8f21-70469f8a7b4b None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.682775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c137ba-c899-4826-8f21-70469f8a7b4b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.684366 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c137ba-c899-4826-8f21-70469f8a7b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.701849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-59c137ba-c899-4826-8f21-70469f8a7b4b None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:49.703307 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-59c137ba-c899-4826-8f21-70469f8a7b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:49.777366 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 14/30] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:49.779145 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752241e-8283-45b3-ad7e-fc358cf3129d None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.779636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752241e-8283-45b3-ad7e-fc358cf3129d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.780156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752241e-8283-45b3-ad7e-fc358cf3129d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.798419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-2752241e-8283-45b3-ad7e-fc358cf3129d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:49.800034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2752241e-8283-45b3-ad7e-fc358cf3129d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:49.801563 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5876f-c1e8-4767-a1b5-739a4858d0c1 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:49.829748 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:49.834821 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:49.839584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bac619-92fc-4a40-b95e-3bbc591939be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:49.840481 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bac619-92fc-4a40-b95e-3bbc591939be None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:49.840923 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bac619-92fc-4a40-b95e-3bbc591939be None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:49.841367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bac619-92fc-4a40-b95e-3bbc591939be None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:49.842215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bac619-92fc-4a40-b95e-3bbc591939be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:49.845834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bac619-92fc-4a40-b95e-3bbc591939be None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:49.879955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 15/31] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:49.879955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752241e-8283-45b3-ad7e-fc358cf3129d None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:49.996762 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752241e-8283-45b3-ad7e-fc358cf3129d None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:50.035993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57e892-33d5-4d6a-a15b-0ac928796f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:50.036796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57e892-33d5-4d6a-a15b-0ac928796f8f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:50.037360 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57e892-33d5-4d6a-a15b-0ac928796f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:50.038345 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57e892-33d5-4d6a-a15b-0ac928796f8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:50.050435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57e892-33d5-4d6a-a15b-0ac928796f8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:50.060100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-5f57e892-33d5-4d6a-a15b-0ac928796f8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:50.060100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:50.060100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:50.060100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:50.060100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:50.060100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:50.060100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:50.060100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:50.060100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:50.060100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:50.060100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:50.060100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:50.060100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:50.060100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:50.060100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:50.060100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:50.061227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:50.061227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:50.061227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:50.061227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:50.061227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:50.061227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:50.061227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:50.061227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:50.061227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:50.061227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:50.061227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:50.061227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:50.061227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:50.061227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:50.061227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:50.061227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:50.062141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:50.062141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:50.062141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:50.062141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:50.062141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:50.062141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:50.062141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:50.062141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:50.062141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:50.062141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:50.062141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:50.062141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:42:50.064184 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 16/32] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:42:50.065195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57e892-33d5-4d6a-a15b-0ac928796f8f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:50.098512 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:50.194535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57e892-33d5-4d6a-a15b-0ac928796f8f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:50.205443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 17/33] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 16 14:42:49 2022] POST /identity/v3/projects => generated 301 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:50.206624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bac619-92fc-4a40-b95e-3bbc591939be None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:50.239574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad01e3-a293-422f-826c-4135012280df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:50.240586 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad01e3-a293-422f-826c-4135012280df None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:50.241088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad01e3-a293-422f-826c-4135012280df None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:50.241577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad01e3-a293-422f-826c-4135012280df None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:50.242660 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad01e3-a293-422f-826c-4135012280df None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:50.244414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad01e3-a293-422f-826c-4135012280df None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:50.359424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bac619-92fc-4a40-b95e-3bbc591939be None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:50.401194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecfcaa-5487-43c7-8042-eea87a8ca042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:50.401194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecfcaa-5487-43c7-8042-eea87a8ca042 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:50.401194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecfcaa-5487-43c7-8042-eea87a8ca042 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:50.401194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecfcaa-5487-43c7-8042-eea87a8ca042 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:50.401568 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecfcaa-5487-43c7-8042-eea87a8ca042 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:50.401916 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecfcaa-5487-43c7-8042-eea87a8ca042 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:50.434389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 17/34] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Jun 16 14:42:50 2022] POST /identity/v3/roles => generated 225 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:50.435400 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad01e3-a293-422f-826c-4135012280df None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:50.483224 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 18/35] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Jun 16 14:42:50 2022] POST /identity/v3/roles => generated 219 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:50.485377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b17c7-1a6d-42e5-892f-9b7ebb0f10ef None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:50.485923 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b17c7-1a6d-42e5-892f-9b7ebb0f10ef None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:50.486409 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b17c7-1a6d-42e5-892f-9b7ebb0f10ef None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:50.488355 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:50.494470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcd7fc-a2d3-457e-b975-27a3fcb7fcb8 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:50.494811 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcd7fc-a2d3-457e-b975-27a3fcb7fcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:50.498031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcd7fc-a2d3-457e-b975-27a3fcb7fcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:50.543008 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-65dcd7fc-a2d3-457e-b975-27a3fcb7fcb8 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:50.546489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-65dcd7fc-a2d3-457e-b975-27a3fcb7fcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:50.593022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:50.608646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:50.614514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad01e3-a293-422f-826c-4135012280df None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:50.655832 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 20/37] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:50.657301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06687d60-1ed3-43b3-9e21-25d7d5b7ea14 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:50.663533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06687d60-1ed3-43b3-9e21-25d7d5b7ea14 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:50.663533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06687d60-1ed3-43b3-9e21-25d7d5b7ea14 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:50.663533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 21/38] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:50.665583 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a08cf-279c-433d-9c4d-cf8bff4da175 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:50.666021 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ffed0-bba8-4910-9cb5-baeaebebd5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:50.666192 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a08cf-279c-433d-9c4d-cf8bff4da175 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:50.666655 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a08cf-279c-433d-9c4d-cf8bff4da175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:50.666761 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ffed0-bba8-4910-9cb5-baeaebebd5df None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:50.667007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ffed0-bba8-4910-9cb5-baeaebebd5df None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:50.667297 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ffed0-bba8-4910-9cb5-baeaebebd5df None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:50.668089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ffed0-bba8-4910-9cb5-baeaebebd5df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:50.668407 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ffed0-bba8-4910-9cb5-baeaebebd5df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:50.670321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ffed0-bba8-4910-9cb5-baeaebebd5df None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:50.688847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-cd4a08cf-279c-433d-9c4d-cf8bff4da175 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:50.690143 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-cd4a08cf-279c-433d-9c4d-cf8bff4da175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:50.774969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 22/39] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:50.775697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a08cf-279c-433d-9c4d-cf8bff4da175 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:50.800889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 18/40] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:50.802057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ffed0-bba8-4910-9cb5-baeaebebd5df None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:50.874610 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:50.878057 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a08cf-279c-433d-9c4d-cf8bff4da175 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:50.902169 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ffed0-bba8-4910-9cb5-baeaebebd5df None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:50.913984 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0bec8-67e2-4a46-ba2d-4e759b5d3d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:50.914785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0bec8-67e2-4a46-ba2d-4e759b5d3d77 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:50.915075 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0bec8-67e2-4a46-ba2d-4e759b5d3d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:50.915358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0bec8-67e2-4a46-ba2d-4e759b5d3d77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:50.916524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0bec8-67e2-4a46-ba2d-4e759b5d3d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:50.918034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0bec8-67e2-4a46-ba2d-4e759b5d3d77 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:50.919641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 23/41] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:50.920402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0bec8-67e2-4a46-ba2d-4e759b5d3d77 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:50.938786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d5ce9-b931-44b2-95f0-4597312c549e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:50.939465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d5ce9-b931-44b2-95f0-4597312c549e None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:50.939758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d5ce9-b931-44b2-95f0-4597312c549e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:50.940042 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d5ce9-b931-44b2-95f0-4597312c549e None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:50.940790 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d5ce9-b931-44b2-95f0-4597312c549e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:50.944476 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d5ce9-b931-44b2-95f0-4597312c549e None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:51.019795 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0bec8-67e2-4a46-ba2d-4e759b5d3d77 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:51.049600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 19/42] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Jun 16 14:42:50 2022] POST /identity/v3/roles => generated 223 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:51.050360 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d5ce9-b931-44b2-95f0-4597312c549e None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:51.061536 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d361-5be5-460a-82b3-c26278736382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:51.062617 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d361-5be5-460a-82b3-c26278736382 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:51.062913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d361-5be5-460a-82b3-c26278736382 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:51.063205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1d361-5be5-460a-82b3-c26278736382 None admin] PATH_INFO: `/v3/users/7bd0a21fa70d4ea3afe606ec912fd867` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:51.063391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:51.064592 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1d361-5be5-460a-82b3-c26278736382 None admin] RBAC: Authorizing `identity:get_user(user_id=7bd0a21fa70d4ea3afe606ec912fd867)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:51.075599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1d361-5be5-460a-82b3-c26278736382 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:51.075599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 24/43] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:50 2022] GET /identity/v3/users/7bd0a21fa70d4ea3afe606ec912fd867 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:51.075599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d361-5be5-460a-82b3-c26278736382 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:51.118634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:51.172261 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d5ce9-b931-44b2-95f0-4597312c549e None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:51.191369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1d361-5be5-460a-82b3-c26278736382 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:51.214542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a8453-1d6e-44c6-9c53-2afe806e6efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:51.215597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a8453-1d6e-44c6-9c53-2afe806e6efb None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:51.216666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a8453-1d6e-44c6-9c53-2afe806e6efb None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:51.217083 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a8453-1d6e-44c6-9c53-2afe806e6efb None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:51.218247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a8453-1d6e-44c6-9c53-2afe806e6efb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:51.219871 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a8453-1d6e-44c6-9c53-2afe806e6efb None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:51.231267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfd27d-e46c-4f63-bfb9-f914104d3470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:51.232071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfd27d-e46c-4f63-bfb9-f914104d3470 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:51.233577 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfd27d-e46c-4f63-bfb9-f914104d3470 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:51.233577 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfd27d-e46c-4f63-bfb9-f914104d3470 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:51.234653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfd27d-e46c-4f63-bfb9-f914104d3470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:51.236775 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfd27d-e46c-4f63-bfb9-f914104d3470 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:51.239524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 25/44] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:51.247105 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfd27d-e46c-4f63-bfb9-f914104d3470 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:51.326367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 20/45] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 16 14:42:51 2022] POST /identity/v3/projects => generated 312 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:51.356812 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfd27d-e46c-4f63-bfb9-f914104d3470 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:51.358752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:51.394623 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572e6c5-3c54-4d86-a397-1572abd161c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:51.395523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572e6c5-3c54-4d86-a397-1572abd161c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:51.396070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572e6c5-3c54-4d86-a397-1572abd161c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:51.396355 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572e6c5-3c54-4d86-a397-1572abd161c7 None admin] PATH_INFO: `/v3/domains/default/users/7bd0a21fa70d4ea3afe606ec912fd867/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:51.398541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572e6c5-3c54-4d86-a397-1572abd161c7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7bd0a21fa70d4ea3afe606ec912fd867, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:51.400054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572e6c5-3c54-4d86-a397-1572abd161c7 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:51.467226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 26/46] 10.222.0.23 () {58 vars in 1361 bytes} [Thu Jun 16 14:42:51 2022] PUT /identity/v3/domains/default/users/7bd0a21fa70d4ea3afe606ec912fd867/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:42:53.456953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec668d-205e-4a11-9fde-63bae2802ea1 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.457494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec668d-205e-4a11-9fde-63bae2802ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.457592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec668d-205e-4a11-9fde-63bae2802ea1 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.458925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 21/47] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:53.464294 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c23de2-0bd9-4528-86e8-93fd4042a456 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.464706 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c23de2-0bd9-4528-86e8-93fd4042a456 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.464873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c23de2-0bd9-4528-86e8-93fd4042a456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.481699 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-55c23de2-0bd9-4528-86e8-93fd4042a456 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:53.482946 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-55c23de2-0bd9-4528-86e8-93fd4042a456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:53.552043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 27/48] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:53.575702 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec668d-205e-4a11-9fde-63bae2802ea1 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.581902 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dabfd8-d2af-4c98-bcdf-1edbcf610759 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.582197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dabfd8-d2af-4c98-bcdf-1edbcf610759 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.582478 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dabfd8-d2af-4c98-bcdf-1edbcf610759 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.584025 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 28/49] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:53.590751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149182-cef8-4648-bff1-801af0c3970d None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.591041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149182-cef8-4648-bff1-801af0c3970d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.591324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149182-cef8-4648-bff1-801af0c3970d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.608357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-9c149182-cef8-4648-bff1-801af0c3970d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:53.609589 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9c149182-cef8-4648-bff1-801af0c3970d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:53.636258 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.675267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 29/50] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:42:53.677547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec668d-205e-4a11-9fde-63bae2802ea1 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.698801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c149182-cef8-4648-bff1-801af0c3970d None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.711975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abab2b6-7ddb-461d-bd38-9c451e6c073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.712721 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abab2b6-7ddb-461d-bd38-9c451e6c073b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.713006 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abab2b6-7ddb-461d-bd38-9c451e6c073b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.713324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abab2b6-7ddb-461d-bd38-9c451e6c073b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.714517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abab2b6-7ddb-461d-bd38-9c451e6c073b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.715987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abab2b6-7ddb-461d-bd38-9c451e6c073b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:53.717640 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 22/51] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:53.722565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.723034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abab2b6-7ddb-461d-bd38-9c451e6c073b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.797465 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c149182-cef8-4648-bff1-801af0c3970d None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.821887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abab2b6-7ddb-461d-bd38-9c451e6c073b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.830881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4cde0-2d96-49ca-92ea-f7715a9b7bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.831760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4cde0-2d96-49ca-92ea-f7715a9b7bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.832052 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4cde0-2d96-49ca-92ea-f7715a9b7bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.832335 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4cde0-2d96-49ca-92ea-f7715a9b7bc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.842952 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4cde0-2d96-49ca-92ea-f7715a9b7bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:42:53.848738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.851248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-53d4cde0-2d96-49ca-92ea-f7715a9b7bc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:53.851248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:42:53.851248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:42:53.851248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:42:53.851248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:42:53.851248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:42:53.851248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:42:53.851248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:42:53.851248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:42:53.851248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:42:53.851248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:42:53.851248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:42:53.851248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:42:53.851248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:42:53.851248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:42:53.851248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:42:53.852065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:42:53.852065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:42:53.852065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:42:53.852065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:42:53.852065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:42:53.852065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:42:53.852065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:42:53.852065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:42:53.852065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:42:53.852065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:42:53.852065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:42:53.852065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:42:53.852065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:42:53.852065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:42:53.852065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:42:53.852065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:42:53.852863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:42:53.852863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:42:53.852863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:42:53.852863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:42:53.852863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:42:53.852863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:42:53.852863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:42:53.852863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:42:53.852863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:42:53.852863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:42:53.852863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:42:53.852863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:42:53.852863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 30/52] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:42:53.861827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c737681-16f2-4842-8828-b963eb87f611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.861827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c737681-16f2-4842-8828-b963eb87f611 None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.861827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c737681-16f2-4842-8828-b963eb87f611 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.861827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c737681-16f2-4842-8828-b963eb87f611 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.862109 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c737681-16f2-4842-8828-b963eb87f611 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.862172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4cde0-2d96-49ca-92ea-f7715a9b7bc1 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:53.862243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c737681-16f2-4842-8828-b963eb87f611 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:53.938670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:53.955893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4cde0-2d96-49ca-92ea-f7715a9b7bc1 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:53.982910 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 23/53] 10.222.0.23 () {60 vars in 1140 bytes} [Thu Jun 16 14:42:53 2022] POST /identity/v3/projects => generated 298 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:42:53.989104 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c185f4e-2a7e-4828-ba0f-e7831b61d6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:53.989828 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c185f4e-2a7e-4828-ba0f-e7831b61d6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:53.990133 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c185f4e-2a7e-4828-ba0f-e7831b61d6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:53.990411 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c185f4e-2a7e-4828-ba0f-e7831b61d6a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:53.991225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c185f4e-2a7e-4828-ba0f-e7831b61d6a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:53.991541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c185f4e-2a7e-4828-ba0f-e7831b61d6a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:53.993301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c185f4e-2a7e-4828-ba0f-e7831b61d6a3 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:54.003440 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 31/54] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:42:54.009892 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c737681-16f2-4842-8828-b963eb87f611 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:54.120514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c737681-16f2-4842-8828-b963eb87f611 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:54.156351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19593fd-d8a1-4c53-9311-0d561dc474be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:54.157271 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19593fd-d8a1-4c53-9311-0d561dc474be None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:54.157572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19593fd-d8a1-4c53-9311-0d561dc474be None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:54.157862 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19593fd-d8a1-4c53-9311-0d561dc474be None admin] PATH_INFO: `/v3/users/7bd0a21fa70d4ea3afe606ec912fd867` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:54.159358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19593fd-d8a1-4c53-9311-0d561dc474be None admin] RBAC: Authorizing `identity:get_user(user_id=7bd0a21fa70d4ea3afe606ec912fd867)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:54.160826 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19593fd-d8a1-4c53-9311-0d561dc474be None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:54.162676 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 24/55] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:42:54 2022] GET /identity/v3/users/7bd0a21fa70d4ea3afe606ec912fd867 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:54.168076 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c185f4e-2a7e-4828-ba0f-e7831b61d6a3 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:54.268747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c185f4e-2a7e-4828-ba0f-e7831b61d6a3 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:54.301827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168dd6b-cf70-4c7e-87d6-22d58825b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:54.302629 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168dd6b-cf70-4c7e-87d6-22d58825b220 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:54.302917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168dd6b-cf70-4c7e-87d6-22d58825b220 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:54.303197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168dd6b-cf70-4c7e-87d6-22d58825b220 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:54.304397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168dd6b-cf70-4c7e-87d6-22d58825b220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:54.305879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168dd6b-cf70-4c7e-87d6-22d58825b220 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:54.307501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 32/56] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:54.313207 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19593fd-d8a1-4c53-9311-0d561dc474be None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:54.361849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:54.411837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19593fd-d8a1-4c53-9311-0d561dc474be None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:54.445460 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3548d-6c59-42fb-a2b4-10d3354b557b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:54.446128 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3548d-6c59-42fb-a2b4-10d3354b557b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:54.446426 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3548d-6c59-42fb-a2b4-10d3354b557b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:54.446710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3548d-6c59-42fb-a2b4-10d3354b557b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:54.447541 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3548d-6c59-42fb-a2b4-10d3354b557b None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.domain.id=default, user.id=7bd0a21fa70d4ea3afe606ec912fd867) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:42:54.447861 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3548d-6c59-42fb-a2b4-10d3354b557b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:54.449347 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3548d-6c59-42fb-a2b4-10d3354b557b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:54.457972 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 25/57] 10.222.0.23 () {56 vars in 1322 bytes} [Thu Jun 16 14:42:54 2022] GET /identity/v3/role_assignments?user.id=7bd0a21fa70d4ea3afe606ec912fd867&scope.domain.id=default&role.id=c865040abd6c4b099381557da21c471d => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:56.138203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1e010-ef16-460c-be02-cc49babf79de None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.138709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1e010-ef16-460c-be02-cc49babf79de None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.138818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1e010-ef16-460c-be02-cc49babf79de None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.140146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 33/58] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:56.145123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d622ebe-eb4d-4b44-b864-b703d1be56b9 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.145535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d622ebe-eb4d-4b44-b864-b703d1be56b9 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.145752 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d622ebe-eb4d-4b44-b864-b703d1be56b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.162602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-7d622ebe-eb4d-4b44-b864-b703d1be56b9 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:56.164123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-7d622ebe-eb4d-4b44-b864-b703d1be56b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:56.228166 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 26/59] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:56.252260 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1e010-ef16-460c-be02-cc49babf79de None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:56.267198 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:56.358627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1e010-ef16-460c-be02-cc49babf79de None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:56.397445 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4b823-6c63-4d60-951c-80750f62f775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:56.398241 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4b823-6c63-4d60-951c-80750f62f775 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.398533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4b823-6c63-4d60-951c-80750f62f775 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.398817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4b823-6c63-4d60-951c-80750f62f775 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.399987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4b823-6c63-4d60-951c-80750f62f775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:56.401468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4b823-6c63-4d60-951c-80750f62f775 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:56.403095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 34/60] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:42:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:42:56.408714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d622ebe-eb4d-4b44-b864-b703d1be56b9 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:42:56.450026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:42:56.503532 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d622ebe-eb4d-4b44-b864-b703d1be56b9 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:42:56.535278 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4829a5c-df82-4a35-9ff6-1e4677d4748f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:42:56.535939 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4829a5c-df82-4a35-9ff6-1e4677d4748f None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:56.536228 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4829a5c-df82-4a35-9ff6-1e4677d4748f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:56.536505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4829a5c-df82-4a35-9ff6-1e4677d4748f None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:56.537247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4829a5c-df82-4a35-9ff6-1e4677d4748f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:42:56.539215 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4829a5c-df82-4a35-9ff6-1e4677d4748f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:42:56.620614 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 27/61] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:42:56 2022] POST /identity/v3/users => generated 275 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:42:59.841341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe4ae0-1383-43e1-93cd-f021b07f72c5 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:59.842359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe4ae0-1383-43e1-93cd-f021b07f72c5 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:59.842847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe4ae0-1383-43e1-93cd-f021b07f72c5 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:59.844575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 35/62] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:42:59.850346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1492d8d-5c82-4b79-9adc-d6787afa5651 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:59.850873 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1492d8d-5c82-4b79-9adc-d6787afa5651 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:59.851545 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1492d8d-5c82-4b79-9adc-d6787afa5651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:59.874172 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-a1492d8d-5c82-4b79-9adc-d6787afa5651 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:59.875391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a1492d8d-5c82-4b79-9adc-d6787afa5651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:59.908428 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b63d66-69b2-4683-ac26-276800e16ce2 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:59.908740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b63d66-69b2-4683-ac26-276800e16ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:59.909030 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b63d66-69b2-4683-ac26-276800e16ce2 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:59.910442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 36/63] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:42:59.916970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5efcd-7bc8-42b2-865d-fec0c9343dda None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:42:59.917301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5efcd-7bc8-42b2-865d-fec0c9343dda None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:42:59.917593 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5efcd-7bc8-42b2-865d-fec0c9343dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:42:59.953875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-a0f5efcd-7bc8-42b2-865d-fec0c9343dda None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:42:59.955112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a0f5efcd-7bc8-42b2-865d-fec0c9343dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:42:59.955935 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 28/64] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:42:59.998289 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1492d8d-5c82-4b79-9adc-d6787afa5651 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.033601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:00.120169 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 37/65] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:00.120381 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1492d8d-5c82-4b79-9adc-d6787afa5651 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.121868 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2dda1-728c-432a-9a42-bfd9970536a3 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.122394 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2dda1-728c-432a-9a42-bfd9970536a3 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.122803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2dda1-728c-432a-9a42-bfd9970536a3 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.128048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 38/66] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:00.129857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f0e4f-f4ea-431a-8b3f-87126447a20e None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.130299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f0e4f-f4ea-431a-8b3f-87126447a20e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.130726 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f0e4f-f4ea-431a-8b3f-87126447a20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.163571 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e03dbd-0458-48b0-b8a8-162103e33745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.164527 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e03dbd-0458-48b0-b8a8-162103e33745 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.164926 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e03dbd-0458-48b0-b8a8-162103e33745 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.165359 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e03dbd-0458-48b0-b8a8-162103e33745 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.166625 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-147f0e4f-f4ea-431a-8b3f-87126447a20e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:00.168011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-147f0e4f-f4ea-431a-8b3f-87126447a20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:00.172069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:00.179737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e03dbd-0458-48b0-b8a8-162103e33745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:00.190872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-e3e03dbd-0458-48b0-b8a8-162103e33745 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:00.190872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:00.190872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:00.190872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:00.190872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:00.190872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:00.190872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:00.190872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:00.190872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:00.190872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:00.190872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:00.190872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:00.190872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:00.190872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:00.190872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:00.190872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:00.191737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:00.191737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:00.191737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:00.191737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:00.191737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:00.191737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:00.191737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:00.191737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:00.191737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:00.191737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:00.191737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:00.191737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:00.191737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:00.191737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:00.191737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:00.191737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:00.197815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:00.197815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:00.197815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:00.197815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:00.197815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:00.197815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:00.197815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:00.197815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:00.197815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:00.197815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:00.197815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:00.197815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:00.197815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 29/67] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:42:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:00.197815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e03dbd-0458-48b0-b8a8-162103e33745 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.256542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 39/68] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:00.258100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f0e4f-f4ea-431a-8b3f-87126447a20e None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.305659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:00.318758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e03dbd-0458-48b0-b8a8-162103e33745 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.354789 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50f37a-f1f0-4f7e-8bf5-20e6cc5ac2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.355596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50f37a-f1f0-4f7e-8bf5-20e6cc5ac2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.355891 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50f37a-f1f0-4f7e-8bf5-20e6cc5ac2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.356186 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50f37a-f1f0-4f7e-8bf5-20e6cc5ac2f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.366614 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50f37a-f1f0-4f7e-8bf5-20e6cc5ac2f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:00.373805 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f0e4f-f4ea-431a-8b3f-87126447a20e None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.374485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-9e50f37a-f1f0-4f7e-8bf5-20e6cc5ac2f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:00.374485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:00.374485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:00.374485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:00.374485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:00.374485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:00.374485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:00.374485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:00.374485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:00.374485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:00.374485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:00.374485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:00.374485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:00.374485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:00.374485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:00.374485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:00.375324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:00.375324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:00.375324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:00.375324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:00.375324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:00.375324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:00.375324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:00.375324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:00.375324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:00.375324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:00.375324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:00.375324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:00.375324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:00.375324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:00.375324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:00.375324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:00.376057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:00.376057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:00.376057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:00.376057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:00.376057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:00.376057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:00.376057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:00.376057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:00.376057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:00.376057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:00.376057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:00.376057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:00.376057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 30/69] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:00.377470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50f37a-f1f0-4f7e-8bf5-20e6cc5ac2f8 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.415622 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f755a-5a4a-4df8-b383-3ee915449242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.416307 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f755a-5a4a-4df8-b383-3ee915449242 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.416598 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f755a-5a4a-4df8-b383-3ee915449242 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.416883 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f755a-5a4a-4df8-b383-3ee915449242 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.417682 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f755a-5a4a-4df8-b383-3ee915449242 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:00.418003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f755a-5a4a-4df8-b383-3ee915449242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:00.419404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f755a-5a4a-4df8-b383-3ee915449242 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:00.427973 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 40/70] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:00.429974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2d006-c695-4df6-a179-c5d74fa562c3 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.430273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2d006-c695-4df6-a179-c5d74fa562c3 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.430561 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2d006-c695-4df6-a179-c5d74fa562c3 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.431814 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 41/71] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:00.432743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2d006-c695-4df6-a179-c5d74fa562c3 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.435881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:00.490574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50f37a-f1f0-4f7e-8bf5-20e6cc5ac2f8 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.526261 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af4bff-ea1f-4e9d-98be-daf3cefabf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.527338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4bff-ea1f-4e9d-98be-daf3cefabf88 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.527632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4bff-ea1f-4e9d-98be-daf3cefabf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.527918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4bff-ea1f-4e9d-98be-daf3cefabf88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.538582 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af4bff-ea1f-4e9d-98be-daf3cefabf88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:00.540077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2d006-c695-4df6-a179-c5d74fa562c3 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.546909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-23af4bff-ea1f-4e9d-98be-daf3cefabf88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:00.546909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:00.546909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:00.546909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:00.546909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:00.546909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:00.546909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:00.546909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:00.546909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:00.546909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:00.546909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:00.546909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:00.546909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:00.546909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:00.546909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:00.546909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:00.547802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:00.547802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:00.547802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:00.547802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:00.547802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:00.547802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:00.547802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:00.547802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:00.547802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:00.547802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:00.547802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:00.547802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:00.547802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:00.547802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:00.547802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:00.547802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:00.548693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:00.548693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:00.548693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:00.548693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:00.548693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:00.548693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:00.548693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:00.548693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:00.548693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:00.548693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:00.548693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:00.548693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:00.548693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 31/72] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:00.549916 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af4bff-ea1f-4e9d-98be-daf3cefabf88 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.564007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:00.580095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182170a-9fa7-4065-964f-04e3293f30ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.585530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182170a-9fa7-4065-964f-04e3293f30ae None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.585530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182170a-9fa7-4065-964f-04e3293f30ae None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.585530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182170a-9fa7-4065-964f-04e3293f30ae None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.585530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182170a-9fa7-4065-964f-04e3293f30ae None admin] RBAC: Adding query filter params (name=member) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:00.585530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182170a-9fa7-4065-964f-04e3293f30ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:00.585530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182170a-9fa7-4065-964f-04e3293f30ae None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:00.592779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 42/73] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:00.594015 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d12b7-dbe1-4a22-8f3b-75df9f3e71cc None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.594366 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d12b7-dbe1-4a22-8f3b-75df9f3e71cc None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.594582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d12b7-dbe1-4a22-8f3b-75df9f3e71cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.610917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-3a2d12b7-dbe1-4a22-8f3b-75df9f3e71cc None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:00.612119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-3a2d12b7-dbe1-4a22-8f3b-75df9f3e71cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:00.658876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af4bff-ea1f-4e9d-98be-daf3cefabf88 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.672913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:00.683140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 43/74] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:00.690228 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d12b7-dbe1-4a22-8f3b-75df9f3e71cc None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.703682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7523d0-f80c-4d84-9637-71ca714e5af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.704599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7523d0-f80c-4d84-9637-71ca714e5af2 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.704893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7523d0-f80c-4d84-9637-71ca714e5af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.705205 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7523d0-f80c-4d84-9637-71ca714e5af2 None admin] PATH_INFO: `/v3/users/7bd0a21fa70d4ea3afe606ec912fd867` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.706872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7523d0-f80c-4d84-9637-71ca714e5af2 None admin] RBAC: Authorizing `identity:get_user(user_id=7bd0a21fa70d4ea3afe606ec912fd867)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:00.708405 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7523d0-f80c-4d84-9637-71ca714e5af2 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:00.710117 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 32/75] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:00 2022] GET /identity/v3/users/7bd0a21fa70d4ea3afe606ec912fd867 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:00.710935 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7523d0-f80c-4d84-9637-71ca714e5af2 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.789404 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:00.803947 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d12b7-dbe1-4a22-8f3b-75df9f3e71cc None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.811687 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7523d0-f80c-4d84-9637-71ca714e5af2 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.836965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a9ae6-49b6-43fc-9580-4915d460eb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.837858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a9ae6-49b6-43fc-9580-4915d460eb61 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.838144 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a9ae6-49b6-43fc-9580-4915d460eb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.838425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a9ae6-49b6-43fc-9580-4915d460eb61 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.839175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a9ae6-49b6-43fc-9580-4915d460eb61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:00.839485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a9ae6-49b6-43fc-9580-4915d460eb61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:00.840889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a9ae6-49b6-43fc-9580-4915d460eb61 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:00.844260 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ae3c9-424c-46f1-8f49-8a79befd1903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.845149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ae3c9-424c-46f1-8f49-8a79befd1903 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.845447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ae3c9-424c-46f1-8f49-8a79befd1903 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.845733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ae3c9-424c-46f1-8f49-8a79befd1903 None admin] PATH_INFO: `/v3/users/1116c623801c4ed79d916a1359b00bac` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.848607 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 44/76] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:00.849421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a9ae6-49b6-43fc-9580-4915d460eb61 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.864957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ae3c9-424c-46f1-8f49-8a79befd1903 None admin] RBAC: Authorizing `identity:get_user(user_id=1116c623801c4ed79d916a1359b00bac)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:00.867147 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ae3c9-424c-46f1-8f49-8a79befd1903 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:00.868835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 33/77] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:00 2022] GET /identity/v3/users/1116c623801c4ed79d916a1359b00bac => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:00.871472 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ae3c9-424c-46f1-8f49-8a79befd1903 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:00.903767 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:00.948520 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a9ae6-49b6-43fc-9580-4915d460eb61 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.967737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ae3c9-424c-46f1-8f49-8a79befd1903 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:00.981615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540efea-999f-4ec4-a921-9f540fb51564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:00.982416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540efea-999f-4ec4-a921-9f540fb51564 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:00.982706 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540efea-999f-4ec4-a921-9f540fb51564 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:00.982990 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540efea-999f-4ec4-a921-9f540fb51564 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:00.993482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540efea-999f-4ec4-a921-9f540fb51564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:01.001214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-c540efea-999f-4ec4-a921-9f540fb51564 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:01.001214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:01.001214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:01.001214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:01.001214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:01.001214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:01.001214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:01.001214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:01.001214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:01.001214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:01.001214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:01.001214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:01.001214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:01.001214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:01.001214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:01.001214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:01.002041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:01.002041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:01.002041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:01.002041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:01.002041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:01.002041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:01.002041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:01.002041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:01.002041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:01.002041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:01.002041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:01.002041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:01.002041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:01.002041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:01.002041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:01.002041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:01.003139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:01.003139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:01.003139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:01.003139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:01.003139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:01.003139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:01.003139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:01.003139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:01.003139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:01.003139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:01.003139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:01.003139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:01.003139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 45/78] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:01.003885 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51c894-2eef-46f2-a89a-365457085c2f None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.003885 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51c894-2eef-46f2-a89a-365457085c2f None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.004133 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51c894-2eef-46f2-a89a-365457085c2f None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.009162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 46/79] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:01.009162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51c894-2eef-46f2-a89a-365457085c2f None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.011279 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c610a7b-e7ef-4827-ba52-9ed6a885be3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.011944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c610a7b-e7ef-4827-ba52-9ed6a885be3c None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.012239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c610a7b-e7ef-4827-ba52-9ed6a885be3c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.012526 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c610a7b-e7ef-4827-ba52-9ed6a885be3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.015511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.084014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c610a7b-e7ef-4827-ba52-9ed6a885be3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.086308 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c610a7b-e7ef-4827-ba52-9ed6a885be3c None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.116807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51c894-2eef-46f2-a89a-365457085c2f None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.132673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.151049 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e36cd-fe28-46fc-9439-2a2faf893b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.151956 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e36cd-fe28-46fc-9439-2a2faf893b3f None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.152289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e36cd-fe28-46fc-9439-2a2faf893b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.152580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e36cd-fe28-46fc-9439-2a2faf893b3f None admin] PATH_INFO: `/v3/users/1116c623801c4ed79d916a1359b00bac` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.153805 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e36cd-fe28-46fc-9439-2a2faf893b3f None admin] RBAC: Authorizing `identity:get_user(user_id=1116c623801c4ed79d916a1359b00bac)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.155316 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e36cd-fe28-46fc-9439-2a2faf893b3f None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.157271 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 47/80] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/users/1116c623801c4ed79d916a1359b00bac => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:01.157786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e36cd-fe28-46fc-9439-2a2faf893b3f None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.183180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 34/81] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:01.184015 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c610a7b-e7ef-4827-ba52-9ed6a885be3c None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.215891 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.259044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e36cd-fe28-46fc-9439-2a2faf893b3f None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.280135 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c610a7b-e7ef-4827-ba52-9ed6a885be3c None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.291929 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b62ff-e6fa-43cb-965e-a2217f111f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.292575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b62ff-e6fa-43cb-965e-a2217f111f68 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.292863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b62ff-e6fa-43cb-965e-a2217f111f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.293153 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b62ff-e6fa-43cb-965e-a2217f111f68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.314141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d56c25-8219-4a33-90e1-be216c1d026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.314812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d56c25-8219-4a33-90e1-be216c1d026e None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.315100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d56c25-8219-4a33-90e1-be216c1d026e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.315385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d56c25-8219-4a33-90e1-be216c1d026e None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.316127 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d56c25-8219-4a33-90e1-be216c1d026e None admin] RBAC: Adding query filter params (name=member) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:01.316439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d56c25-8219-4a33-90e1-be216c1d026e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.317858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d56c25-8219-4a33-90e1-be216c1d026e None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.325634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 35/82] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:01.326977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49165a77-6af2-44de-8933-99738bfc60a2 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.327278 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49165a77-6af2-44de-8933-99738bfc60a2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.327568 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49165a77-6af2-44de-8933-99738bfc60a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.344117 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-49165a77-6af2-44de-8933-99738bfc60a2 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:01.344733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.345372 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-49165a77-6af2-44de-8933-99738bfc60a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:01.360687 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b62ff-e6fa-43cb-965e-a2217f111f68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.362176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b62ff-e6fa-43cb-965e-a2217f111f68 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.417879 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 36/83] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:01.418739 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49165a77-6af2-44de-8933-99738bfc60a2 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.444805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.474440 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 48/84] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:01.475054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b62ff-e6fa-43cb-965e-a2217f111f68 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.516506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49165a77-6af2-44de-8933-99738bfc60a2 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.550301 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85b611-ee73-4218-9b68-703c85d7aab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.550945 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85b611-ee73-4218-9b68-703c85d7aab0 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.551234 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85b611-ee73-4218-9b68-703c85d7aab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.551515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85b611-ee73-4218-9b68-703c85d7aab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.560958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.577013 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b62ff-e6fa-43cb-965e-a2217f111f68 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.610799 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93176f-f7f8-445b-92cd-0a76f45fa5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.611649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93176f-f7f8-445b-92cd-0a76f45fa5db None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.611935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93176f-f7f8-445b-92cd-0a76f45fa5db None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.612270 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93176f-f7f8-445b-92cd-0a76f45fa5db None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.613559 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93176f-f7f8-445b-92cd-0a76f45fa5db None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.615003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93176f-f7f8-445b-92cd-0a76f45fa5db None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.616852 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 49/85] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:01.616962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85b611-ee73-4218-9b68-703c85d7aab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.617715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93176f-f7f8-445b-92cd-0a76f45fa5db None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.622418 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85b611-ee73-4218-9b68-703c85d7aab0 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.648511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.715920 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93176f-f7f8-445b-92cd-0a76f45fa5db None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.724717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 37/86] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:01.725528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85b611-ee73-4218-9b68-703c85d7aab0 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.757346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153062e-0c23-4d25-885a-18dcd4b24255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.758224 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153062e-0c23-4d25-885a-18dcd4b24255 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.758518 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153062e-0c23-4d25-885a-18dcd4b24255 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.758795 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153062e-0c23-4d25-885a-18dcd4b24255 None admin] PATH_INFO: `/v3/users/1116c623801c4ed79d916a1359b00bac` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.760004 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153062e-0c23-4d25-885a-18dcd4b24255 None admin] RBAC: Authorizing `identity:get_user(user_id=1116c623801c4ed79d916a1359b00bac)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.761499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153062e-0c23-4d25-885a-18dcd4b24255 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.763137 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 50/87] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/users/1116c623801c4ed79d916a1359b00bac => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:01.767772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153062e-0c23-4d25-885a-18dcd4b24255 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.789216 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.834824 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85b611-ee73-4218-9b68-703c85d7aab0 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.860021 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:01.864179 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153062e-0c23-4d25-885a-18dcd4b24255 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.869369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec84fa-1269-4c83-a8fd-5728e880ed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.870224 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec84fa-1269-4c83-a8fd-5728e880ed44 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.870515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec84fa-1269-4c83-a8fd-5728e880ed44 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.870798 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec84fa-1269-4c83-a8fd-5728e880ed44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.872030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec84fa-1269-4c83-a8fd-5728e880ed44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.873555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec84fa-1269-4c83-a8fd-5728e880ed44 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.875191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 38/88] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:01.879905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec84fa-1269-4c83-a8fd-5728e880ed44 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.898849 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7cab6-91dc-48b3-b4e6-310f6c170f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:01.899713 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7cab6-91dc-48b3-b4e6-310f6c170f61 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:01.900007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7cab6-91dc-48b3-b4e6-310f6c170f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:01.900292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7cab6-91dc-48b3-b4e6-310f6c170f61 None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:01.901521 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7cab6-91dc-48b3-b4e6-310f6c170f61 None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:01.902986 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7cab6-91dc-48b3-b4e6-310f6c170f61 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:01.904691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 51/89] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:01.905483 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7cab6-91dc-48b3-b4e6-310f6c170f61 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:01.977063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec84fa-1269-4c83-a8fd-5728e880ed44 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:01.996188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.007647 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7cab6-91dc-48b3-b4e6-310f6c170f61 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.008704 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a789a8-8493-43d1-b370-5766fabc8ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.009416 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a789a8-8493-43d1-b370-5766fabc8ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.009704 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a789a8-8493-43d1-b370-5766fabc8ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.011751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a789a8-8493-43d1-b370-5766fabc8ea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.011751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a789a8-8493-43d1-b370-5766fabc8ea5 None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.project.id=54dee477b50d4b1283589452d92ce93f, user.id=7bd0a21fa70d4ea3afe606ec912fd867) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:02.011751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a789a8-8493-43d1-b370-5766fabc8ea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.012545 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a789a8-8493-43d1-b370-5766fabc8ea5 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.017955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 39/90] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/role_assignments?user.id=7bd0a21fa70d4ea3afe606ec912fd867&scope.project.id=54dee477b50d4b1283589452d92ce93f&role.id=c865040abd6c4b099381557da21c471d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:02.018902 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a789a8-8493-43d1-b370-5766fabc8ea5 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.046003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0bbe5-1584-436a-8b2b-ac94db21aa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.047398 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0bbe5-1584-436a-8b2b-ac94db21aa76 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.047860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0bbe5-1584-436a-8b2b-ac94db21aa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.048308 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0bbe5-1584-436a-8b2b-ac94db21aa76 None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.050293 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0bbe5-1584-436a-8b2b-ac94db21aa76 None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.052634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0bbe5-1584-436a-8b2b-ac94db21aa76 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.055509 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 52/91] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:01 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:02.056969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0bbe5-1584-436a-8b2b-ac94db21aa76 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.107528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.158331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a789a8-8493-43d1-b370-5766fabc8ea5 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.186269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0bbe5-1584-436a-8b2b-ac94db21aa76 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.196549 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d11ecd-c2c4-4338-b238-215c5d87c6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.197859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d11ecd-c2c4-4338-b238-215c5d87c6df None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.198151 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d11ecd-c2c4-4338-b238-215c5d87c6df None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.198752 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d11ecd-c2c4-4338-b238-215c5d87c6df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.225256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f20c9-8a68-49bb-8b45-c7c318222ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.225970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f20c9-8a68-49bb-8b45-c7c318222ae6 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.226804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f20c9-8a68-49bb-8b45-c7c318222ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.227213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f20c9-8a68-49bb-8b45-c7c318222ae6 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.227888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f20c9-8a68-49bb-8b45-c7c318222ae6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.229365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f20c9-8a68-49bb-8b45-c7c318222ae6 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.273396 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d11ecd-c2c4-4338-b238-215c5d87c6df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.274831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d11ecd-c2c4-4338-b238-215c5d87c6df None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.331277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.342424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 53/92] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:02 2022] POST /identity/v3/users => generated 289 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:02.343265 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f20c9-8a68-49bb-8b45-c7c318222ae6 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.369785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.395358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 40/93] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:02.396511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d11ecd-c2c4-4338-b238-215c5d87c6df None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.499608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f20c9-8a68-49bb-8b45-c7c318222ae6 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.524826 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d11ecd-c2c4-4338-b238-215c5d87c6df None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.539441 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc46cb-113a-4fc7-abea-91b4cdc7c2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.540124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc46cb-113a-4fc7-abea-91b4cdc7c2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.540416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc46cb-113a-4fc7-abea-91b4cdc7c2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.540699 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc46cb-113a-4fc7-abea-91b4cdc7c2e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.541592 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc46cb-113a-4fc7-abea-91b4cdc7c2e3 None admin] RBAC: Adding query filter params (role.id=6832f9f0b207495a9a247504bcb6b49f, scope.project.id=54dee477b50d4b1283589452d92ce93f, user.id=1116c623801c4ed79d916a1359b00bac) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:02.541949 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc46cb-113a-4fc7-abea-91b4cdc7c2e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.543585 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc46cb-113a-4fc7-abea-91b4cdc7c2e3 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.552930 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 54/94] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/role_assignments?user.id=1116c623801c4ed79d916a1359b00bac&scope.project.id=54dee477b50d4b1283589452d92ce93f&role.id=6832f9f0b207495a9a247504bcb6b49f => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:02.554842 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc46cb-113a-4fc7-abea-91b4cdc7c2e3 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.575508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc445e-4924-4e3b-8686-1c2f6f34d65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.576203 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc445e-4924-4e3b-8686-1c2f6f34d65d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.576550 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc445e-4924-4e3b-8686-1c2f6f34d65d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.576841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc445e-4924-4e3b-8686-1c2f6f34d65d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.577730 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc445e-4924-4e3b-8686-1c2f6f34d65d None admin] RBAC: Adding query filter params (role.id=602eca0d730345ff8999a6bbd7124092, scope.project.id=54dee477b50d4b1283589452d92ce93f, user.id=1116c623801c4ed79d916a1359b00bac) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:02.578052 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc445e-4924-4e3b-8686-1c2f6f34d65d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.579576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc445e-4924-4e3b-8686-1c2f6f34d65d None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.586724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 41/95] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/role_assignments?user.id=1116c623801c4ed79d916a1359b00bac&scope.project.id=54dee477b50d4b1283589452d92ce93f&role.id=602eca0d730345ff8999a6bbd7124092 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:02.652975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.682125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc46cb-113a-4fc7-abea-91b4cdc7c2e3 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.722756 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4970a6-2752-429f-ab6b-d812d34d5d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.723649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4970a6-2752-429f-ab6b-d812d34d5d4e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.723947 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4970a6-2752-429f-ab6b-d812d34d5d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.724230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4970a6-2752-429f-ab6b-d812d34d5d4e None admin] PATH_INFO: `/v3/projects/64c74d1ebe674afd96b3379a9b18b3de` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.725543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4970a6-2752-429f-ab6b-d812d34d5d4e None admin] RBAC: Authorizing `identity:get_project(project_id=64c74d1ebe674afd96b3379a9b18b3de)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.727087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4970a6-2752-429f-ab6b-d812d34d5d4e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.729345 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 55/96] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/projects/64c74d1ebe674afd96b3379a9b18b3de => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:02.735793 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc445e-4924-4e3b-8686-1c2f6f34d65d None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:02.772139 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:02.871860 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc445e-4924-4e3b-8686-1c2f6f34d65d None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:02.908432 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c7da4-c5ea-424c-adce-9428337ac630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:02.909450 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c7da4-c5ea-424c-adce-9428337ac630 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:02.909912 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c7da4-c5ea-424c-adce-9428337ac630 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:02.910392 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c7da4-c5ea-424c-adce-9428337ac630 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:02.911396 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c7da4-c5ea-424c-adce-9428337ac630 None admin] RBAC: Adding query filter params (role.id=6832f9f0b207495a9a247504bcb6b49f, scope.project.id=64c74d1ebe674afd96b3379a9b18b3de, user.id=1116c623801c4ed79d916a1359b00bac) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:02.911885 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c7da4-c5ea-424c-adce-9428337ac630 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:02.913588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c7da4-c5ea-424c-adce-9428337ac630 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:02.920090 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 42/97] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:02 2022] GET /identity/v3/role_assignments?user.id=1116c623801c4ed79d916a1359b00bac&scope.project.id=64c74d1ebe674afd96b3379a9b18b3de&role.id=6832f9f0b207495a9a247504bcb6b49f => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:04.644624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f31199-128b-4f9d-a771-1d72092e3074 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.645626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f31199-128b-4f9d-a771-1d72092e3074 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:04.646108 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f31199-128b-4f9d-a771-1d72092e3074 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:04.648262 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 56/98] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:04.653879 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6ddc9-a81d-499a-97f7-136c0870e8a2 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.654670 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6ddc9-a81d-499a-97f7-136c0870e8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:04.655151 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6ddc9-a81d-499a-97f7-136c0870e8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:04.677696 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-2fa6ddc9-a81d-499a-97f7-136c0870e8a2 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:04.679228 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2fa6ddc9-a81d-499a-97f7-136c0870e8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:04.765523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 43/99] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:04.800980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f31199-128b-4f9d-a771-1d72092e3074 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:04.930015 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f31199-128b-4f9d-a771-1d72092e3074 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:04.979003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26e22d-ee72-42ba-8a36-6337a81e5622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:04.979832 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26e22d-ee72-42ba-8a36-6337a81e5622 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:04.980128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26e22d-ee72-42ba-8a36-6337a81e5622 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:04.980413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26e22d-ee72-42ba-8a36-6337a81e5622 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:05.000251 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26e22d-ee72-42ba-8a36-6337a81e5622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:05.008303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-ec26e22d-ee72-42ba-8a36-6337a81e5622 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:05.008303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:05.008303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:05.008303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:05.008303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:05.008303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:05.008303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:05.008303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:05.008303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:05.008303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:05.008303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:05.008303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:05.008303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:05.008303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:05.008303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:05.008303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:05.009163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:05.009163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:05.009163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:05.009163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:05.009163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:05.009163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:05.009163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:05.009163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:05.009163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:05.009163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:05.009163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:05.009163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:05.009163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:05.009163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:05.009163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:05.009163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:05.010353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:05.010353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:05.010353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:05.010353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:05.010353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:05.010353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:05.010353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:05.010353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:05.010353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:05.010353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:05.010353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:05.010353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:05.010353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 57/100] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:05.017126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6ddc9-a81d-499a-97f7-136c0870e8a2 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:05.056161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:05.165546 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6ddc9-a81d-499a-97f7-136c0870e8a2 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:05.213855 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c954a-8932-4e7f-bc2d-ab43bcc88d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:05.214557 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c954a-8932-4e7f-bc2d-ab43bcc88d4d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:05.214848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c954a-8932-4e7f-bc2d-ab43bcc88d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:05.215132 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c954a-8932-4e7f-bc2d-ab43bcc88d4d None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:05.215898 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c954a-8932-4e7f-bc2d-ab43bcc88d4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:05.216213 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c954a-8932-4e7f-bc2d-ab43bcc88d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:05.217656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c954a-8932-4e7f-bc2d-ab43bcc88d4d None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:05.227380 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 44/101] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:05.233252 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26e22d-ee72-42ba-8a36-6337a81e5622 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:05.243450 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:05.388843 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26e22d-ee72-42ba-8a36-6337a81e5622 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:05.433383 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ec9c3-b045-4285-b0d9-346a8995389b None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:05.433993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ec9c3-b045-4285-b0d9-346a8995389b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:05.434422 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ec9c3-b045-4285-b0d9-346a8995389b None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:05.436081 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 45/102] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:05.436823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043b5af-ad77-4786-80ee-aaba62b734cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:05.437775 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043b5af-ad77-4786-80ee-aaba62b734cc None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:05.438069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043b5af-ad77-4786-80ee-aaba62b734cc None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:05.438355 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043b5af-ad77-4786-80ee-aaba62b734cc None admin] PATH_INFO: `/v3/users/7bd0a21fa70d4ea3afe606ec912fd867` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:05.439589 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043b5af-ad77-4786-80ee-aaba62b734cc None admin] RBAC: Authorizing `identity:get_user(user_id=7bd0a21fa70d4ea3afe606ec912fd867)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:05.441063 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043b5af-ad77-4786-80ee-aaba62b734cc None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:05.442753 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 58/103] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:05 2022] GET /identity/v3/users/7bd0a21fa70d4ea3afe606ec912fd867 => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:05.448275 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043b5af-ad77-4786-80ee-aaba62b734cc None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:05.448911 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d33a9d-d19d-4bc1-be04-1a7284bfc163 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:05.449523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d33a9d-d19d-4bc1-be04-1a7284bfc163 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:05.450000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d33a9d-d19d-4bc1-be04-1a7284bfc163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:05.483449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-40d33a9d-d19d-4bc1-be04-1a7284bfc163 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:05.484951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-40d33a9d-d19d-4bc1-be04-1a7284bfc163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:05.579401 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:05.628684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043b5af-ad77-4786-80ee-aaba62b734cc None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:05.631657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 46/104] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:05.633654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a284b8e-b3ed-48cc-a697-c7618205e12a None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:05.633954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a284b8e-b3ed-48cc-a697-c7618205e12a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:05.634241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a284b8e-b3ed-48cc-a697-c7618205e12a None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:05.636516 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 47/105] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:05.645782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3031c-6173-4f58-8dcb-662a3a00cb1e None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:05.646073 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3031c-6173-4f58-8dcb-662a3a00cb1e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:05.646362 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3031c-6173-4f58-8dcb-662a3a00cb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:05.673718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-59a3031c-6173-4f58-8dcb-662a3a00cb1e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:05.674937 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-59a3031c-6173-4f58-8dcb-662a3a00cb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:05.698095 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:05.738035 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92a2b8-8e71-4215-88d4-b7ff2c690749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:05.738861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92a2b8-8e71-4215-88d4-b7ff2c690749 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:05.739152 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92a2b8-8e71-4215-88d4-b7ff2c690749 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:05.739434 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92a2b8-8e71-4215-88d4-b7ff2c690749 None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:05.740750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92a2b8-8e71-4215-88d4-b7ff2c690749 None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:05.742846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92a2b8-8e71-4215-88d4-b7ff2c690749 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:05.744733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 59/106] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:05 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:05.750082 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92a2b8-8e71-4215-88d4-b7ff2c690749 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:05.751933 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 48/107] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:05.753483 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3031c-6173-4f58-8dcb-662a3a00cb1e None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:05.916586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92a2b8-8e71-4215-88d4-b7ff2c690749 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:05.922158 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3031c-6173-4f58-8dcb-662a3a00cb1e None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:05.955022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e0ad4-0c32-4619-920c-ab2b6580c39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:05.956056 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0ad4-0c32-4619-920c-ab2b6580c39e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:05.956484 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0ad4-0c32-4619-920c-ab2b6580c39e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:05.956897 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e0ad4-0c32-4619-920c-ab2b6580c39e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:05.970393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c930eb-e9e2-4186-973b-f3e1f91bff34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:05.971655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c930eb-e9e2-4186-973b-f3e1f91bff34 None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:05.972172 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c930eb-e9e2-4186-973b-f3e1f91bff34 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:05.972747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c930eb-e9e2-4186-973b-f3e1f91bff34 None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f/users/7bd0a21fa70d4ea3afe606ec912fd867/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:05.975640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:05.978559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c930eb-e9e2-4186-973b-f3e1f91bff34 None admin] RBAC: Authorizing `identity:create_grant(project_id=54dee477b50d4b1283589452d92ce93f, user_id=7bd0a21fa70d4ea3afe606ec912fd867, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:05.978892 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e0ad4-0c32-4619-920c-ab2b6580c39e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:05.981104 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c930eb-e9e2-4186-973b-f3e1f91bff34 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:05.991735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-9c8e0ad4-0c32-4619-920c-ab2b6580c39e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:05.991735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:05.991735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:05.991735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:05.991735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:05.991735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:05.991735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:05.991735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:05.991735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:05.991735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:05.991735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:05.991735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:05.991735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:05.991735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:05.991735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:05.991735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:05.993540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:05.993540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:05.993540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:05.993540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:05.993540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:05.993540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:05.993540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:05.993540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:05.993540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:05.993540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:05.993540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:05.993540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:05.993540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:05.993540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:05.993540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:05.993540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:05.994364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:05.994364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:05.994364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:05.994364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:05.994364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:05.994364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:05.994364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:05.994364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:05.994364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:05.994364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:05.994364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:05.994364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:05.994364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 60/108] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:05.994364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f145fe4-de37-414c-918b-df44fb24cad3 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:05.995279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f145fe4-de37-414c-918b-df44fb24cad3 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:05.995279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f145fe4-de37-414c-918b-df44fb24cad3 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:05.995279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 61/109] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:05.995279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f145fe4-de37-414c-918b-df44fb24cad3 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:06.066858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:06.074028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 49/110] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:05 2022] PUT /identity/v3/projects/54dee477b50d4b1283589452d92ce93f/users/7bd0a21fa70d4ea3afe606ec912fd867/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:06.074858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c930eb-e9e2-4186-973b-f3e1f91bff34 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:06.117691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f145fe4-de37-414c-918b-df44fb24cad3 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:06.161287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154aad40-d2cc-4411-93ae-ec90ce27aa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:06.162119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154aad40-d2cc-4411-93ae-ec90ce27aa19 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:06.162410 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154aad40-d2cc-4411-93ae-ec90ce27aa19 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:06.162694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154aad40-d2cc-4411-93ae-ec90ce27aa19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:06.176333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154aad40-d2cc-4411-93ae-ec90ce27aa19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:06.184882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-154aad40-d2cc-4411-93ae-ec90ce27aa19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:06.184882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:06.184882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:06.184882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:06.184882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:06.184882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:06.184882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:06.184882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:06.184882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:06.184882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:06.184882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:06.184882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:06.184882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:06.184882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:06.184882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:06.184882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:06.185859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:06.185859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:06.185859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:06.185859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:06.185859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:06.185859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:06.185859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:06.185859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:06.185859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:06.185859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:06.185859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:06.185859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:06.185859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:06.185859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:06.185859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:06.185859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:06.190948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:06.190948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:06.190948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:06.190948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:06.190948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:06.190948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:06.190948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:06.190948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:06.190948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:06.190948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:06.190948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:06.190948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:06.190948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 62/111] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:06.190948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f7369-8f41-4566-9066-557eb179f987 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:06.191806 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f7369-8f41-4566-9066-557eb179f987 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:06.191806 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f7369-8f41-4566-9066-557eb179f987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:06.209263 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-7b6f7369-8f41-4566-9066-557eb179f987 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:06.210470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-7b6f7369-8f41-4566-9066-557eb179f987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:06.233664 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c930eb-e9e2-4186-973b-f3e1f91bff34 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:06.276694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:06.288121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcca24-66ec-4b86-9d43-b80805b1e1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:06.291459 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 63/112] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:06.291560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcca24-66ec-4b86-9d43-b80805b1e1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:06.291560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcca24-66ec-4b86-9d43-b80805b1e1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:06.291560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcca24-66ec-4b86-9d43-b80805b1e1b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:06.291560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcca24-66ec-4b86-9d43-b80805b1e1b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:06.291560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcca24-66ec-4b86-9d43-b80805b1e1b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:06.293011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcca24-66ec-4b86-9d43-b80805b1e1b1 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:06.293652 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f7369-8f41-4566-9066-557eb179f987 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:06.303204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 50/113] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:06.304982 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17f200-7fa8-4c2d-b871-61254e3651b0 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:06.305337 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17f200-7fa8-4c2d-b871-61254e3651b0 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:06.305630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17f200-7fa8-4c2d-b871-61254e3651b0 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:06.308966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 51/114] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:06.309693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17f200-7fa8-4c2d-b871-61254e3651b0 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:06.400368 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:06.446248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17f200-7fa8-4c2d-b871-61254e3651b0 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:06.450174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f7369-8f41-4566-9066-557eb179f987 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:06.485611 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac675f98-6023-4704-874b-24269e3e3890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:06.486618 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac675f98-6023-4704-874b-24269e3e3890 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:06.487010 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac675f98-6023-4704-874b-24269e3e3890 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:06.487621 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac675f98-6023-4704-874b-24269e3e3890 None admin] PATH_INFO: `/v3/users/1116c623801c4ed79d916a1359b00bac` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:06.488653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac675f98-6023-4704-874b-24269e3e3890 None admin] RBAC: Authorizing `identity:get_user(user_id=1116c623801c4ed79d916a1359b00bac)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:06.490251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac675f98-6023-4704-874b-24269e3e3890 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:06.492672 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 52/115] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:06 2022] GET /identity/v3/users/1116c623801c4ed79d916a1359b00bac => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:06.494182 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac675f98-6023-4704-874b-24269e3e3890 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:06.505966 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41061b-1c55-48cc-b676-a1787e8c8be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:06.506729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41061b-1c55-48cc-b676-a1787e8c8be5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:06.507022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41061b-1c55-48cc-b676-a1787e8c8be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:06.507308 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41061b-1c55-48cc-b676-a1787e8c8be5 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:06.508749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41061b-1c55-48cc-b676-a1787e8c8be5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:06.509069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41061b-1c55-48cc-b676-a1787e8c8be5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:06.510812 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41061b-1c55-48cc-b676-a1787e8c8be5 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:06.520665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 64/116] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:06.522394 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de4ac9-bca8-41b0-9f7b-0593c556eedd None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:06.522695 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de4ac9-bca8-41b0-9f7b-0593c556eedd None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:06.522985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de4ac9-bca8-41b0-9f7b-0593c556eedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:06.541709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-f6de4ac9-bca8-41b0-9f7b-0593c556eedd None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:06.542915 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-f6de4ac9-bca8-41b0-9f7b-0593c556eedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:06.604272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:06.625533 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac675f98-6023-4704-874b-24269e3e3890 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:06.625843 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 65/117] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:06.629500 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de4ac9-bca8-41b0-9f7b-0593c556eedd None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:06.661108 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:06.669890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce6ac1-9475-403d-8df8-6499c0341a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:06.670720 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce6ac1-9475-403d-8df8-6499c0341a65 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:06.671018 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce6ac1-9475-403d-8df8-6499c0341a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:06.671305 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce6ac1-9475-403d-8df8-6499c0341a65 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:06.682839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce6ac1-9475-403d-8df8-6499c0341a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:06.690951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-23ce6ac1-9475-403d-8df8-6499c0341a65 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:06.690951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:06.690951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:06.690951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:06.690951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:06.690951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:06.690951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:06.690951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:06.690951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:06.690951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:06.690951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:06.690951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:06.690951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:06.690951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:06.690951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:06.690951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:06.691847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:06.691847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:06.691847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:06.691847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:06.691847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:06.691847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:06.691847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:06.691847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:06.691847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:06.691847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:06.691847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:06.691847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:06.691847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:06.691847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:06.691847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:06.691847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:06.692589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:06.692589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:06.692589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:06.692589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:06.692589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:06.692589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:06.692589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:06.692589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:06.692589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:06.692589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:06.692589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:06.692589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:06.692589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 53/118] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:06.693346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce6ac1-9475-403d-8df8-6499c0341a65 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:06.747347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de4ac9-bca8-41b0-9f7b-0593c556eedd None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:06.784074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18932c3e-7bd3-4d58-9d9c-d9b5354dadda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:06.784960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932c3e-7bd3-4d58-9d9c-d9b5354dadda None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:06.785283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932c3e-7bd3-4d58-9d9c-d9b5354dadda None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:06.788017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932c3e-7bd3-4d58-9d9c-d9b5354dadda None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:06.788017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18932c3e-7bd3-4d58-9d9c-d9b5354dadda None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:06.788580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18932c3e-7bd3-4d58-9d9c-d9b5354dadda None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:06.795601 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 66/119] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:06 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:06.795601 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325a427-537d-49bc-8b83-4e2fa72dc052 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:06.795601 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325a427-537d-49bc-8b83-4e2fa72dc052 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:06.795601 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325a427-537d-49bc-8b83-4e2fa72dc052 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:06.795601 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 67/120] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:06.795601 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325a427-537d-49bc-8b83-4e2fa72dc052 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:06.815269 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce6ac1-9475-403d-8df8-6499c0341a65 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:06.852631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:06.853614 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a685e-c95b-4ed5-b777-8e6a7a2b0328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:06.854506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a685e-c95b-4ed5-b777-8e6a7a2b0328 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:06.854796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a685e-c95b-4ed5-b777-8e6a7a2b0328 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:06.855078 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a685e-c95b-4ed5-b777-8e6a7a2b0328 None admin] PATH_INFO: `/v3/users/1116c623801c4ed79d916a1359b00bac` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:06.856387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a685e-c95b-4ed5-b777-8e6a7a2b0328 None admin] RBAC: Authorizing `identity:get_user(user_id=1116c623801c4ed79d916a1359b00bac)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:06.857927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a685e-c95b-4ed5-b777-8e6a7a2b0328 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:06.859597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 54/121] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:06 2022] GET /identity/v3/users/1116c623801c4ed79d916a1359b00bac => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:06.860363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a685e-c95b-4ed5-b777-8e6a7a2b0328 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:06.917589 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325a427-537d-49bc-8b83-4e2fa72dc052 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:06.922853 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:06.954574 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e55890-8391-4d82-8199-9475c1cb4eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:06.955703 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55890-8391-4d82-8199-9475c1cb4eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:06.955996 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55890-8391-4d82-8199-9475c1cb4eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:06.956280 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55890-8391-4d82-8199-9475c1cb4eb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:06.957613 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e55890-8391-4d82-8199-9475c1cb4eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:06.959070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e55890-8391-4d82-8199-9475c1cb4eb8 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:06.965437 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 68/122] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:06.965437 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e55890-8391-4d82-8199-9475c1cb4eb8 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:06.979012 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a685e-c95b-4ed5-b777-8e6a7a2b0328 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:07.017577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1e9c3-ea90-4f44-a2b7-4ba47f470d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:07.018260 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1e9c3-ea90-4f44-a2b7-4ba47f470d20 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:07.018552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1e9c3-ea90-4f44-a2b7-4ba47f470d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:07.018846 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1e9c3-ea90-4f44-a2b7-4ba47f470d20 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:07.019580 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1e9c3-ea90-4f44-a2b7-4ba47f470d20 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:07.019898 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1e9c3-ea90-4f44-a2b7-4ba47f470d20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:07.021324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1e9c3-ea90-4f44-a2b7-4ba47f470d20 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:07.030374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 55/123] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:07.031599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12149b2f-57e7-41aa-8bf7-cca5763b5344 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:07.031896 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12149b2f-57e7-41aa-8bf7-cca5763b5344 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:07.032181 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12149b2f-57e7-41aa-8bf7-cca5763b5344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:07.048964 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-12149b2f-57e7-41aa-8bf7-cca5763b5344 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:07.050141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-12149b2f-57e7-41aa-8bf7-cca5763b5344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:07.076636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e55890-8391-4d82-8199-9475c1cb4eb8 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:07.096117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:07.113577 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804c3a6-631a-49b9-9919-c11be56415ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:07.114656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804c3a6-631a-49b9-9919-c11be56415ed None admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:07.115042 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804c3a6-631a-49b9-9919-c11be56415ed None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:07.115327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804c3a6-631a-49b9-9919-c11be56415ed None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f/users/1116c623801c4ed79d916a1359b00bac/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:07.117572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804c3a6-631a-49b9-9919-c11be56415ed None admin] RBAC: Authorizing `identity:create_grant(project_id=54dee477b50d4b1283589452d92ce93f, user_id=1116c623801c4ed79d916a1359b00bac, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:07.119192 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804c3a6-631a-49b9-9919-c11be56415ed None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:07.122456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 56/124] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:07.123322 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12149b2f-57e7-41aa-8bf7-cca5763b5344 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:07.171339 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:07.222353 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12149b2f-57e7-41aa-8bf7-cca5763b5344 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:07.239968 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 69/125] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:06 2022] PUT /identity/v3/projects/54dee477b50d4b1283589452d92ce93f/users/1116c623801c4ed79d916a1359b00bac/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:07.240582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804c3a6-631a-49b9-9919-c11be56415ed None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:07.272497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180d032-bd0c-4e3b-9771-19830e59c60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:07.274400 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180d032-bd0c-4e3b-9771-19830e59c60c None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:07.275177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180d032-bd0c-4e3b-9771-19830e59c60c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:07.276174 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180d032-bd0c-4e3b-9771-19830e59c60c None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:07.278120 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180d032-bd0c-4e3b-9771-19830e59c60c None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:07.280939 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180d032-bd0c-4e3b-9771-19830e59c60c None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:07.284176 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 57/126] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:07 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:07.285249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180d032-bd0c-4e3b-9771-19830e59c60c None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:07.391355 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804c3a6-631a-49b9-9919-c11be56415ed None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:07.418211 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180d032-bd0c-4e3b-9771-19830e59c60c None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:07.438314 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cd545-d897-48a9-a4d6-6196b95cbbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:07.438995 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cd545-d897-48a9-a4d6-6196b95cbbe2 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:07.439284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cd545-d897-48a9-a4d6-6196b95cbbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:07.439566 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cd545-d897-48a9-a4d6-6196b95cbbe2 None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:07.440283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cd545-d897-48a9-a4d6-6196b95cbbe2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:07.441786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cd545-d897-48a9-a4d6-6196b95cbbe2 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:07.447919 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:07.465193 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752630f7-d774-4350-9013-31d1d63e0936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:07.468553 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752630f7-d774-4350-9013-31d1d63e0936 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:07.468553 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752630f7-d774-4350-9013-31d1d63e0936 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:07.468553 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752630f7-d774-4350-9013-31d1d63e0936 None admin] PATH_INFO: `/v3/users/f5be3aff441b4df5a906a4fed4e02295` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:07.482524 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752630f7-d774-4350-9013-31d1d63e0936 None admin] RBAC: Authorizing `identity:get_user(user_id=f5be3aff441b4df5a906a4fed4e02295)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:07.484131 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752630f7-d774-4350-9013-31d1d63e0936 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:07.491432 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 58/127] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:07 2022] GET /identity/v3/users/f5be3aff441b4df5a906a4fed4e02295 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:07.491432 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752630f7-d774-4350-9013-31d1d63e0936 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:07.541244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 70/128] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 16 14:43:07 2022] POST /identity/v3/projects => generated 302 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:07.546802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cd545-d897-48a9-a4d6-6196b95cbbe2 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:07.618510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752630f7-d774-4350-9013-31d1d63e0936 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:07.629316 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:07.658324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553ed47-180a-4430-9984-51ba154ed562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:07.659051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553ed47-180a-4430-9984-51ba154ed562 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:07.659515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553ed47-180a-4430-9984-51ba154ed562 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:07.659806 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553ed47-180a-4430-9984-51ba154ed562 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:07.674520 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553ed47-180a-4430-9984-51ba154ed562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:07.689446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-7553ed47-180a-4430-9984-51ba154ed562 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:07.689446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:07.689446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:07.689446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:07.689446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:07.689446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:07.689446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:07.689446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:07.689446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:07.689446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:07.689446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:07.689446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:07.689446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:07.689446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:07.689446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:07.689446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:07.690800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:07.690800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:07.690800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:07.690800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:07.690800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:07.690800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:07.690800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:07.690800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:07.690800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:07.690800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:07.690800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:07.690800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:07.690800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:07.690800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:07.690800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:07.690800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:07.691962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:07.691962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:07.691962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:07.691962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:07.691962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:07.691962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:07.691962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:07.691962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:07.691962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:07.691962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:07.691962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:07.691962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:07.693876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 59/129] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:07.698734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553ed47-180a-4430-9984-51ba154ed562 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:07.748126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cd545-d897-48a9-a4d6-6196b95cbbe2 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:07.774607 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:07.803925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538192c-af19-4a59-82ee-914d23fbab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:07.804405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538192c-af19-4a59-82ee-914d23fbab04 None admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:07.805282 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538192c-af19-4a59-82ee-914d23fbab04 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:07.805616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538192c-af19-4a59-82ee-914d23fbab04 None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f/users/1116c623801c4ed79d916a1359b00bac/roles/602eca0d730345ff8999a6bbd7124092` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:07.808770 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538192c-af19-4a59-82ee-914d23fbab04 None admin] RBAC: Authorizing `identity:create_grant(project_id=54dee477b50d4b1283589452d92ce93f, user_id=1116c623801c4ed79d916a1359b00bac, role_id=602eca0d730345ff8999a6bbd7124092)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:07.810405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538192c-af19-4a59-82ee-914d23fbab04 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:07.863177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553ed47-180a-4430-9984-51ba154ed562 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:07.901967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66588d99-80bc-46ce-a5ce-8802e6ce4ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:07.903137 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66588d99-80bc-46ce-a5ce-8802e6ce4ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:07.903673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66588d99-80bc-46ce-a5ce-8802e6ce4ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:07.904154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66588d99-80bc-46ce-a5ce-8802e6ce4ea6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:07.919537 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 71/130] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:07 2022] PUT /identity/v3/projects/54dee477b50d4b1283589452d92ce93f/users/1116c623801c4ed79d916a1359b00bac/roles/602eca0d730345ff8999a6bbd7124092 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:07.920315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538192c-af19-4a59-82ee-914d23fbab04 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:08.025191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66588d99-80bc-46ce-a5ce-8802e6ce4ea6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:08.027097 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66588d99-80bc-46ce-a5ce-8802e6ce4ea6 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:08.098771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:08.117491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:08.136192 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538192c-af19-4a59-82ee-914d23fbab04 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:08.215042 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43125bea-99b7-40ba-8369-88c0135bb0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:08.215816 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43125bea-99b7-40ba-8369-88c0135bb0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.216110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43125bea-99b7-40ba-8369-88c0135bb0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.216396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43125bea-99b7-40ba-8369-88c0135bb0a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.217219 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43125bea-99b7-40ba-8369-88c0135bb0a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:08.217741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43125bea-99b7-40ba-8369-88c0135bb0a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:08.219404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43125bea-99b7-40ba-8369-88c0135bb0a5 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:08.232405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 72/131] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:08.237964 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43125bea-99b7-40ba-8369-88c0135bb0a5 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:08.268003 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 60/132] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:08.287723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66588d99-80bc-46ce-a5ce-8802e6ce4ea6 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:08.371905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43125bea-99b7-40ba-8369-88c0135bb0a5 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:08.441368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840ecd3-c08c-4bed-be02-3c4174f78f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:08.442261 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840ecd3-c08c-4bed-be02-3c4174f78f7a None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.442553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840ecd3-c08c-4bed-be02-3c4174f78f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.442840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840ecd3-c08c-4bed-be02-3c4174f78f7a None admin] PATH_INFO: `/v3/users/1116c623801c4ed79d916a1359b00bac` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.446223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840ecd3-c08c-4bed-be02-3c4174f78f7a None admin] RBAC: Authorizing `identity:get_user(user_id=1116c623801c4ed79d916a1359b00bac)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:08.451244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840ecd3-c08c-4bed-be02-3c4174f78f7a None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:08.454036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 73/133] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:08 2022] GET /identity/v3/users/1116c623801c4ed79d916a1359b00bac => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:08.472900 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66588d99-80bc-46ce-a5ce-8802e6ce4ea6 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:08.475700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840ecd3-c08c-4bed-be02-3c4174f78f7a None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:08.511664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:08.557351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bad5e-60b0-4f0a-858a-ec9e466fb711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:08.558308 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bad5e-60b0-4f0a-858a-ec9e466fb711 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.558807 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bad5e-60b0-4f0a-858a-ec9e466fb711 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.558922 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bad5e-60b0-4f0a-858a-ec9e466fb711 None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.560989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bad5e-60b0-4f0a-858a-ec9e466fb711 None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:08.562521 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bad5e-60b0-4f0a-858a-ec9e466fb711 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:08.564325 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 61/134] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:08 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:08.580075 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bad5e-60b0-4f0a-858a-ec9e466fb711 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:08.589758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:08.645753 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840ecd3-c08c-4bed-be02-3c4174f78f7a None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:08.682370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7e0b8-c60d-45eb-873f-0c04070d6fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:08.683236 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7e0b8-c60d-45eb-873f-0c04070d6fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.683522 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7e0b8-c60d-45eb-873f-0c04070d6fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.683803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7e0b8-c60d-45eb-873f-0c04070d6fe8 None admin] PATH_INFO: `/v3/projects/64c74d1ebe674afd96b3379a9b18b3de` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.684997 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7e0b8-c60d-45eb-873f-0c04070d6fe8 None admin] RBAC: Authorizing `identity:get_project(project_id=64c74d1ebe674afd96b3379a9b18b3de)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:08.686477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7e0b8-c60d-45eb-873f-0c04070d6fe8 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:08.688508 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 74/135] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:08 2022] GET /identity/v3/projects/64c74d1ebe674afd96b3379a9b18b3de => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:08.689723 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e901-39a1-4d5e-b47c-bbcc571039ae None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.690023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e901-39a1-4d5e-b47c-bbcc571039ae None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.690304 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e901-39a1-4d5e-b47c-bbcc571039ae None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.691767 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 75/136] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:08.697191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e901-39a1-4d5e-b47c-bbcc571039ae None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:08.697427 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bad5e-60b0-4f0a-858a-ec9e466fb711 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:08.733304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4864bc9-494a-4607-9f42-46f1fae8abb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:08.733924 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4864bc9-494a-4607-9f42-46f1fae8abb6 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.734221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4864bc9-494a-4607-9f42-46f1fae8abb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.734507 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4864bc9-494a-4607-9f42-46f1fae8abb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.735355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4864bc9-494a-4607-9f42-46f1fae8abb6 None admin] RBAC: Adding query filter params (role.id=51d54eaf35fd45ccb7048e3f446f1eac, scope.project.id=54dee477b50d4b1283589452d92ce93f, user.id=f5be3aff441b4df5a906a4fed4e02295) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:08.735676 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4864bc9-494a-4607-9f42-46f1fae8abb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:08.737160 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4864bc9-494a-4607-9f42-46f1fae8abb6 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:08.744170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 62/137] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:08 2022] GET /identity/v3/role_assignments?user.id=f5be3aff441b4df5a906a4fed4e02295&scope.project.id=54dee477b50d4b1283589452d92ce93f&role.id=51d54eaf35fd45ccb7048e3f446f1eac => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:08.749624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b76eaa-e811-4ad4-8ef2-547e5dc374c8 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.749967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b76eaa-e811-4ad4-8ef2-547e5dc374c8 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.750267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b76eaa-e811-4ad4-8ef2-547e5dc374c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.784247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-73b76eaa-e811-4ad4-8ef2-547e5dc374c8 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:08.793582 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-73b76eaa-e811-4ad4-8ef2-547e5dc374c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:08.794848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:08.817906 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e901-39a1-4d5e-b47c-bbcc571039ae None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:08.889715 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:08.895991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 63/138] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:08.906036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6c92c-1f3c-4cd1-b8cf-fed749b9b569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:08.907244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6c92c-1f3c-4cd1-b8cf-fed749b9b569 None admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:08.907690 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6c92c-1f3c-4cd1-b8cf-fed749b9b569 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:08.908115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6c92c-1f3c-4cd1-b8cf-fed749b9b569 None admin] PATH_INFO: `/v3/projects/64c74d1ebe674afd96b3379a9b18b3de/users/1116c623801c4ed79d916a1359b00bac/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:08.910497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6c92c-1f3c-4cd1-b8cf-fed749b9b569 None admin] RBAC: Authorizing `identity:create_grant(project_id=64c74d1ebe674afd96b3379a9b18b3de, user_id=1116c623801c4ed79d916a1359b00bac, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:08.912189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6c92c-1f3c-4cd1-b8cf-fed749b9b569 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:08.949540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b76eaa-e811-4ad4-8ef2-547e5dc374c8 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:09.025001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 76/139] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:08 2022] PUT /identity/v3/projects/64c74d1ebe674afd96b3379a9b18b3de/users/1116c623801c4ed79d916a1359b00bac/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:09.120808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b76eaa-e811-4ad4-8ef2-547e5dc374c8 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:09.168430 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40feceb9-0142-4327-89dd-f627720e7b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:09.169306 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40feceb9-0142-4327-89dd-f627720e7b4d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:09.169600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40feceb9-0142-4327-89dd-f627720e7b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:09.169881 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40feceb9-0142-4327-89dd-f627720e7b4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:09.192494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40feceb9-0142-4327-89dd-f627720e7b4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:09.200576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-40feceb9-0142-4327-89dd-f627720e7b4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:09.200576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:09.200576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:09.200576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:09.200576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:09.200576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:09.200576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:09.200576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:09.200576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:09.200576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:09.200576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:09.200576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:09.200576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:09.200576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:09.200576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:09.200576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:09.201560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:09.201560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:09.201560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:09.201560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:09.201560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:09.201560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:09.201560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:09.201560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:09.201560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:09.201560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:09.201560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:09.201560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:09.201560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:09.201560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:09.201560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:09.201560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:09.202796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:09.202796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:09.202796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:09.202796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:09.202796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:09.202796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:09.202796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:09.202796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:09.202796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:09.202796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:09.202796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:09.202796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:09.202796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 64/140] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:09.209668 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6c92c-1f3c-4cd1-b8cf-fed749b9b569 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:09.347208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6c92c-1f3c-4cd1-b8cf-fed749b9b569 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:09.384120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b48500-0c8a-42c6-9b16-f77278e5d405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:09.385213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b48500-0c8a-42c6-9b16-f77278e5d405 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:09.385717 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b48500-0c8a-42c6-9b16-f77278e5d405 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:09.386190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b48500-0c8a-42c6-9b16-f77278e5d405 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:09.387121 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b48500-0c8a-42c6-9b16-f77278e5d405 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:09.387617 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b48500-0c8a-42c6-9b16-f77278e5d405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:09.389199 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b48500-0c8a-42c6-9b16-f77278e5d405 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:09.398350 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 77/141] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:09.403981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40feceb9-0142-4327-89dd-f627720e7b4d None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:09.477214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:09.530412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40feceb9-0142-4327-89dd-f627720e7b4d None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:09.581826 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dec8a-4bf6-47a8-8383-56dbb57c4010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:09.583093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dec8a-4bf6-47a8-8383-56dbb57c4010 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:09.583581 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dec8a-4bf6-47a8-8383-56dbb57c4010 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:09.584058 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dec8a-4bf6-47a8-8383-56dbb57c4010 None admin] PATH_INFO: `/v3/users/7bd0a21fa70d4ea3afe606ec912fd867` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:09.585662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73dec8a-4bf6-47a8-8383-56dbb57c4010 None admin] RBAC: Authorizing `identity:get_user(user_id=7bd0a21fa70d4ea3afe606ec912fd867)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:09.587846 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73dec8a-4bf6-47a8-8383-56dbb57c4010 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:09.589724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 65/142] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:09 2022] GET /identity/v3/users/7bd0a21fa70d4ea3afe606ec912fd867 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:09.595191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b48500-0c8a-42c6-9b16-f77278e5d405 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:09.611603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:09.712330 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b48500-0c8a-42c6-9b16-f77278e5d405 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:09.761641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3b37-4db8-45bc-ab78-7b79a6b3a79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:09.762327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3b37-4db8-45bc-ab78-7b79a6b3a79d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:09.762664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3b37-4db8-45bc-ab78-7b79a6b3a79d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:09.762947 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3b37-4db8-45bc-ab78-7b79a6b3a79d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:09.848626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e3b37-4db8-45bc-ab78-7b79a6b3a79d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:09.850142 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e3b37-4db8-45bc-ab78-7b79a6b3a79d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:09.867662 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:09.975030 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 78/143] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:09.980728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dec8a-4bf6-47a8-8383-56dbb57c4010 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:10.128077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dec8a-4bf6-47a8-8383-56dbb57c4010 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:10.155245 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:10.171499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1e467-23e8-4c26-a04e-16ea1a4ea60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:10.179176 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1e467-23e8-4c26-a04e-16ea1a4ea60b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:10.179176 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1e467-23e8-4c26-a04e-16ea1a4ea60b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:10.179176 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1e467-23e8-4c26-a04e-16ea1a4ea60b None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:10.179176 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1e467-23e8-4c26-a04e-16ea1a4ea60b None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:10.179176 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1e467-23e8-4c26-a04e-16ea1a4ea60b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:10.179176 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 66/144] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:09 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:10.183943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3b37-4db8-45bc-ab78-7b79a6b3a79d None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:10.335476 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3b37-4db8-45bc-ab78-7b79a6b3a79d None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:10.354712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:10.390010 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb028d6b-28fb-4330-b9fd-1ee960961b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:10.390611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb028d6b-28fb-4330-b9fd-1ee960961b29 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:10.390899 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb028d6b-28fb-4330-b9fd-1ee960961b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:10.391177 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb028d6b-28fb-4330-b9fd-1ee960961b29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:10.392027 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb028d6b-28fb-4330-b9fd-1ee960961b29 None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.project.id=54dee477b50d4b1283589452d92ce93f, user.id=7bd0a21fa70d4ea3afe606ec912fd867) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:10.392470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb028d6b-28fb-4330-b9fd-1ee960961b29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:10.394296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb028d6b-28fb-4330-b9fd-1ee960961b29 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:10.402276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 79/145] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:10 2022] GET /identity/v3/role_assignments?user.id=7bd0a21fa70d4ea3afe606ec912fd867&scope.project.id=54dee477b50d4b1283589452d92ce93f&role.id=c865040abd6c4b099381557da21c471d => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:10.525164 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50df607-a6ca-4d1d-9be5-bcbf8a56d511 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:10.525504 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50df607-a6ca-4d1d-9be5-bcbf8a56d511 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:10.525743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50df607-a6ca-4d1d-9be5-bcbf8a56d511 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:10.527319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 67/146] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:10.532756 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b86cc-22f4-4622-b2d0-0d9a06b21fee None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:10.533050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b86cc-22f4-4622-b2d0-0d9a06b21fee None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:10.533365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b86cc-22f4-4622-b2d0-0d9a06b21fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:10.551459 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-ea1b86cc-22f4-4622-b2d0-0d9a06b21fee None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:10.552694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ea1b86cc-22f4-4622-b2d0-0d9a06b21fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:10.646821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 80/147] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:10.682436 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50df607-a6ca-4d1d-9be5-bcbf8a56d511 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:10.730833 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1a75c-1601-48a4-a239-cce7c0287d06 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:10.731136 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1a75c-1601-48a4-a239-cce7c0287d06 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:10.731393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1a75c-1601-48a4-a239-cce7c0287d06 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:10.732943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 81/148] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:10.739060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae848455-fc68-456b-a3e9-c2406e243d20 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:10.739352 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae848455-fc68-456b-a3e9-c2406e243d20 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:10.739639 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae848455-fc68-456b-a3e9-c2406e243d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:10.770143 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-ae848455-fc68-456b-a3e9-c2406e243d20 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:10.771470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ae848455-fc68-456b-a3e9-c2406e243d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:10.817510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50df607-a6ca-4d1d-9be5-bcbf8a56d511 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:10.860734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32489408-2c1b-417c-8a83-c2f12975f917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:10.864571 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32489408-2c1b-417c-8a83-c2f12975f917 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:10.864571 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32489408-2c1b-417c-8a83-c2f12975f917 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:10.864571 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32489408-2c1b-417c-8a83-c2f12975f917 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:10.877615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32489408-2c1b-417c-8a83-c2f12975f917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:10.888246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-32489408-2c1b-417c-8a83-c2f12975f917 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:10.888246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:10.888246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:10.888246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:10.888246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:10.888246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:10.888246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:10.888246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:10.888246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:10.888246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:10.888246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:10.888246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:10.888246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:10.888246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:10.888246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:10.888246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:10.889323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:10.889323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:10.889323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:10.889323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:10.889323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:10.889323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:10.889323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:10.889323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:10.889323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:10.889323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:10.889323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:10.889323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:10.889323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:10.889323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:10.889323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:10.889323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:10.890265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:10.890265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:10.890265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:10.890265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:10.890265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:10.890265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:10.890265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:10.890265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:10.890265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:10.890265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:10.890265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:10.890265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:10.892602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 68/149] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:10.902304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32489408-2c1b-417c-8a83-c2f12975f917 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:10.926154 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 82/150] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:10.974808 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae848455-fc68-456b-a3e9-c2406e243d20 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:10.990544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:11.035636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:11.048771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32489408-2c1b-417c-8a83-c2f12975f917 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:11.094994 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1ea3b-97c0-4d2a-bc45-1e1b52000dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:11.096047 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1ea3b-97c0-4d2a-bc45-1e1b52000dfc None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:11.096527 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1ea3b-97c0-4d2a-bc45-1e1b52000dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:11.097005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1ea3b-97c0-4d2a-bc45-1e1b52000dfc None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:11.097995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1ea3b-97c0-4d2a-bc45-1e1b52000dfc None admin] RBAC: Adding query filter params (name=member) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:11.098519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1ea3b-97c0-4d2a-bc45-1e1b52000dfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:11.100447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1ea3b-97c0-4d2a-bc45-1e1b52000dfc None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:11.113967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 69/151] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:11.121803 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1ea3b-97c0-4d2a-bc45-1e1b52000dfc None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:11.150376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae848455-fc68-456b-a3e9-c2406e243d20 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:11.216599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acb6dd-cdd9-4c3a-821e-78fa9adb234a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:11.217417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acb6dd-cdd9-4c3a-821e-78fa9adb234a None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:11.217711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acb6dd-cdd9-4c3a-821e-78fa9adb234a None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:11.218005 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acb6dd-cdd9-4c3a-821e-78fa9adb234a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:11.219372 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acb6dd-cdd9-4c3a-821e-78fa9adb234a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:11.220892 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acb6dd-cdd9-4c3a-821e-78fa9adb234a None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:11.227302 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 83/152] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:11.238574 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acb6dd-cdd9-4c3a-821e-78fa9adb234a None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:11.255326 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1ea3b-97c0-4d2a-bc45-1e1b52000dfc None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:11.273488 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:11.293015 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3856a2-1c8b-40d6-9b27-fc6f8145a0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:11.294386 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3856a2-1c8b-40d6-9b27-fc6f8145a0fe None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:11.294870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3856a2-1c8b-40d6-9b27-fc6f8145a0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:11.295355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3856a2-1c8b-40d6-9b27-fc6f8145a0fe None admin] PATH_INFO: `/v3/users/1116c623801c4ed79d916a1359b00bac` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:11.296782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3856a2-1c8b-40d6-9b27-fc6f8145a0fe None admin] RBAC: Authorizing `identity:get_user(user_id=1116c623801c4ed79d916a1359b00bac)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:11.298504 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3856a2-1c8b-40d6-9b27-fc6f8145a0fe None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:11.300454 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 70/153] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:11 2022] GET /identity/v3/users/1116c623801c4ed79d916a1359b00bac => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:11.302239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6033a-1edf-4e6c-8987-cd232ffb1726 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:11.302886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6033a-1edf-4e6c-8987-cd232ffb1726 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:11.303458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6033a-1edf-4e6c-8987-cd232ffb1726 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:11.305594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 71/154] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:11.306548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6033a-1edf-4e6c-8987-cd232ffb1726 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:11.365917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acb6dd-cdd9-4c3a-821e-78fa9adb234a None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:11.368082 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:11.402661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee67ab0-9aaa-4f83-aec4-342743c85324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:11.403352 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee67ab0-9aaa-4f83-aec4-342743c85324 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:11.403936 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee67ab0-9aaa-4f83-aec4-342743c85324 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:11.403936 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee67ab0-9aaa-4f83-aec4-342743c85324 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:11.404610 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee67ab0-9aaa-4f83-aec4-342743c85324 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:11.406307 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee67ab0-9aaa-4f83-aec4-342743c85324 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:11.419290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6033a-1edf-4e6c-8987-cd232ffb1726 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:11.454202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb76cbd-dcc3-48f7-8f0c-f05a44d15e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:11.455320 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb76cbd-dcc3-48f7-8f0c-f05a44d15e49 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:11.455815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb76cbd-dcc3-48f7-8f0c-f05a44d15e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:11.456300 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb76cbd-dcc3-48f7-8f0c-f05a44d15e49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:11.507526 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:11.526293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb76cbd-dcc3-48f7-8f0c-f05a44d15e49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:11.528204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb76cbd-dcc3-48f7-8f0c-f05a44d15e49 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:11.540818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 84/155] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:11 2022] POST /identity/v3/users => generated 283 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:43:11.540818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67233ed6-109e-48bf-8179-8c463c5babde None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:11.540818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67233ed6-109e-48bf-8179-8c463c5babde None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:11.540818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67233ed6-109e-48bf-8179-8c463c5babde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:11.554063 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-67233ed6-109e-48bf-8179-8c463c5babde None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:11.555902 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-67233ed6-109e-48bf-8179-8c463c5babde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:11.668708 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 72/156] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:11.679502 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb76cbd-dcc3-48f7-8f0c-f05a44d15e49 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:11.689161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 85/157] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:11.706845 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67233ed6-109e-48bf-8179-8c463c5babde None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:11.821235 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:11.831831 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67233ed6-109e-48bf-8179-8c463c5babde None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:11.870308 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:11.885904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc986c67-43e7-4aeb-bdf7-b922f8c72929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:11.886721 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc986c67-43e7-4aeb-bdf7-b922f8c72929 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:11.887008 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc986c67-43e7-4aeb-bdf7-b922f8c72929 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:11.887289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc986c67-43e7-4aeb-bdf7-b922f8c72929 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:11.900506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb76cbd-dcc3-48f7-8f0c-f05a44d15e49 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:11.903420 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc986c67-43e7-4aeb-bdf7-b922f8c72929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:11.912654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-fc986c67-43e7-4aeb-bdf7-b922f8c72929 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:11.912654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:11.912654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:11.912654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:11.912654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:11.912654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:11.912654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:11.912654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:11.912654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:11.912654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:11.912654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:11.912654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:11.912654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:11.912654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:11.912654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:11.912654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:11.917361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:11.917361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:11.917361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:11.917361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:11.917361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:11.917361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:11.917361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:11.917361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:11.917361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:11.917361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:11.917361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:11.917361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:11.917361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:11.917361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:11.917361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:11.917361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:11.918146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:11.918146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:11.918146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:11.918146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:11.918146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:11.918146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:11.918146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:11.918146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:11.918146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:11.918146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:11.918146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:11.918146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:11.918146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 86/158] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:11.924419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc986c67-43e7-4aeb-bdf7-b922f8c72929 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:11.956669 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df21197-fe59-4d73-ab06-fbe0b8225cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:11.957763 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df21197-fe59-4d73-ab06-fbe0b8225cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:11.958140 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df21197-fe59-4d73-ab06-fbe0b8225cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:11.958490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df21197-fe59-4d73-ab06-fbe0b8225cf9 None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:11.959818 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df21197-fe59-4d73-ab06-fbe0b8225cf9 None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:11.964267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df21197-fe59-4d73-ab06-fbe0b8225cf9 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:11.964267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 73/159] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:11 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:11.983319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df21197-fe59-4d73-ab06-fbe0b8225cf9 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:12.090800 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc986c67-43e7-4aeb-bdf7-b922f8c72929 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:12.120218 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df21197-fe59-4d73-ab06-fbe0b8225cf9 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:12.133925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedd0ec-445c-4d98-bbfd-0c82df3adc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:12.134609 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedd0ec-445c-4d98-bbfd-0c82df3adc95 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.134900 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedd0ec-445c-4d98-bbfd-0c82df3adc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.135183 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedd0ec-445c-4d98-bbfd-0c82df3adc95 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.135948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aedd0ec-445c-4d98-bbfd-0c82df3adc95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:12.136509 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aedd0ec-445c-4d98-bbfd-0c82df3adc95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:12.137700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aedd0ec-445c-4d98-bbfd-0c82df3adc95 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:12.146789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 87/160] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:12.148491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4672f2d-d2f7-4fb0-aef5-f900e8563828 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.148871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4672f2d-d2f7-4fb0-aef5-f900e8563828 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.149686 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4672f2d-d2f7-4fb0-aef5-f900e8563828 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.151134 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 88/161] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:12.152046 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36833b42-a8f7-4d66-bf0f-1572a9de5776 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.152499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36833b42-a8f7-4d66-bf0f-1572a9de5776 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.152783 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36833b42-a8f7-4d66-bf0f-1572a9de5776 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.154891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 89/162] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:12.155890 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36833b42-a8f7-4d66-bf0f-1572a9de5776 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:12.171740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:12.172858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be955144-3413-4687-9991-3b12322c84dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:12.175715 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be955144-3413-4687-9991-3b12322c84dd None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.175715 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be955144-3413-4687-9991-3b12322c84dd None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.175715 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be955144-3413-4687-9991-3b12322c84dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.175715 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be955144-3413-4687-9991-3b12322c84dd None admin] RBAC: Adding query filter params (role.id=6832f9f0b207495a9a247504bcb6b49f, scope.project.id=54dee477b50d4b1283589452d92ce93f, user.id=1116c623801c4ed79d916a1359b00bac) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:12.176123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be955144-3413-4687-9991-3b12322c84dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:12.178943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be955144-3413-4687-9991-3b12322c84dd None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:12.197243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 74/163] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:11 2022] GET /identity/v3/role_assignments?user.id=1116c623801c4ed79d916a1359b00bac&scope.project.id=54dee477b50d4b1283589452d92ce93f&role.id=6832f9f0b207495a9a247504bcb6b49f => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:12.197243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19b7d-4b8a-485d-8947-a32a8213c8f0 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.197243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19b7d-4b8a-485d-8947-a32a8213c8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.197243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19b7d-4b8a-485d-8947-a32a8213c8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.212745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-f5f19b7d-4b8a-485d-8947-a32a8213c8f0 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:12.214047 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f5f19b7d-4b8a-485d-8947-a32a8213c8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:12.226969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:12.306183 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36833b42-a8f7-4d66-bf0f-1572a9de5776 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:12.325169 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 75/164] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:12.327296 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f39104-9df0-4645-815d-2578508ee852 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.327596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f39104-9df0-4645-815d-2578508ee852 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.328177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f39104-9df0-4645-815d-2578508ee852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.363986 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-69f39104-9df0-4645-815d-2578508ee852 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:12.365394 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-69f39104-9df0-4645-815d-2578508ee852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:12.367255 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbed9c-4a5c-4a4d-87f7-9a770781e1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:12.368551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbed9c-4a5c-4a4d-87f7-9a770781e1ee None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.369059 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbed9c-4a5c-4a4d-87f7-9a770781e1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.369641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbed9c-4a5c-4a4d-87f7-9a770781e1ee None admin] PATH_INFO: `/v3/users/1116c623801c4ed79d916a1359b00bac` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.371243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbed9c-4a5c-4a4d-87f7-9a770781e1ee None admin] RBAC: Authorizing `identity:get_user(user_id=1116c623801c4ed79d916a1359b00bac)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:12.372946 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbed9c-4a5c-4a4d-87f7-9a770781e1ee None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:12.374910 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 90/165] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:12 2022] GET /identity/v3/users/1116c623801c4ed79d916a1359b00bac => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:12.375960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbed9c-4a5c-4a4d-87f7-9a770781e1ee None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:12.460526 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 76/166] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:12.461620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f39104-9df0-4645-815d-2578508ee852 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:12.478289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:12.502632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbed9c-4a5c-4a4d-87f7-9a770781e1ee None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:12.541654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:12.546628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45069ab8-3a5a-4add-82c3-1fe91e99d4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:12.547512 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45069ab8-3a5a-4add-82c3-1fe91e99d4dc None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.547836 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45069ab8-3a5a-4add-82c3-1fe91e99d4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.548558 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45069ab8-3a5a-4add-82c3-1fe91e99d4dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.563266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45069ab8-3a5a-4add-82c3-1fe91e99d4dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:12.572656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-45069ab8-3a5a-4add-82c3-1fe91e99d4dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:12.572656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:12.572656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:12.572656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:12.572656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:12.572656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:12.572656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:12.572656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:12.572656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:12.572656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:12.572656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:12.572656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:12.572656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:12.572656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:12.572656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:12.572656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:12.573562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:12.573562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:12.573562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:12.573562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:12.573562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:12.573562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:12.573562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:12.573562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:12.573562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:12.573562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:12.573562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:12.573562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:12.573562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:12.573562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:12.573562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:12.573562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:12.574673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:12.574673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:12.574673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:12.574673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:12.574673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:12.574673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:12.574673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:12.574673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:12.574673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:12.574673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:12.574673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:12.574673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:12.574673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 91/167] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:12.575307 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45069ab8-3a5a-4add-82c3-1fe91e99d4dc None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:12.618951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f39104-9df0-4645-815d-2578508ee852 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:12.679271 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1690f-c6c8-4c43-9dc6-2b3e384bd51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:12.679942 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1690f-c6c8-4c43-9dc6-2b3e384bd51b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.680749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1690f-c6c8-4c43-9dc6-2b3e384bd51b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.681031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1690f-c6c8-4c43-9dc6-2b3e384bd51b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.690999 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45069ab8-3a5a-4add-82c3-1fe91e99d4dc None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:12.726811 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c54b8c-dbdf-4a9d-946a-244a39e0232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:12.727719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c54b8c-dbdf-4a9d-946a-244a39e0232d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.728012 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c54b8c-dbdf-4a9d-946a-244a39e0232d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.728293 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c54b8c-dbdf-4a9d-946a-244a39e0232d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.739271 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c54b8c-dbdf-4a9d-946a-244a39e0232d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:12.747975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-f3c54b8c-dbdf-4a9d-946a-244a39e0232d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:12.747975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:12.747975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:12.747975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:12.747975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:12.747975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:12.747975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:12.747975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:12.747975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:12.747975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:12.747975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:12.747975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:12.747975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:12.747975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:12.747975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:12.747975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:12.750140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:12.750140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:12.750140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:12.750140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:12.750140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:12.750140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:12.750140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:12.750140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:12.750140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:12.750140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:12.750140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:12.750140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:12.750140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:12.750140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:12.750140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:12.750140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:12.752098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:12.752098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:12.752098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:12.752098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:12.752098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:12.752098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:12.752098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:12.752098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:12.752098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:12.752098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:12.752098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:12.752098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:12.752098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 92/168] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:12.752098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c54b8c-dbdf-4a9d-946a-244a39e0232d None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:12.758320 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:12.800987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1690f-c6c8-4c43-9dc6-2b3e384bd51b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:12.806632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1690f-c6c8-4c43-9dc6-2b3e384bd51b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:12.861001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c54b8c-dbdf-4a9d-946a-244a39e0232d None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:12.899497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d79e97-61e1-4907-83ec-471a4d31973d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:12.900103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d79e97-61e1-4907-83ec-471a4d31973d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:12.900393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d79e97-61e1-4907-83ec-471a4d31973d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:12.900679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d79e97-61e1-4907-83ec-471a4d31973d None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:12.901474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d79e97-61e1-4907-83ec-471a4d31973d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:12.901787 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d79e97-61e1-4907-83ec-471a4d31973d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:12.903820 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d79e97-61e1-4907-83ec-471a4d31973d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:12.918133 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 93/169] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:12.918751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d79e97-61e1-4907-83ec-471a4d31973d None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:12.989412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.008895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.041648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 77/170] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:13.042490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1690f-c6c8-4c43-9dc6-2b3e384bd51b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.086172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d79e97-61e1-4907-83ec-471a4d31973d None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.154923 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b83ad-fb0e-4919-bca4-a85ca2f98ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.155662 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b83ad-fb0e-4919-bca4-a85ca2f98ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.155854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b83ad-fb0e-4919-bca4-a85ca2f98ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.156147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b83ad-fb0e-4919-bca4-a85ca2f98ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.156901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b83ad-fb0e-4919-bca4-a85ca2f98ea3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:13.157238 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b83ad-fb0e-4919-bca4-a85ca2f98ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.158633 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b83ad-fb0e-4919-bca4-a85ca2f98ea3 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.180567 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 94/171] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:13.181452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b83ad-fb0e-4919-bca4-a85ca2f98ea3 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.227543 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1690f-c6c8-4c43-9dc6-2b3e384bd51b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.266821 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee7b58-3059-40de-818a-68a28e5b5f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.268352 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee7b58-3059-40de-818a-68a28e5b5f6b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.268843 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee7b58-3059-40de-818a-68a28e5b5f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.269351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee7b58-3059-40de-818a-68a28e5b5f6b None admin] PATH_INFO: `/v3/users/f5be3aff441b4df5a906a4fed4e02295` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.270774 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee7b58-3059-40de-818a-68a28e5b5f6b None admin] RBAC: Authorizing `identity:get_user(user_id=f5be3aff441b4df5a906a4fed4e02295)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.272972 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee7b58-3059-40de-818a-68a28e5b5f6b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.274856 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 78/172] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/users/f5be3aff441b4df5a906a4fed4e02295 => generated 289 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:13.280767 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee7b58-3059-40de-818a-68a28e5b5f6b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.331542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.415955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee7b58-3059-40de-818a-68a28e5b5f6b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.459024 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b83ad-fb0e-4919-bca4-a85ca2f98ea3 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.468743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea54d0-e82d-45c7-8336-d0d2791e95be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.469911 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea54d0-e82d-45c7-8336-d0d2791e95be None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.470402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea54d0-e82d-45c7-8336-d0d2791e95be None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.470879 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea54d0-e82d-45c7-8336-d0d2791e95be None admin] PATH_INFO: `/v3/users/1116c623801c4ed79d916a1359b00bac` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.472322 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea54d0-e82d-45c7-8336-d0d2791e95be None admin] RBAC: Authorizing `identity:get_user(user_id=1116c623801c4ed79d916a1359b00bac)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.474016 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea54d0-e82d-45c7-8336-d0d2791e95be None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.475863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 79/173] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/users/1116c623801c4ed79d916a1359b00bac => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:13.481748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea54d0-e82d-45c7-8336-d0d2791e95be None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.500312 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.526873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a616c-4a99-445e-b7aa-536f6abf3706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.528073 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a616c-4a99-445e-b7aa-536f6abf3706 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.528558 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a616c-4a99-445e-b7aa-536f6abf3706 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.529031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a616c-4a99-445e-b7aa-536f6abf3706 None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.532765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a616c-4a99-445e-b7aa-536f6abf3706 None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.534619 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a616c-4a99-445e-b7aa-536f6abf3706 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.541370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 95/174] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:13.542413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a616c-4a99-445e-b7aa-536f6abf3706 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.631694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea54d0-e82d-45c7-8336-d0d2791e95be None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.657322 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.662385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a616c-4a99-445e-b7aa-536f6abf3706 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.685524 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233eded4-4a05-4eff-834a-4fe2d64626ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.686998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eded4-4a05-4eff-834a-4fe2d64626ff None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.687692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eded4-4a05-4eff-834a-4fe2d64626ff None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.688315 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eded4-4a05-4eff-834a-4fe2d64626ff None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.689841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233eded4-4a05-4eff-834a-4fe2d64626ff None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.691918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233eded4-4a05-4eff-834a-4fe2d64626ff None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.693805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 80/175] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:13.694738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233eded4-4a05-4eff-834a-4fe2d64626ff None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:13.723888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a2502-efbd-499c-9cdf-69fc18113651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.724549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a2502-efbd-499c-9cdf-69fc18113651 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.724833 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a2502-efbd-499c-9cdf-69fc18113651 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.725113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a2502-efbd-499c-9cdf-69fc18113651 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.806202 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:13.817848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a2502-efbd-499c-9cdf-69fc18113651 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.819331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a2502-efbd-499c-9cdf-69fc18113651 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.828625 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233eded4-4a05-4eff-834a-4fe2d64626ff None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:13.888584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898d566-a9be-4f99-8fdd-5a23a9c8e946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:13.889283 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898d566-a9be-4f99-8fdd-5a23a9c8e946 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:13.889570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898d566-a9be-4f99-8fdd-5a23a9c8e946 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:13.889850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898d566-a9be-4f99-8fdd-5a23a9c8e946 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:13.890692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898d566-a9be-4f99-8fdd-5a23a9c8e946 None admin] RBAC: Adding query filter params (role.id=602eca0d730345ff8999a6bbd7124092, scope.project.id=54dee477b50d4b1283589452d92ce93f, user.id=1116c623801c4ed79d916a1359b00bac) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:13.891006 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898d566-a9be-4f99-8fdd-5a23a9c8e946 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:13.892463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898d566-a9be-4f99-8fdd-5a23a9c8e946 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:13.910567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 81/176] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/role_assignments?user.id=1116c623801c4ed79d916a1359b00bac&scope.project.id=54dee477b50d4b1283589452d92ce93f&role.id=602eca0d730345ff8999a6bbd7124092 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:13.911199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898d566-a9be-4f99-8fdd-5a23a9c8e946 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:14.026394 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:14.027078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 96/177] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:14.034626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a2502-efbd-499c-9cdf-69fc18113651 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:14.173862 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898d566-a9be-4f99-8fdd-5a23a9c8e946 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:14.255212 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465f697-60b5-4e6d-bf8e-31afb81771cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.256033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465f697-60b5-4e6d-bf8e-31afb81771cf None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.256318 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465f697-60b5-4e6d-bf8e-31afb81771cf None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.256598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465f697-60b5-4e6d-bf8e-31afb81771cf None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f/users/f5be3aff441b4df5a906a4fed4e02295/roles/51d54eaf35fd45ccb7048e3f446f1eac` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.256850 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:14.261788 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465f697-60b5-4e6d-bf8e-31afb81771cf None admin] RBAC: Authorizing `identity:create_grant(project_id=54dee477b50d4b1283589452d92ce93f, user_id=f5be3aff441b4df5a906a4fed4e02295, role_id=51d54eaf35fd45ccb7048e3f446f1eac)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:14.263263 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465f697-60b5-4e6d-bf8e-31afb81771cf None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:14.275474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a2502-efbd-499c-9cdf-69fc18113651 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:14.311352 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e02a8a-8831-4fbc-814b-9f9c22f4d08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.313438 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e02a8a-8831-4fbc-814b-9f9c22f4d08e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.313438 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e02a8a-8831-4fbc-814b-9f9c22f4d08e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.313438 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e02a8a-8831-4fbc-814b-9f9c22f4d08e None admin] PATH_INFO: `/v3/projects/64c74d1ebe674afd96b3379a9b18b3de` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.314022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e02a8a-8831-4fbc-814b-9f9c22f4d08e None admin] RBAC: Authorizing `identity:get_project(project_id=64c74d1ebe674afd96b3379a9b18b3de)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:14.315510 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e02a8a-8831-4fbc-814b-9f9c22f4d08e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:14.317280 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 97/178] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:14 2022] GET /identity/v3/projects/64c74d1ebe674afd96b3379a9b18b3de => generated 312 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:14.325853 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e02a8a-8831-4fbc-814b-9f9c22f4d08e None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:14.372227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 82/179] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:13 2022] PUT /identity/v3/projects/54dee477b50d4b1283589452d92ce93f/users/f5be3aff441b4df5a906a4fed4e02295/roles/51d54eaf35fd45ccb7048e3f446f1eac => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:14.459706 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16873354-a787-4a49-9a3f-b4a1e63accc4 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.460356 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16873354-a787-4a49-9a3f-b4a1e63accc4 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.460565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e02a8a-8831-4fbc-814b-9f9c22f4d08e None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:14.461109 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16873354-a787-4a49-9a3f-b4a1e63accc4 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.462814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 83/180] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:14.469795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a410a-dde7-4140-bc14-521563fc2f18 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.470382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a410a-dde7-4140-bc14-521563fc2f18 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.470848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a410a-dde7-4140-bc14-521563fc2f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.496711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-1b4a410a-dde7-4140-bc14-521563fc2f18 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:14.497982 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-1b4a410a-dde7-4140-bc14-521563fc2f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:14.511169 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74b968-498a-4583-91fd-fd7a62a17043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.512168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74b968-498a-4583-91fd-fd7a62a17043 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.513064 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74b968-498a-4583-91fd-fd7a62a17043 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.513576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74b968-498a-4583-91fd-fd7a62a17043 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.515571 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74b968-498a-4583-91fd-fd7a62a17043 None admin] RBAC: Adding query filter params (role.id=6832f9f0b207495a9a247504bcb6b49f, scope.project.id=64c74d1ebe674afd96b3379a9b18b3de, user.id=1116c623801c4ed79d916a1359b00bac) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:14.516144 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74b968-498a-4583-91fd-fd7a62a17043 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:14.518517 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74b968-498a-4583-91fd-fd7a62a17043 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:14.527889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 98/181] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:14 2022] GET /identity/v3/role_assignments?user.id=1116c623801c4ed79d916a1359b00bac&scope.project.id=64c74d1ebe674afd96b3379a9b18b3de&role.id=6832f9f0b207495a9a247504bcb6b49f => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:14.585251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 84/182] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:14.609078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74b968-498a-4583-91fd-fd7a62a17043 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:14.638441 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:14.737104 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74b968-498a-4583-91fd-fd7a62a17043 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:14.775342 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437ac4c-afc9-4612-9ba6-f9d076429419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.776495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437ac4c-afc9-4612-9ba6-f9d076429419 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.776979 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437ac4c-afc9-4612-9ba6-f9d076429419 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.777481 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437ac4c-afc9-4612-9ba6-f9d076429419 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.789581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437ac4c-afc9-4612-9ba6-f9d076429419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:14.797866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-a437ac4c-afc9-4612-9ba6-f9d076429419 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:14.797866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:14.797866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:14.797866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:14.797866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:14.797866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:14.797866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:14.797866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:14.797866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:14.797866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:14.797866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:14.797866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:14.797866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:14.797866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:14.797866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:14.797866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:14.798893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:14.798893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:14.798893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:14.798893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:14.798893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:14.798893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:14.798893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:14.798893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:14.798893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:14.798893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:14.798893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:14.798893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:14.798893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:14.798893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:14.798893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:14.798893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:14.799665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:14.799665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:14.799665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:14.799665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:14.799665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:14.799665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:14.799665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:14.799665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:14.799665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:14.799665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:14.799665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:14.799665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:14.801749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 99/183] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:14.809201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a410a-dde7-4140-bc14-521563fc2f18 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:14.847185 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:14.894049 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70852b95-82a6-4331-919e-a597d11cf315 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.894905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70852b95-82a6-4331-919e-a597d11cf315 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.895390 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70852b95-82a6-4331-919e-a597d11cf315 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.897471 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 100/184] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:14.903927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329e682-f475-49da-a0af-e7859e63f3ef None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.904389 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329e682-f475-49da-a0af-e7859e63f3ef None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.904671 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329e682-f475-49da-a0af-e7859e63f3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.926055 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-4329e682-f475-49da-a0af-e7859e63f3ef None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:14.928378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a410a-dde7-4140-bc14-521563fc2f18 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:14.929184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4329e682-f475-49da-a0af-e7859e63f3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:14.975312 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55c7cd-f6c6-44c4-8d48-76980d2a03ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:14.976365 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55c7cd-f6c6-44c4-8d48-76980d2a03ab None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:14.976829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55c7cd-f6c6-44c4-8d48-76980d2a03ab None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:14.977408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55c7cd-f6c6-44c4-8d48-76980d2a03ab None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:14.979945 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55c7cd-f6c6-44c4-8d48-76980d2a03ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:14.980452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55c7cd-f6c6-44c4-8d48-76980d2a03ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:14.982112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55c7cd-f6c6-44c4-8d48-76980d2a03ab None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:14.996659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 85/185] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:15.002230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55c7cd-f6c6-44c4-8d48-76980d2a03ab None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.021189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 101/186] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:15.046165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329e682-f475-49da-a0af-e7859e63f3ef None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.063620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.141289 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.148453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55c7cd-f6c6-44c4-8d48-76980d2a03ab None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.169983 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329e682-f475-49da-a0af-e7859e63f3ef None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.184802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321918f9-6b4f-4fae-b524-c6167c02719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.185725 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321918f9-6b4f-4fae-b524-c6167c02719a None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.186014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321918f9-6b4f-4fae-b524-c6167c02719a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.186301 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321918f9-6b4f-4fae-b524-c6167c02719a None admin] PATH_INFO: `/v3/users/8fd04ca9fd584971a66c11d7e529411b` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.199786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321918f9-6b4f-4fae-b524-c6167c02719a None admin] RBAC: Authorizing `identity:get_user(user_id=8fd04ca9fd584971a66c11d7e529411b)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.201277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321918f9-6b4f-4fae-b524-c6167c02719a None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.207350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 86/187] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/users/8fd04ca9fd584971a66c11d7e529411b => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:15.207350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235830e8-7035-449b-93f2-471d9d279ac1 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.207350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235830e8-7035-449b-93f2-471d9d279ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.207350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235830e8-7035-449b-93f2-471d9d279ac1 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.207743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19501d7d-9e1e-4c0e-8890-8956fe5e8bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.207743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19501d7d-9e1e-4c0e-8890-8956fe5e8bcf None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.207743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19501d7d-9e1e-4c0e-8890-8956fe5e8bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.207940 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 87/188] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:15.208397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235830e8-7035-449b-93f2-471d9d279ac1 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.210282 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19501d7d-9e1e-4c0e-8890-8956fe5e8bcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.211564 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19501d7d-9e1e-4c0e-8890-8956fe5e8bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.213032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19501d7d-9e1e-4c0e-8890-8956fe5e8bcf None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.214823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 102/189] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:15.215920 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a9db0-38fe-40c7-b09f-b75ad8c5451d None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.216214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a9db0-38fe-40c7-b09f-b75ad8c5451d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.216492 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a9db0-38fe-40c7-b09f-b75ad8c5451d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.233106 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-de0a9db0-38fe-40c7-b09f-b75ad8c5451d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:15.234318 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-de0a9db0-38fe-40c7-b09f-b75ad8c5451d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:15.310971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 103/190] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:15.311760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a9db0-38fe-40c7-b09f-b75ad8c5451d None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.320299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235830e8-7035-449b-93f2-471d9d279ac1 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.335309 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.358605 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add8f10-bdf6-4852-97a6-b287c507bfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.359274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add8f10-bdf6-4852-97a6-b287c507bfa9 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.359564 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add8f10-bdf6-4852-97a6-b287c507bfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.359844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add8f10-bdf6-4852-97a6-b287c507bfa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.381686 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.432138 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add8f10-bdf6-4852-97a6-b287c507bfa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.433643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add8f10-bdf6-4852-97a6-b287c507bfa9 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.437482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a9db0-38fe-40c7-b09f-b75ad8c5451d None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.473154 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e268fa-b377-4805-895f-651a078d3137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.474272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e268fa-b377-4805-895f-651a078d3137 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.474272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e268fa-b377-4805-895f-651a078d3137 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.474595 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e268fa-b377-4805-895f-651a078d3137 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.475301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e268fa-b377-4805-895f-651a078d3137 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.476841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e268fa-b377-4805-895f-651a078d3137 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.534078 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 88/191] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:15.534078 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add8f10-bdf6-4852-97a6-b287c507bfa9 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.577230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 104/192] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:15 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:15.578353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e268fa-b377-4805-895f-651a078d3137 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.598963 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.672034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add8f10-bdf6-4852-97a6-b287c507bfa9 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.672881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.713912 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e268fa-b377-4805-895f-651a078d3137 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.722869 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d369dd-aafa-45ab-9314-9a2106447cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.723806 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d369dd-aafa-45ab-9314-9a2106447cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.724100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d369dd-aafa-45ab-9314-9a2106447cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.724382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d369dd-aafa-45ab-9314-9a2106447cc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.738315 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d369dd-aafa-45ab-9314-9a2106447cc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:15.746983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-44d369dd-aafa-45ab-9314-9a2106447cc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:15.746983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:15.746983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:15.746983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:15.746983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:15.746983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:15.746983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:15.746983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:15.746983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:15.746983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:15.746983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:15.746983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:15.746983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:15.746983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:15.746983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:15.746983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:15.747889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:15.747889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:15.747889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:15.747889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:15.747889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:15.747889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:15.747889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:15.747889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:15.747889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:15.747889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:15.747889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:15.747889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:15.747889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:15.747889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:15.747889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:15.747889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:15.748673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:15.748673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:15.748673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:15.748673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:15.748673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:15.748673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:15.748673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:15.748673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:15.748673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:15.748673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:15.748673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:15.748673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:15.748673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 89/193] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:15.755573 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d369dd-aafa-45ab-9314-9a2106447cc9 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.759041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec904e4b-2064-44ab-b1d8-406309257e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.760799 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec904e4b-2064-44ab-b1d8-406309257e68 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.761107 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec904e4b-2064-44ab-b1d8-406309257e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.761407 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec904e4b-2064-44ab-b1d8-406309257e68 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.762649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec904e4b-2064-44ab-b1d8-406309257e68 None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.764109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec904e4b-2064-44ab-b1d8-406309257e68 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.766444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 105/194] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:15.772478 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec904e4b-2064-44ab-b1d8-406309257e68 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:15.887748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d369dd-aafa-45ab-9314-9a2106447cc9 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.897472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec904e4b-2064-44ab-b1d8-406309257e68 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:15.912715 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.937850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd0928-c85a-40a2-a582-bc5731e92a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.938043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38305819-076b-4d65-b514-fc142ef6f3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:15.938537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd0928-c85a-40a2-a582-bc5731e92a47 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.938637 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38305819-076b-4d65-b514-fc142ef6f3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:15.942378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd0928-c85a-40a2-a582-bc5731e92a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.942485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38305819-076b-4d65-b514-fc142ef6f3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:15.942558 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd0928-c85a-40a2-a582-bc5731e92a47 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.942625 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38305819-076b-4d65-b514-fc142ef6f3c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:15.942691 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd0928-c85a-40a2-a582-bc5731e92a47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:15.942767 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38305819-076b-4d65-b514-fc142ef6f3c6 None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.project.id=95ca3cd0264d43a2af05d5013692c2da, user.id=8fd04ca9fd584971a66c11d7e529411b) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:15.942836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd0928-c85a-40a2-a582-bc5731e92a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.942900 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38305819-076b-4d65-b514-fc142ef6f3c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:15.942965 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd0928-c85a-40a2-a582-bc5731e92a47 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.943029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38305819-076b-4d65-b514-fc142ef6f3c6 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:15.945203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:15.952204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 106/195] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/role_assignments?user.id=8fd04ca9fd584971a66c11d7e529411b&scope.project.id=95ca3cd0264d43a2af05d5013692c2da&role.id=c865040abd6c4b099381557da21c471d => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:15.954469 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 90/196] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:15.960009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38305819-076b-4d65-b514-fc142ef6f3c6 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:16.082355 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38305819-076b-4d65-b514-fc142ef6f3c6 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:16.123815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a957c5e-b7f8-462b-871b-96d07bf106cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:16.124736 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a957c5e-b7f8-462b-871b-96d07bf106cb None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.125025 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a957c5e-b7f8-462b-871b-96d07bf106cb None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.125335 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a957c5e-b7f8-462b-871b-96d07bf106cb None admin] PATH_INFO: `/v3/users/8fd04ca9fd584971a66c11d7e529411b` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.129991 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a957c5e-b7f8-462b-871b-96d07bf106cb None admin] RBAC: Authorizing `identity:get_user(user_id=8fd04ca9fd584971a66c11d7e529411b)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:16.131498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a957c5e-b7f8-462b-871b-96d07bf106cb None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:16.133974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 107/197] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:15 2022] GET /identity/v3/users/8fd04ca9fd584971a66c11d7e529411b => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:16.142385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd0928-c85a-40a2-a582-bc5731e92a47 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:16.266724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd0928-c85a-40a2-a582-bc5731e92a47 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:16.319147 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93521d03-00ed-425e-9494-3911f8cc0c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:16.319859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93521d03-00ed-425e-9494-3911f8cc0c85 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.320151 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93521d03-00ed-425e-9494-3911f8cc0c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.320430 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93521d03-00ed-425e-9494-3911f8cc0c85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.380472 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:16.416585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93521d03-00ed-425e-9494-3911f8cc0c85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:16.418019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93521d03-00ed-425e-9494-3911f8cc0c85 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:16.553435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 91/198] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:16.557525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a957c5e-b7f8-462b-871b-96d07bf106cb None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:16.663117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:16.705401 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a957c5e-b7f8-462b-871b-96d07bf106cb None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:16.759925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7146d20-bcef-4304-bbc2-e7a5526fda34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:16.760813 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7146d20-bcef-4304-bbc2-e7a5526fda34 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.761166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7146d20-bcef-4304-bbc2-e7a5526fda34 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.761668 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7146d20-bcef-4304-bbc2-e7a5526fda34 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.765961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7146d20-bcef-4304-bbc2-e7a5526fda34 None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:16.767496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7146d20-bcef-4304-bbc2-e7a5526fda34 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:16.769987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 108/199] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:16 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:16.778158 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93521d03-00ed-425e-9494-3911f8cc0c85 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:16.891232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79010b9-1e17-49e0-aa74-0d417c2b1562 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.891530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79010b9-1e17-49e0-aa74-0d417c2b1562 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.891815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79010b9-1e17-49e0-aa74-0d417c2b1562 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.893342 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 109/200] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:16.903269 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:16.906424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7d9e6-e04d-40c2-ba76-b537c32717f6 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:16.906720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7d9e6-e04d-40c2-ba76-b537c32717f6 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:16.907004 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7d9e6-e04d-40c2-ba76-b537c32717f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:16.943264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-b9f7d9e6-e04d-40c2-ba76-b537c32717f6 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:16.945436 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b9f7d9e6-e04d-40c2-ba76-b537c32717f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:16.954156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93521d03-00ed-425e-9494-3911f8cc0c85 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:17.027198 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baddfea-00aa-43d6-9807-ee31362d15b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:17.027869 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baddfea-00aa-43d6-9807-ee31362d15b5 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:17.028155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baddfea-00aa-43d6-9807-ee31362d15b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:17.028491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baddfea-00aa-43d6-9807-ee31362d15b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:17.029399 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baddfea-00aa-43d6-9807-ee31362d15b5 None admin] RBAC: Adding query filter params (role.id=602eca0d730345ff8999a6bbd7124092, scope.project.id=95ca3cd0264d43a2af05d5013692c2da, user.id=8fd04ca9fd584971a66c11d7e529411b) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:17.029723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baddfea-00aa-43d6-9807-ee31362d15b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:17.031181 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baddfea-00aa-43d6-9807-ee31362d15b5 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:17.044530 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 92/201] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:16 2022] GET /identity/v3/role_assignments?user.id=8fd04ca9fd584971a66c11d7e529411b&scope.project.id=95ca3cd0264d43a2af05d5013692c2da&role.id=602eca0d730345ff8999a6bbd7124092 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:17.068797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 110/202] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:17.092745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baddfea-00aa-43d6-9807-ee31362d15b5 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:17.214725 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baddfea-00aa-43d6-9807-ee31362d15b5 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:17.268898 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be994-7ea8-4a12-8520-86e89306d5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:17.269665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be994-7ea8-4a12-8520-86e89306d5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:17.269946 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be994-7ea8-4a12-8520-86e89306d5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:17.270227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be994-7ea8-4a12-8520-86e89306d5f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:17.278459 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:17.282562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900be994-7ea8-4a12-8520-86e89306d5f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:17.291119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-900be994-7ea8-4a12-8520-86e89306d5f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:17.291119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:17.291119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:17.291119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:17.291119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:17.291119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:17.291119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:17.291119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:17.291119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:17.291119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:17.291119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:17.291119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:17.291119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:17.291119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:17.291119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:17.291119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:17.299125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:17.299125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:17.299125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:17.299125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:17.299125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:17.299125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:17.299125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:17.299125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:17.299125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:17.299125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:17.299125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:17.299125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:17.299125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:17.299125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:17.299125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:17.299125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:17.299913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:17.299913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:17.299913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:17.299913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:17.299913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:17.299913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:17.299913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:17.299913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:17.299913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:17.299913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:17.299913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:17.299913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:17.299913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 93/203] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:17.300564 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7d9e6-e04d-40c2-ba76-b537c32717f6 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:17.370295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:17.423905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7d9e6-e04d-40c2-ba76-b537c32717f6 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:17.459328 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def8067-ddc9-4e27-9871-363b6269a52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:17.460021 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def8067-ddc9-4e27-9871-363b6269a52c None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:17.460304 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def8067-ddc9-4e27-9871-363b6269a52c None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:17.460575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def8067-ddc9-4e27-9871-363b6269a52c None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:17.461474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def8067-ddc9-4e27-9871-363b6269a52c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:17.462331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def8067-ddc9-4e27-9871-363b6269a52c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:17.463770 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def8067-ddc9-4e27-9871-363b6269a52c None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:17.474869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 111/204] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:17.479987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be994-7ea8-4a12-8520-86e89306d5f2 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:17.647965 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be994-7ea8-4a12-8520-86e89306d5f2 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:17.694799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a67ea-698c-4610-bfe1-6190b82a8e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:17.695694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a67ea-698c-4610-bfe1-6190b82a8e40 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:17.695985 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a67ea-698c-4610-bfe1-6190b82a8e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:17.696828 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a67ea-698c-4610-bfe1-6190b82a8e40 None admin] PATH_INFO: `/v3/users/f5be3aff441b4df5a906a4fed4e02295` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:17.698076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a67ea-698c-4610-bfe1-6190b82a8e40 None admin] RBAC: Authorizing `identity:get_user(user_id=f5be3aff441b4df5a906a4fed4e02295)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:17.699550 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a67ea-698c-4610-bfe1-6190b82a8e40 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:17.701574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 94/205] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:17 2022] GET /identity/v3/users/f5be3aff441b4df5a906a4fed4e02295 => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:17.706605 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def8067-ddc9-4e27-9871-363b6269a52c None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:17.859794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def8067-ddc9-4e27-9871-363b6269a52c None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:17.899063 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:17.907585 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1cde5-223f-44f2-8f7e-2a7aaa5a865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:17.908251 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1cde5-223f-44f2-8f7e-2a7aaa5a865d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:17.908540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1cde5-223f-44f2-8f7e-2a7aaa5a865d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:17.908822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1cde5-223f-44f2-8f7e-2a7aaa5a865d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:17.976304 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1cde5-223f-44f2-8f7e-2a7aaa5a865d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:17.977864 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1cde5-223f-44f2-8f7e-2a7aaa5a865d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:18.090794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 112/206] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:18.098254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a67ea-698c-4610-bfe1-6190b82a8e40 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:18.189427 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:18.233333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a67ea-698c-4610-bfe1-6190b82a8e40 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:18.285194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165741a-b27f-489f-892f-962d446ba88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:18.286077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165741a-b27f-489f-892f-962d446ba88d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:18.286366 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165741a-b27f-489f-892f-962d446ba88d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:18.286649 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165741a-b27f-489f-892f-962d446ba88d None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:18.296046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165741a-b27f-489f-892f-962d446ba88d None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:18.298097 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165741a-b27f-489f-892f-962d446ba88d None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:18.299716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 95/207] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:18 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:18.305440 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1cde5-223f-44f2-8f7e-2a7aaa5a865d None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:18.350830 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:18.448305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1cde5-223f-44f2-8f7e-2a7aaa5a865d None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:18.484889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e75a7-12ab-4a07-ae0d-c7bd8a993f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:18.485598 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e75a7-12ab-4a07-ae0d-c7bd8a993f7e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:18.485883 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e75a7-12ab-4a07-ae0d-c7bd8a993f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:18.486164 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e75a7-12ab-4a07-ae0d-c7bd8a993f7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:18.487153 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e75a7-12ab-4a07-ae0d-c7bd8a993f7e None admin] RBAC: Adding query filter params (role.id=51d54eaf35fd45ccb7048e3f446f1eac, scope.project.id=54dee477b50d4b1283589452d92ce93f, user.id=f5be3aff441b4df5a906a4fed4e02295) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:18.487474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e75a7-12ab-4a07-ae0d-c7bd8a993f7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:18.488625 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6529f57-fec1-473d-98ec-8b168bf1fda3 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:18.489122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e75a7-12ab-4a07-ae0d-c7bd8a993f7e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:18.489316 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6529f57-fec1-473d-98ec-8b168bf1fda3 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:18.489316 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6529f57-fec1-473d-98ec-8b168bf1fda3 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:18.490589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 96/208] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:18.495653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 113/209] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:18 2022] GET /identity/v3/role_assignments?user.id=f5be3aff441b4df5a906a4fed4e02295&scope.project.id=54dee477b50d4b1283589452d92ce93f&role.id=51d54eaf35fd45ccb7048e3f446f1eac => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:18.498464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e59d7-1341-420d-be22-5e1b2d442bd8 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:18.498758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e59d7-1341-420d-be22-5e1b2d442bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:18.499039 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e59d7-1341-420d-be22-5e1b2d442bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:18.517518 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-ea3e59d7-1341-420d-be22-5e1b2d442bd8 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:18.518831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ea3e59d7-1341-420d-be22-5e1b2d442bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:18.619227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 97/210] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:18.664491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e75a7-12ab-4a07-ae0d-c7bd8a993f7e None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:18.706503 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb1a72-6442-4631-803b-0b50c754521e None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:18.706810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb1a72-6442-4631-803b-0b50c754521e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:18.706990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb1a72-6442-4631-803b-0b50c754521e None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:18.708808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 98/211] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:18.718167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed38423-dce9-4509-ad71-103d01cf6df2 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:18.718807 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed38423-dce9-4509-ad71-103d01cf6df2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:18.719281 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed38423-dce9-4509-ad71-103d01cf6df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:18.738809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-1ed38423-dce9-4509-ad71-103d01cf6df2 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:18.740308 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-1ed38423-dce9-4509-ad71-103d01cf6df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:18.773598 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:18.785565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e75a7-12ab-4a07-ae0d-c7bd8a993f7e None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:18.810784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:18.826562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 99/212] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:18.831017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9ea61-29bf-433e-b79f-d8eb34624777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:18.831863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9ea61-29bf-433e-b79f-d8eb34624777 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:18.832157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9ea61-29bf-433e-b79f-d8eb34624777 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:18.832531 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9ea61-29bf-433e-b79f-d8eb34624777 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:18.846904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a9ea61-29bf-433e-b79f-d8eb34624777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:18.852608 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed38423-dce9-4509-ad71-103d01cf6df2 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:18.857867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-e3a9ea61-29bf-433e-b79f-d8eb34624777 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:18.857867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:18.857867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:18.857867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:18.857867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:18.857867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:18.857867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:18.857867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:18.857867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:18.857867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:18.857867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:18.857867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:18.857867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:18.857867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:18.857867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:18.857867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:18.858786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:18.858786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:18.858786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:18.858786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:18.858786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:18.858786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:18.858786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:18.858786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:18.858786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:18.858786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:18.858786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:18.858786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:18.858786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:18.858786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:18.858786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:18.858786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:18.859553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:18.859553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:18.859553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:18.859553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:18.859553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:18.859553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:18.859553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:18.859553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:18.859553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:18.859553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:18.859553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:18.859553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:18.862201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 114/213] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:18.871767 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9ea61-29bf-433e-b79f-d8eb34624777 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:18.987661 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed38423-dce9-4509-ad71-103d01cf6df2 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:19.006992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9ea61-29bf-433e-b79f-d8eb34624777 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:19.025906 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e8e7b-2024-4454-924f-e086f3a4e642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:19.026722 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e8e7b-2024-4454-924f-e086f3a4e642 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.027010 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e8e7b-2024-4454-924f-e086f3a4e642 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.027290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e8e7b-2024-4454-924f-e086f3a4e642 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.029195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e8e7b-2024-4454-924f-e086f3a4e642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:19.031156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e8e7b-2024-4454-924f-e086f3a4e642 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:19.033439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 100/214] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:19.038779 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bed9f-d921-473f-a587-050e50e0d83c None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.039072 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bed9f-d921-473f-a587-050e50e0d83c None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.039362 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bed9f-d921-473f-a587-050e50e0d83c None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.040810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 101/215] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:19.041504 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bed9f-d921-473f-a587-050e50e0d83c None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.049123 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8bf0ff-2aad-4479-ba48-e1b53d655001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:19.049819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bf0ff-2aad-4479-ba48-e1b53d655001 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.050101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bf0ff-2aad-4479-ba48-e1b53d655001 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.050372 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bf0ff-2aad-4479-ba48-e1b53d655001 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.051118 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bf0ff-2aad-4479-ba48-e1b53d655001 None admin] RBAC: Adding query filter params (name=member) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:19.051425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bf0ff-2aad-4479-ba48-e1b53d655001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:19.052805 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bf0ff-2aad-4479-ba48-e1b53d655001 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:19.061819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 115/216] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:19.062834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f5630-e704-43d7-8b07-8756d8ad695c None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.063124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f5630-e704-43d7-8b07-8756d8ad695c None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.063400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f5630-e704-43d7-8b07-8756d8ad695c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.082962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-fd4f5630-e704-43d7-8b07-8756d8ad695c None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:19.084212 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fd4f5630-e704-43d7-8b07-8756d8ad695c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:19.093637 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:19.112936 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:19.152036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bed9f-d921-473f-a587-050e50e0d83c None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:19.154429 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 116/217] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:19.159764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f5630-e704-43d7-8b07-8756d8ad695c None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.202543 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d696d-ff68-41b2-832e-904664f69a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:19.203225 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d696d-ff68-41b2-832e-904664f69a1b None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.203514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d696d-ff68-41b2-832e-904664f69a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.203818 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d696d-ff68-41b2-832e-904664f69a1b None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.204536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d696d-ff68-41b2-832e-904664f69a1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:19.206020 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d696d-ff68-41b2-832e-904664f69a1b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:19.267316 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f5630-e704-43d7-8b07-8756d8ad695c None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:19.299901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a77405-be32-4184-8e4c-9fdc40ecc0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:19.300784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a77405-be32-4184-8e4c-9fdc40ecc0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.301072 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a77405-be32-4184-8e4c-9fdc40ecc0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.301387 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a77405-be32-4184-8e4c-9fdc40ecc0c6 None admin] PATH_INFO: `/v3/users/d9af40abf6c34d8197ab1b7b590f110f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.316605 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 102/218] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:19 2022] POST /identity/v3/users => generated 297 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:19.317766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d696d-ff68-41b2-832e-904664f69a1b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.326442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:19.330068 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a77405-be32-4184-8e4c-9fdc40ecc0c6 None admin] RBAC: Authorizing `identity:get_user(user_id=d9af40abf6c34d8197ab1b7b590f110f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:19.332922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a77405-be32-4184-8e4c-9fdc40ecc0c6 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:19.336267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 117/219] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:19 2022] GET /identity/v3/users/d9af40abf6c34d8197ab1b7b590f110f => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:19.344339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a77405-be32-4184-8e4c-9fdc40ecc0c6 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.467350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d696d-ff68-41b2-832e-904664f69a1b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:19.492009 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:19.493871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a77405-be32-4184-8e4c-9fdc40ecc0c6 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:19.518325 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dd48f-0080-4830-8ab5-edaf532cafdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:19.519061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dd48f-0080-4830-8ab5-edaf532cafdc None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.519381 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dd48f-0080-4830-8ab5-edaf532cafdc None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.520414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dd48f-0080-4830-8ab5-edaf532cafdc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.533066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64dd48f-0080-4830-8ab5-edaf532cafdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:19.533668 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed3f02-508f-4704-9cb2-f9020bd4e2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:19.534277 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed3f02-508f-4704-9cb2-f9020bd4e2ff None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.534565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed3f02-508f-4704-9cb2-f9020bd4e2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.534848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed3f02-508f-4704-9cb2-f9020bd4e2ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.542716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-b64dd48f-0080-4830-8ab5-edaf532cafdc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:19.542716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:19.542716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:19.542716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:19.542716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:19.542716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:19.542716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:19.542716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:19.542716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:19.542716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:19.542716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:19.542716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:19.542716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:19.542716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:19.542716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:19.542716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:19.543585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:19.543585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:19.543585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:19.543585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:19.543585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:19.543585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:19.543585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:19.543585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:19.543585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:19.543585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:19.543585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:19.543585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:19.543585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:19.543585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:19.543585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:19.543585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:19.544343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:19.544343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:19.544343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:19.544343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:19.544343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:19.544343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:19.544343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:19.544343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:19.544343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:19.544343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:19.544343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:19.544343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:19.549453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 103/220] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:19.550714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dd48f-0080-4830-8ab5-edaf532cafdc None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.624062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:19.626736 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed3f02-508f-4704-9cb2-f9020bd4e2ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:19.628212 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed3f02-508f-4704-9cb2-f9020bd4e2ff None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:19.678937 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64dd48f-0080-4830-8ab5-edaf532cafdc None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:19.723711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d82323-92d3-48ba-a716-77051945b46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:19.725322 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d82323-92d3-48ba-a716-77051945b46d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.725828 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d82323-92d3-48ba-a716-77051945b46d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.726309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d82323-92d3-48ba-a716-77051945b46d None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.728727 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d82323-92d3-48ba-a716-77051945b46d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:19.729523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d82323-92d3-48ba-a716-77051945b46d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:19.731116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d82323-92d3-48ba-a716-77051945b46d None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:19.744243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 104/221] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:19.752210 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d82323-92d3-48ba-a716-77051945b46d None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.753651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 118/222] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:19.762355 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed3f02-508f-4704-9cb2-f9020bd4e2ff None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.829620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:19.887279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:19.890183 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed3f02-508f-4704-9cb2-f9020bd4e2ff None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:19.906552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d82323-92d3-48ba-a716-77051945b46d None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:19.925634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac1890-653e-40b9-8afa-8d732c98ccc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:19.926512 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac1890-653e-40b9-8afa-8d732c98ccc9 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.926800 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac1890-653e-40b9-8afa-8d732c98ccc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.927077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac1890-653e-40b9-8afa-8d732c98ccc9 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.928265 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac1890-653e-40b9-8afa-8d732c98ccc9 None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:19.929765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac1890-653e-40b9-8afa-8d732c98ccc9 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:19.932605 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 119/223] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:19 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:19.933895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de7324-ed35-45b9-b1c3-d24594dab146 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.934228 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de7324-ed35-45b9-b1c3-d24594dab146 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.934816 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de7324-ed35-45b9-b1c3-d24594dab146 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.936157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 120/224] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:19.940996 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de7324-ed35-45b9-b1c3-d24594dab146 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:19.944783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fa7bd-01c3-45aa-a86d-d6d51b2b9d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:19.945935 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fa7bd-01c3-45aa-a86d-d6d51b2b9d79 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.946465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fa7bd-01c3-45aa-a86d-d6d51b2b9d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.946944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fa7bd-01c3-45aa-a86d-d6d51b2b9d79 None admin] PATH_INFO: `/v3/users/8fd04ca9fd584971a66c11d7e529411b` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.948379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fa7bd-01c3-45aa-a86d-d6d51b2b9d79 None admin] RBAC: Authorizing `identity:get_user(user_id=8fd04ca9fd584971a66c11d7e529411b)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:19.950149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fa7bd-01c3-45aa-a86d-d6d51b2b9d79 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:19.952338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 105/225] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:19 2022] GET /identity/v3/users/8fd04ca9fd584971a66c11d7e529411b => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:19.953930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206367b-e9f6-4ab5-8e53-bd5898b74006 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:19.954419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206367b-e9f6-4ab5-8e53-bd5898b74006 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:19.954880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206367b-e9f6-4ab5-8e53-bd5898b74006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:19.976665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-2206367b-e9f6-4ab5-8e53-bd5898b74006 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:19.978879 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2206367b-e9f6-4ab5-8e53-bd5898b74006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:20.047464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de7324-ed35-45b9-b1c3-d24594dab146 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:20.053156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 106/226] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:20.054327 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206367b-e9f6-4ab5-8e53-bd5898b74006 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:20.112506 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed532c56-b760-42d6-833d-5fad76258791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:20.113556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed532c56-b760-42d6-833d-5fad76258791 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.114367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed532c56-b760-42d6-833d-5fad76258791 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.114843 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed532c56-b760-42d6-833d-5fad76258791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.115879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed532c56-b760-42d6-833d-5fad76258791 None admin] RBAC: Adding query filter params (role.id=6832f9f0b207495a9a247504bcb6b49f, scope.project.id=95ca3cd0264d43a2af05d5013692c2da, user.id=d9af40abf6c34d8197ab1b7b590f110f) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:20.116368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed532c56-b760-42d6-833d-5fad76258791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:20.118148 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed532c56-b760-42d6-833d-5fad76258791 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:20.129716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 121/227] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:19 2022] GET /identity/v3/role_assignments?user.id=d9af40abf6c34d8197ab1b7b590f110f&scope.project.id=95ca3cd0264d43a2af05d5013692c2da&role.id=6832f9f0b207495a9a247504bcb6b49f => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:20.131210 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed532c56-b760-42d6-833d-5fad76258791 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:20.173288 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206367b-e9f6-4ab5-8e53-bd5898b74006 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:20.182825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:20.189033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:20.212724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88e609-e6c8-42d4-bb6c-7e6aa40e3747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:20.213816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88e609-e6c8-42d4-bb6c-7e6aa40e3747 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.214224 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88e609-e6c8-42d4-bb6c-7e6aa40e3747 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.214607 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88e609-e6c8-42d4-bb6c-7e6aa40e3747 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.215898 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88e609-e6c8-42d4-bb6c-7e6aa40e3747 None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:20.217501 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88e609-e6c8-42d4-bb6c-7e6aa40e3747 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:20.219391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 107/228] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:20 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:20.225113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88e609-e6c8-42d4-bb6c-7e6aa40e3747 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:20.269107 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed532c56-b760-42d6-833d-5fad76258791 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:20.313922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f752114-e207-480a-b246-b1c3c3404745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:20.315113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f752114-e207-480a-b246-b1c3c3404745 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.315397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f752114-e207-480a-b246-b1c3c3404745 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.315674 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f752114-e207-480a-b246-b1c3c3404745 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.337581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f752114-e207-480a-b246-b1c3c3404745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:20.345369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-3f752114-e207-480a-b246-b1c3c3404745 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:20.345369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:20.345369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:20.345369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:20.345369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:20.345369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:20.345369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:20.345369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:20.345369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:20.345369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:20.345369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:20.345369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:20.345369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:20.345369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:20.345369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:20.345369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:20.346319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:20.346319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:20.346319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:20.346319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:20.346319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:20.346319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:20.346319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:20.346319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:20.346319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:20.346319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:20.346319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:20.346319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:20.346319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:20.346319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:20.346319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:20.346319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:20.347117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:20.347117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:20.347117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:20.347117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:20.347117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:20.347117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:20.347117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:20.347117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:20.347117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:20.347117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:20.347117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:20.347117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:20.347117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 122/229] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:20.354868 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f752114-e207-480a-b246-b1c3c3404745 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:20.435077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88e609-e6c8-42d4-bb6c-7e6aa40e3747 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:20.444574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:20.497185 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e817b-90b8-4269-87d9-08065af6f380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:20.499070 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e817b-90b8-4269-87d9-08065af6f380 None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.499509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e817b-90b8-4269-87d9-08065af6f380 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.499866 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e817b-90b8-4269-87d9-08065af6f380 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da/users/8fd04ca9fd584971a66c11d7e529411b/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.502125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e817b-90b8-4269-87d9-08065af6f380 None admin] RBAC: Authorizing `identity:create_grant(project_id=95ca3cd0264d43a2af05d5013692c2da, user_id=8fd04ca9fd584971a66c11d7e529411b, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:20.503946 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e817b-90b8-4269-87d9-08065af6f380 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:20.519377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:20.529741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f752114-e207-480a-b246-b1c3c3404745 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:20.563843 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce2c53-8950-4b19-b7a1-2ecb2ff58c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:20.564521 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce2c53-8950-4b19-b7a1-2ecb2ff58c6d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.564808 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce2c53-8950-4b19-b7a1-2ecb2ff58c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.565086 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce2c53-8950-4b19-b7a1-2ecb2ff58c6d None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.565914 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce2c53-8950-4b19-b7a1-2ecb2ff58c6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:20.566225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce2c53-8950-4b19-b7a1-2ecb2ff58c6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:20.567716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce2c53-8950-4b19-b7a1-2ecb2ff58c6d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:20.580752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 123/230] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:20.585405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce2c53-8950-4b19-b7a1-2ecb2ff58c6d None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:20.593233 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 108/231] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:20 2022] PUT /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da/users/8fd04ca9fd584971a66c11d7e529411b/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:20.712477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce2c53-8950-4b19-b7a1-2ecb2ff58c6d None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:20.761642 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3fd9f-f1cb-4577-a813-20207bdb7ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:20.762891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3fd9f-f1cb-4577-a813-20207bdb7ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:20.763400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3fd9f-f1cb-4577-a813-20207bdb7ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:20.763863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3fd9f-f1cb-4577-a813-20207bdb7ac9 None admin] PATH_INFO: `/v3/users/8fd04ca9fd584971a66c11d7e529411b` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:20.766045 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3fd9f-f1cb-4577-a813-20207bdb7ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=8fd04ca9fd584971a66c11d7e529411b)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:20.767764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3fd9f-f1cb-4577-a813-20207bdb7ac9 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:20.769730 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 124/232] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:20 2022] GET /identity/v3/users/8fd04ca9fd584971a66c11d7e529411b => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:20.776505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e817b-90b8-4269-87d9-08065af6f380 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:20.968654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e817b-90b8-4269-87d9-08065af6f380 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:21.028126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ffd9e-19f9-452c-8ca5-b5aea86cef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:21.029010 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ffd9e-19f9-452c-8ca5-b5aea86cef63 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.029331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ffd9e-19f9-452c-8ca5-b5aea86cef63 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.029616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ffd9e-19f9-452c-8ca5-b5aea86cef63 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.033932 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ffd9e-19f9-452c-8ca5-b5aea86cef63 None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:21.035531 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ffd9e-19f9-452c-8ca5-b5aea86cef63 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:21.037295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 109/233] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:20 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:21.043767 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3fd9f-f1cb-4577-a813-20207bdb7ac9 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:21.092003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:21.180357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3fd9f-f1cb-4577-a813-20207bdb7ac9 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:21.224801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa27cc-3856-4545-8993-548df7ac055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:21.225651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa27cc-3856-4545-8993-548df7ac055b None admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:21.225938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa27cc-3856-4545-8993-548df7ac055b None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:21.226216 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa27cc-3856-4545-8993-548df7ac055b None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da/users/8fd04ca9fd584971a66c11d7e529411b/roles/602eca0d730345ff8999a6bbd7124092` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:21.228521 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa27cc-3856-4545-8993-548df7ac055b None admin] RBAC: Authorizing `identity:create_grant(project_id=95ca3cd0264d43a2af05d5013692c2da, user_id=8fd04ca9fd584971a66c11d7e529411b, role_id=602eca0d730345ff8999a6bbd7124092)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:21.230002 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa27cc-3856-4545-8993-548df7ac055b None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:21.345331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 125/234] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:21 2022] PUT /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da/users/8fd04ca9fd584971a66c11d7e529411b/roles/602eca0d730345ff8999a6bbd7124092 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:22.128869 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7c14e-6e1a-42bf-8ca0-240827b99c1d None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.129935 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7c14e-6e1a-42bf-8ca0-240827b99c1d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.130428 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7c14e-6e1a-42bf-8ca0-240827b99c1d None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.132116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 110/235] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:22.138289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7e704-a491-4d20-afc9-792df6e3ad9a None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.138825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7e704-a491-4d20-afc9-792df6e3ad9a None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.138825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7e704-a491-4d20-afc9-792df6e3ad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.160107 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-2aa7e704-a491-4d20-afc9-792df6e3ad9a None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:22.161333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2aa7e704-a491-4d20-afc9-792df6e3ad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:22.187716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132dee3-720c-4a16-bdb4-5f9d0136dd26 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.188036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132dee3-720c-4a16-bdb4-5f9d0136dd26 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.188288 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132dee3-720c-4a16-bdb4-5f9d0136dd26 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.190004 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 111/236] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:22.194808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18dc04-c0e5-4c9e-915b-e45cab72bcd4 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.195101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18dc04-c0e5-4c9e-915b-e45cab72bcd4 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.195384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18dc04-c0e5-4c9e-915b-e45cab72bcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.215235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-7d18dc04-c0e5-4c9e-915b-e45cab72bcd4 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:22.216447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-7d18dc04-c0e5-4c9e-915b-e45cab72bcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:22.254142 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 126/237] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:22.271875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:22.290025 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7e704-a491-4d20-afc9-792df6e3ad9a None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.307407 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:22.319511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 112/238] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:22.375508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18dc04-c0e5-4c9e-915b-e45cab72bcd4 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.401237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7e704-a491-4d20-afc9-792df6e3ad9a None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.437711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2bb27-c421-4075-844f-6c26b8ec9f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.438836 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2bb27-c421-4075-844f-6c26b8ec9f99 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.439297 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2bb27-c421-4075-844f-6c26b8ec9f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.439717 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2bb27-c421-4075-844f-6c26b8ec9f99 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.450996 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2bb27-c421-4075-844f-6c26b8ec9f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:22.459737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-e8c2bb27-c421-4075-844f-6c26b8ec9f99 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:22.459737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:22.459737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:22.459737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:22.459737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:22.459737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:22.459737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:22.459737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:22.459737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:22.459737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:22.459737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:22.459737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:22.459737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:22.459737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:22.459737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:22.459737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:22.460803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:22.460803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:22.460803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:22.460803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:22.460803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:22.460803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:22.460803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:22.460803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:22.460803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:22.460803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:22.460803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:22.460803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:22.460803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:22.460803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:22.460803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:22.460803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:22.461827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:22.461827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:22.461827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:22.461827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:22.461827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:22.461827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:22.461827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:22.461827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:22.461827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:22.461827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:22.461827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:22.461827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:22.464819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 127/239] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:22.470098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2bb27-c421-4075-844f-6c26b8ec9f99 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.591669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:22.616491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2bb27-c421-4075-844f-6c26b8ec9f99 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.637665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18dc04-c0e5-4c9e-915b-e45cab72bcd4 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.655187 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeaef3b-71bc-4cce-836d-643a6854a2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.656082 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaef3b-71bc-4cce-836d-643a6854a2ca None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.656509 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaef3b-71bc-4cce-836d-643a6854a2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.656949 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaef3b-71bc-4cce-836d-643a6854a2ca None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.657872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeaef3b-71bc-4cce-836d-643a6854a2ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:22.658340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeaef3b-71bc-4cce-836d-643a6854a2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.660244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeaef3b-71bc-4cce-836d-643a6854a2ca None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.669587 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 128/240] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:22.675214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeaef3b-71bc-4cce-836d-643a6854a2ca None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.721486 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f3d18-79b6-4297-82b2-aa0e1c894cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.722613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f3d18-79b6-4297-82b2-aa0e1c894cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.723044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f3d18-79b6-4297-82b2-aa0e1c894cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.723466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f3d18-79b6-4297-82b2-aa0e1c894cd0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.726398 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f3d18-79b6-4297-82b2-aa0e1c894cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.728125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f3d18-79b6-4297-82b2-aa0e1c894cd0 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.730464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 113/241] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:22.736434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f3d18-79b6-4297-82b2-aa0e1c894cd0 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:22.782923 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:22.848053 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeaef3b-71bc-4cce-836d-643a6854a2ca None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.872711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f3d18-79b6-4297-82b2-aa0e1c894cd0 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:22.890377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b3a1f-7b54-4133-a3f4-a60d527415ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.891699 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b3a1f-7b54-4133-a3f4-a60d527415ab None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.892552 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b3a1f-7b54-4133-a3f4-a60d527415ab None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.893306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b3a1f-7b54-4133-a3f4-a60d527415ab None admin] PATH_INFO: `/v3/users/4ead05500c724690a5606ec2d3de416d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.895762 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:22.911974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b3a1f-7b54-4133-a3f4-a60d527415ab None admin] RBAC: Authorizing `identity:get_user(user_id=4ead05500c724690a5606ec2d3de416d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.914389 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b3a1f-7b54-4133-a3f4-a60d527415ab None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.917442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 129/242] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:22 2022] GET /identity/v3/users/4ead05500c724690a5606ec2d3de416d => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:22.919176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153960e-c827-42ee-b448-1f107dd7b3b2 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.919699 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153960e-c827-42ee-b448-1f107dd7b3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.920189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153960e-c827-42ee-b448-1f107dd7b3b2 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.920628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971653b-513a-4af1-a5b8-7773b025be2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:22.921446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971653b-513a-4af1-a5b8-7773b025be2a None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.921833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971653b-513a-4af1-a5b8-7773b025be2a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.922136 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 130/243] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:22.926177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971653b-513a-4af1-a5b8-7773b025be2a None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.926177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971653b-513a-4af1-a5b8-7773b025be2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:22.926177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971653b-513a-4af1-a5b8-7773b025be2a None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:22.927836 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1591-c22f-4a0b-8f39-b6cc07dc8d05 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:22.928317 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1591-c22f-4a0b-8f39-b6cc07dc8d05 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:22.928782 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1591-c22f-4a0b-8f39-b6cc07dc8d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:22.950179 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-a91f1591-c22f-4a0b-8f39-b6cc07dc8d05 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:22.951513 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a91f1591-c22f-4a0b-8f39-b6cc07dc8d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:23.020738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 114/244] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:22 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:23.022256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971653b-513a-4af1-a5b8-7773b025be2a None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.047351 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 131/245] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:23.081481 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f1591-c22f-4a0b-8f39-b6cc07dc8d05 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.183622 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:23.202321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971653b-513a-4af1-a5b8-7773b025be2a None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.226191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f1591-c22f-4a0b-8f39-b6cc07dc8d05 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.258443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:23.261562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0861aa2-3e0c-4f63-bc0e-a6ea71805ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.261562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0861aa2-3e0c-4f63-bc0e-a6ea71805ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.261812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0861aa2-3e0c-4f63-bc0e-a6ea71805ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.262066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0861aa2-3e0c-4f63-bc0e-a6ea71805ed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.276683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570de72b-95e1-4033-81d2-d46fe3963dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.277860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570de72b-95e1-4033-81d2-d46fe3963dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.278158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570de72b-95e1-4033-81d2-d46fe3963dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.278416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570de72b-95e1-4033-81d2-d46fe3963dd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.291114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570de72b-95e1-4033-81d2-d46fe3963dd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:23.302119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-570de72b-95e1-4033-81d2-d46fe3963dd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:23.302119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:23.302119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:23.302119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:23.302119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:23.302119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:23.302119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:23.302119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:23.302119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:23.302119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:23.302119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:23.302119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:23.302119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:23.302119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:23.302119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:23.302119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:23.302980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:23.302980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:23.302980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:23.302980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:23.302980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:23.302980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:23.302980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:23.302980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:23.302980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:23.302980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:23.302980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:23.302980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:23.302980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:23.302980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:23.302980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:23.302980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:23.303818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:23.303818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:23.303818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:23.303818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:23.303818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:23.303818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:23.303818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:23.303818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:23.303818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:23.303818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:23.303818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:23.303818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:23.306822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 132/246] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:23.308298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963467f-a3b9-4b23-b5bc-d06dbdb0199d None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.308854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963467f-a3b9-4b23-b5bc-d06dbdb0199d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.309165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963467f-a3b9-4b23-b5bc-d06dbdb0199d None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.310600 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 133/247] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:23.315535 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963467f-a3b9-4b23-b5bc-d06dbdb0199d None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.354812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0861aa2-3e0c-4f63-bc0e-a6ea71805ed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:23.356948 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0861aa2-3e0c-4f63-bc0e-a6ea71805ed0 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:23.444333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963467f-a3b9-4b23-b5bc-d06dbdb0199d None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.473839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:23.484395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32619dc7-43e6-46ad-8b98-5ce26b91b7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.485197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32619dc7-43e6-46ad-8b98-5ce26b91b7cf None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.485560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32619dc7-43e6-46ad-8b98-5ce26b91b7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.485823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32619dc7-43e6-46ad-8b98-5ce26b91b7cf None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.492650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32619dc7-43e6-46ad-8b98-5ce26b91b7cf None admin] RBAC: Adding query filter params (name=member) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:23.492650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32619dc7-43e6-46ad-8b98-5ce26b91b7cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:23.492650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32619dc7-43e6-46ad-8b98-5ce26b91b7cf None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:23.492928 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 115/248] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:23.492928 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2036e-0962-4270-9e31-66660788f37c None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.492928 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2036e-0962-4270-9e31-66660788f37c None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.492928 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2036e-0962-4270-9e31-66660788f37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.500762 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 134/249] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:23.501873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32619dc7-43e6-46ad-8b98-5ce26b91b7cf None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.511937 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-84e2036e-0962-4270-9e31-66660788f37c None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:23.513187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-84e2036e-0962-4270-9e31-66660788f37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:23.566229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:23.604662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 116/250] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:23.605868 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2036e-0962-4270-9e31-66660788f37c None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.650408 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32619dc7-43e6-46ad-8b98-5ce26b91b7cf None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.701990 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64d43e-ed4c-4382-ba7e-fd824d113337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.702797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64d43e-ed4c-4382-ba7e-fd824d113337 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.703080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64d43e-ed4c-4382-ba7e-fd824d113337 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.703353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64d43e-ed4c-4382-ba7e-fd824d113337 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.704589 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64d43e-ed4c-4382-ba7e-fd824d113337 None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:23.706086 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64d43e-ed4c-4382-ba7e-fd824d113337 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:23.710267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 135/251] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:23.711288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64d43e-ed4c-4382-ba7e-fd824d113337 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.750792 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2036e-0962-4270-9e31-66660788f37c None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.769049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:23.795271 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dbd49-f48b-4618-8b3e-b73c34f82d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.796183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dbd49-f48b-4618-8b3e-b73c34f82d13 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.796467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dbd49-f48b-4618-8b3e-b73c34f82d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.796749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dbd49-f48b-4618-8b3e-b73c34f82d13 None admin] PATH_INFO: `/v3/users/d9af40abf6c34d8197ab1b7b590f110f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.799916 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905dbd49-f48b-4618-8b3e-b73c34f82d13 None admin] RBAC: Authorizing `identity:get_user(user_id=d9af40abf6c34d8197ab1b7b590f110f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:23.801436 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905dbd49-f48b-4618-8b3e-b73c34f82d13 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:23.803119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 117/252] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/users/d9af40abf6c34d8197ab1b7b590f110f => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:23.803892 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dbd49-f48b-4618-8b3e-b73c34f82d13 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.903697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64d43e-ed4c-4382-ba7e-fd824d113337 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.933496 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dbd49-f48b-4618-8b3e-b73c34f82d13 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:23.937193 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:23.969614 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7024fe-7c7d-4105-8011-dd9eeeb8cb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.970522 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7024fe-7c7d-4105-8011-dd9eeeb8cb4d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.970950 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7024fe-7c7d-4105-8011-dd9eeeb8cb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.971234 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7024fe-7c7d-4105-8011-dd9eeeb8cb4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.972247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7024fe-7c7d-4105-8011-dd9eeeb8cb4d None admin] RBAC: Adding query filter params (role.id=51d54eaf35fd45ccb7048e3f446f1eac, scope.project.id=95ca3cd0264d43a2af05d5013692c2da, user.id=4ead05500c724690a5606ec2d3de416d) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:23.972552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7024fe-7c7d-4105-8011-dd9eeeb8cb4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:23.974041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7024fe-7c7d-4105-8011-dd9eeeb8cb4d None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:23.981110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 118/253] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/role_assignments?user.id=4ead05500c724690a5606ec2d3de416d&scope.project.id=95ca3cd0264d43a2af05d5013692c2da&role.id=51d54eaf35fd45ccb7048e3f446f1eac => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:23.981807 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7024fe-7c7d-4105-8011-dd9eeeb8cb4d None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:23.982074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dea82-6888-45d8-ad1e-45ead08c0d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:23.983438 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dea82-6888-45d8-ad1e-45ead08c0d7e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:23.983865 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dea82-6888-45d8-ad1e-45ead08c0d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:23.984401 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dea82-6888-45d8-ad1e-45ead08c0d7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:23.996881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2dea82-6888-45d8-ad1e-45ead08c0d7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:24.005354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-dc2dea82-6888-45d8-ad1e-45ead08c0d7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:24.005354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:24.005354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:24.005354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:24.005354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:24.005354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:24.005354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:24.005354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:24.005354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:24.005354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:24.005354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:24.005354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:24.005354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:24.005354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:24.005354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:24.005354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:24.006464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:24.006464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:24.006464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:24.006464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:24.006464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:24.006464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:24.006464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:24.006464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:24.006464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:24.006464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:24.006464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:24.006464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:24.006464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:24.006464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:24.006464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:24.006464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:24.007432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:24.007432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:24.007432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:24.007432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:24.007432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:24.007432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:24.007432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:24.007432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:24.007432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:24.007432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:24.007432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:24.007432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:24.009758 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 136/254] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:24.028814 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dea82-6888-45d8-ad1e-45ead08c0d7e None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:24.069418 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:24.124606 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7024fe-7c7d-4105-8011-dd9eeeb8cb4d None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:24.162286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b169258-4eac-4238-a232-d7a1aacafc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:24.163181 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b169258-4eac-4238-a232-d7a1aacafc16 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.163467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b169258-4eac-4238-a232-d7a1aacafc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.163742 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b169258-4eac-4238-a232-d7a1aacafc16 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.165000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b169258-4eac-4238-a232-d7a1aacafc16 None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:24.166572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b169258-4eac-4238-a232-d7a1aacafc16 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:24.168346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 119/255] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:23 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:24.174326 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b169258-4eac-4238-a232-d7a1aacafc16 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:24.264097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dea82-6888-45d8-ad1e-45ead08c0d7e None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:24.294977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b169258-4eac-4238-a232-d7a1aacafc16 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:24.337304 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c12cd-c7d6-49e6-beeb-86fba9b6dd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:24.338058 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c12cd-c7d6-49e6-beeb-86fba9b6dd4a None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.338405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c12cd-c7d6-49e6-beeb-86fba9b6dd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.338693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c12cd-c7d6-49e6-beeb-86fba9b6dd4a None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.339464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c12cd-c7d6-49e6-beeb-86fba9b6dd4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:24.339774 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c12cd-c7d6-49e6-beeb-86fba9b6dd4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:24.341949 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c12cd-c7d6-49e6-beeb-86fba9b6dd4a None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:24.349593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:24.367988 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 137/256] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:24.374599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117587-324e-46d3-b068-e7d012a33d99 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.374758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026874c0-650e-4b9a-9f9e-f4ca913fc506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:24.374959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117587-324e-46d3-b068-e7d012a33d99 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.375182 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117587-324e-46d3-b068-e7d012a33d99 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.375622 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026874c0-650e-4b9a-9f9e-f4ca913fc506 None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.375909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026874c0-650e-4b9a-9f9e-f4ca913fc506 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.376186 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026874c0-650e-4b9a-9f9e-f4ca913fc506 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da/users/d9af40abf6c34d8197ab1b7b590f110f/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.376805 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 138/257] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:24.377554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117587-324e-46d3-b068-e7d012a33d99 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:24.378411 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026874c0-650e-4b9a-9f9e-f4ca913fc506 None admin] RBAC: Authorizing `identity:create_grant(project_id=95ca3cd0264d43a2af05d5013692c2da, user_id=d9af40abf6c34d8197ab1b7b590f110f, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:24.379935 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026874c0-650e-4b9a-9f9e-f4ca913fc506 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:24.427177 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:24.441049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 120/258] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:24 2022] PUT /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da/users/d9af40abf6c34d8197ab1b7b590f110f/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:43:24.442424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205f54-4ba7-46b5-82ff-6edf0ac669fa None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.442769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205f54-4ba7-46b5-82ff-6edf0ac669fa None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.443038 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205f54-4ba7-46b5-82ff-6edf0ac669fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.481016 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-82205f54-4ba7-46b5-82ff-6edf0ac669fa None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:24.482254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-82205f54-4ba7-46b5-82ff-6edf0ac669fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:24.627088 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117587-324e-46d3-b068-e7d012a33d99 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:24.654928 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 121/259] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:24.699149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf31ef-233b-4be7-95f9-f77087f58147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:24.699872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf31ef-233b-4be7-95f9-f77087f58147 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.700162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf31ef-233b-4be7-95f9-f77087f58147 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.700261 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205f54-4ba7-46b5-82ff-6edf0ac669fa None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:24.700447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf31ef-233b-4be7-95f9-f77087f58147 None admin] PATH_INFO: `/v3/users/8fd04ca9fd584971a66c11d7e529411b` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.701727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf31ef-233b-4be7-95f9-f77087f58147 None admin] RBAC: Authorizing `identity:get_user(user_id=8fd04ca9fd584971a66c11d7e529411b)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:24.703343 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf31ef-233b-4be7-95f9-f77087f58147 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:24.707071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 139/260] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:24 2022] GET /identity/v3/users/8fd04ca9fd584971a66c11d7e529411b => generated 283 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:24.711800 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf31ef-233b-4be7-95f9-f77087f58147 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:24.879342 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205f54-4ba7-46b5-82ff-6edf0ac669fa None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:24.896280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:24.931986 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf31ef-233b-4be7-95f9-f77087f58147 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:24.963971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46831037-919a-4ee3-a8d5-82903c3bd6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:24.963971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46831037-919a-4ee3-a8d5-82903c3bd6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.963971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46831037-919a-4ee3-a8d5-82903c3bd6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.963971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46831037-919a-4ee3-a8d5-82903c3bd6a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:24.976554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:24.986281 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46831037-919a-4ee3-a8d5-82903c3bd6a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:24.989984 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7768f-83e1-4271-82c6-48d19eab027c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:24.990654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7768f-83e1-4271-82c6-48d19eab027c None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:24.990942 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7768f-83e1-4271-82c6-48d19eab027c None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:24.991951 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7768f-83e1-4271-82c6-48d19eab027c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.002780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-46831037-919a-4ee3-a8d5-82903c3bd6a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:25.002780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:25.002780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:25.002780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:25.002780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:25.002780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:25.002780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:25.002780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:25.002780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:25.002780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:25.002780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:25.002780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:25.002780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:25.002780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:25.002780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:25.002780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:25.003810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:25.003810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:25.003810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:25.003810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:25.003810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:25.003810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:25.003810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:25.003810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:25.003810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:25.003810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:25.003810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:25.003810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:25.003810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:25.003810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:25.003810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:25.003810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:25.004596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:25.004596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:25.004596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:25.004596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:25.004596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:25.004596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:25.004596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:25.004596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:25.004596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:25.004596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:25.004596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:25.004596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:25.004596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 122/261] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:25.022118 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46831037-919a-4ee3-a8d5-82903c3bd6a2 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:25.122211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7768f-83e1-4271-82c6-48d19eab027c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:25.123708 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7768f-83e1-4271-82c6-48d19eab027c None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:25.209712 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46831037-919a-4ee3-a8d5-82903c3bd6a2 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:25.268594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e93c4-8f10-48bb-aeb8-1c602b4fa436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:25.269804 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e93c4-8f10-48bb-aeb8-1c602b4fa436 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.271421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e93c4-8f10-48bb-aeb8-1c602b4fa436 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.272460 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e93c4-8f10-48bb-aeb8-1c602b4fa436 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.273625 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e93c4-8f10-48bb-aeb8-1c602b4fa436 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:25.275043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e93c4-8f10-48bb-aeb8-1c602b4fa436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:25.276773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e93c4-8f10-48bb-aeb8-1c602b4fa436 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:25.294276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 140/262] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 14:43:25.295117 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 123/263] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:25.297494 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7768f-83e1-4271-82c6-48d19eab027c None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:25.299755 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.302459 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e93c4-8f10-48bb-aeb8-1c602b4fa436 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:25.340704 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.422518 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e93c4-8f10-48bb-aeb8-1c602b4fa436 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:25.459579 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4606ee7-03a3-4c4b-8f05-d5ecf439f1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:25.460949 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4606ee7-03a3-4c4b-8f05-d5ecf439f1eb None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.461494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4606ee7-03a3-4c4b-8f05-d5ecf439f1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.462004 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4606ee7-03a3-4c4b-8f05-d5ecf439f1eb None admin] PATH_INFO: `/v3/users/8fd04ca9fd584971a66c11d7e529411b` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.468980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7768f-83e1-4271-82c6-48d19eab027c None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:25.470380 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4606ee7-03a3-4c4b-8f05-d5ecf439f1eb None admin] RBAC: Authorizing `identity:get_user(user_id=8fd04ca9fd584971a66c11d7e529411b)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:25.472033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4606ee7-03a3-4c4b-8f05-d5ecf439f1eb None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:25.473902 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 124/264] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:25 2022] GET /identity/v3/users/8fd04ca9fd584971a66c11d7e529411b => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:25.486607 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4606ee7-03a3-4c4b-8f05-d5ecf439f1eb None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:25.508923 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d13926-d305-4315-aeaa-4d613c11bc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:25.510431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d13926-d305-4315-aeaa-4d613c11bc30 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.510720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d13926-d305-4315-aeaa-4d613c11bc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.511079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d13926-d305-4315-aeaa-4d613c11bc30 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.517155 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d13926-d305-4315-aeaa-4d613c11bc30 None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:25.517155 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d13926-d305-4315-aeaa-4d613c11bc30 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:25.517155 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 141/265] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:25 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:25.521676 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d13926-d305-4315-aeaa-4d613c11bc30 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:25.617159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.629444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d13926-d305-4315-aeaa-4d613c11bc30 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:25.646673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.653007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4606ee7-03a3-4c4b-8f05-d5ecf439f1eb None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:25.687031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb0e45-3cdb-413e-80c4-6fb53d48fd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:25.687916 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0e45-3cdb-413e-80c4-6fb53d48fd65 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.688339 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0e45-3cdb-413e-80c4-6fb53d48fd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.688812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb0e45-3cdb-413e-80c4-6fb53d48fd65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.691318 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a730568-d7c9-4c63-bf2d-1aa99112bb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:25.692277 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a730568-d7c9-4c63-bf2d-1aa99112bb09 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.692574 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a730568-d7c9-4c63-bf2d-1aa99112bb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.692858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a730568-d7c9-4c63-bf2d-1aa99112bb09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.693960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a730568-d7c9-4c63-bf2d-1aa99112bb09 None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.project.id=95ca3cd0264d43a2af05d5013692c2da, user.id=8fd04ca9fd584971a66c11d7e529411b) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:25.694085 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a730568-d7c9-4c63-bf2d-1aa99112bb09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:25.701264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a730568-d7c9-4c63-bf2d-1aa99112bb09 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:25.708124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 142/266] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:25 2022] GET /identity/v3/role_assignments?user.id=8fd04ca9fd584971a66c11d7e529411b&scope.project.id=95ca3cd0264d43a2af05d5013692c2da&role.id=c865040abd6c4b099381557da21c471d => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:25.769207 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb0e45-3cdb-413e-80c4-6fb53d48fd65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:25.771591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb0e45-3cdb-413e-80c4-6fb53d48fd65 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:25.886274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:25.892065 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 125/267] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 14:43:25.897473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8896be-f761-4db3-b144-03a6d6b171ef None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.897776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8896be-f761-4db3-b144-03a6d6b171ef None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.898066 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8896be-f761-4db3-b144-03a6d6b171ef None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.906470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 143/268] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:25.907575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb0e45-3cdb-413e-80c4-6fb53d48fd65 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:25.917170 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f87b0c-9d39-4fcb-b4af-eed790f0f028 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:25.917556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f87b0c-9d39-4fcb-b4af-eed790f0f028 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:25.917912 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f87b0c-9d39-4fcb-b4af-eed790f0f028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:25.950332 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-38f87b0c-9d39-4fcb-b4af-eed790f0f028 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:25.951688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-38f87b0c-9d39-4fcb-b4af-eed790f0f028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:26.051240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 144/269] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:26.109162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f87b0c-9d39-4fcb-b4af-eed790f0f028 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:26.114907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb0e45-3cdb-413e-80c4-6fb53d48fd65 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:26.171304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b34df6-e75d-47a1-9b76-3dd940425fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:26.172196 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b34df6-e75d-47a1-9b76-3dd940425fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.172484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b34df6-e75d-47a1-9b76-3dd940425fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.172762 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b34df6-e75d-47a1-9b76-3dd940425fd9 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.178016 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b34df6-e75d-47a1-9b76-3dd940425fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:26.179515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b34df6-e75d-47a1-9b76-3dd940425fd9 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:26.182173 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 126/270] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:25 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:26.184927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:26.189497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b34df6-e75d-47a1-9b76-3dd940425fd9 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:26.236308 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f87b0c-9d39-4fcb-b4af-eed790f0f028 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:26.299366 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79595087-e40e-4db3-ae45-8d9b86322732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:26.300174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79595087-e40e-4db3-ae45-8d9b86322732 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.300459 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79595087-e40e-4db3-ae45-8d9b86322732 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.300737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79595087-e40e-4db3-ae45-8d9b86322732 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.304144 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:26.321569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79595087-e40e-4db3-ae45-8d9b86322732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:26.333096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-79595087-e40e-4db3-ae45-8d9b86322732 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:26.333096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:26.333096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:26.333096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:26.333096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:26.333096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:26.333096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:26.333096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:26.333096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:26.333096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:26.333096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:26.333096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:26.333096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:26.333096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:26.333096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:26.333096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:26.334006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:26.334006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:26.334006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:26.334006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:26.334006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:26.334006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:26.334006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:26.334006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:26.334006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:26.334006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:26.334006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:26.334006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:26.334006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:26.334006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:26.334006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:26.334006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:26.334777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:26.334777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:26.334777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:26.334777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:26.334777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:26.334777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:26.334777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:26.334777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:26.334777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:26.334777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:26.334777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:26.334777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:26.335360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 145/271] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:26.345584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79595087-e40e-4db3-ae45-8d9b86322732 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:26.381545 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b34df6-e75d-47a1-9b76-3dd940425fd9 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:26.455340 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19f046-f091-4d75-966c-46283cef3e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:26.456025 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19f046-f091-4d75-966c-46283cef3e55 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.456309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19f046-f091-4d75-966c-46283cef3e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.456584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19f046-f091-4d75-966c-46283cef3e55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.457801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19f046-f091-4d75-966c-46283cef3e55 None admin] RBAC: Adding query filter params (role.id=602eca0d730345ff8999a6bbd7124092, scope.project.id=95ca3cd0264d43a2af05d5013692c2da, user.id=8fd04ca9fd584971a66c11d7e529411b) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:26.459094 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19f046-f091-4d75-966c-46283cef3e55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:26.460857 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19f046-f091-4d75-966c-46283cef3e55 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:26.473214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 127/272] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:26 2022] GET /identity/v3/role_assignments?user.id=8fd04ca9fd584971a66c11d7e529411b&scope.project.id=95ca3cd0264d43a2af05d5013692c2da&role.id=602eca0d730345ff8999a6bbd7124092 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:26.526783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94824a03-1b00-411e-8f98-6243f9de53c7 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.527513 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94824a03-1b00-411e-8f98-6243f9de53c7 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.528012 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94824a03-1b00-411e-8f98-6243f9de53c7 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.529895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 128/273] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:26.535786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d85725-6392-44ab-87b4-e659a2521818 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.536890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d85725-6392-44ab-87b4-e659a2521818 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.537442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d85725-6392-44ab-87b4-e659a2521818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.552280 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79595087-e40e-4db3-ae45-8d9b86322732 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:26.559104 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-77d85725-6392-44ab-87b4-e659a2521818 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:26.560697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-77d85725-6392-44ab-87b4-e659a2521818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:26.598211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:26.619445 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef94af-dc02-4f46-8558-fe2a1f271397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:26.620174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef94af-dc02-4f46-8558-fe2a1f271397 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.620571 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef94af-dc02-4f46-8558-fe2a1f271397 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.620847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef94af-dc02-4f46-8558-fe2a1f271397 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.621691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef94af-dc02-4f46-8558-fe2a1f271397 None admin] RBAC: Adding query filter params (name=member) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:26.622019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef94af-dc02-4f46-8558-fe2a1f271397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:26.623603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef94af-dc02-4f46-8558-fe2a1f271397 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:26.643457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 146/274] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:26.647972 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 129/275] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:26.653296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef94af-dc02-4f46-8558-fe2a1f271397 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:26.678272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d85725-6392-44ab-87b4-e659a2521818 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:26.758078 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:26.780065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef94af-dc02-4f46-8558-fe2a1f271397 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:26.808543 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d85725-6392-44ab-87b4-e659a2521818 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:26.828810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9e2d1-9d36-4aa7-9b83-9b52e9dcd55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:26.830622 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9e2d1-9d36-4aa7-9b83-9b52e9dcd55f None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.831230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9e2d1-9d36-4aa7-9b83-9b52e9dcd55f None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.831678 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9e2d1-9d36-4aa7-9b83-9b52e9dcd55f None admin] PATH_INFO: `/v3/users/df970dcaa9a84427b15042480bec1e90` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.849308 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f24e-2b9e-42cf-9e4e-838dc5bb1cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:26.850336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f24e-2b9e-42cf-9e4e-838dc5bb1cfb None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:26.850697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f24e-2b9e-42cf-9e4e-838dc5bb1cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:26.851049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f24e-2b9e-42cf-9e4e-838dc5bb1cfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:26.851275 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9e2d1-9d36-4aa7-9b83-9b52e9dcd55f None admin] RBAC: Authorizing `identity:get_user(user_id=df970dcaa9a84427b15042480bec1e90)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:26.853159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9e2d1-9d36-4aa7-9b83-9b52e9dcd55f None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:26.853469 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7f24e-2b9e-42cf-9e4e-838dc5bb1cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:26.854998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7f24e-2b9e-42cf-9e4e-838dc5bb1cfb None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:26.855520 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 147/276] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:26 2022] GET /identity/v3/users/df970dcaa9a84427b15042480bec1e90 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:26.860361 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 130/277] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:26.861395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9e2d1-9d36-4aa7-9b83-9b52e9dcd55f None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:26.863071 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f24e-2b9e-42cf-9e4e-838dc5bb1cfb None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:26.922689 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:26.984402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f24e-2b9e-42cf-9e4e-838dc5bb1cfb None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:27.000424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9e2d1-9d36-4aa7-9b83-9b52e9dcd55f None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:27.019753 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:27.030092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c582f-a987-41eb-bd0f-0460d19bd49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:27.030587 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c582f-a987-41eb-bd0f-0460d19bd49f None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.036293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c582f-a987-41eb-bd0f-0460d19bd49f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.036293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c582f-a987-41eb-bd0f-0460d19bd49f None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.036293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c582f-a987-41eb-bd0f-0460d19bd49f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:27.036293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c582f-a987-41eb-bd0f-0460d19bd49f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:27.047847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22273d-0b89-4028-8bb0-7cf097cf0f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:27.048828 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22273d-0b89-4028-8bb0-7cf097cf0f88 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.049317 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22273d-0b89-4028-8bb0-7cf097cf0f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.049813 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22273d-0b89-4028-8bb0-7cf097cf0f88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.050869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22273d-0b89-4028-8bb0-7cf097cf0f88 None admin] RBAC: Adding query filter params (role.id=6832f9f0b207495a9a247504bcb6b49f, user.id=df970dcaa9a84427b15042480bec1e90, scope.system=all) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:27.051359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22273d-0b89-4028-8bb0-7cf097cf0f88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:27.053113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22273d-0b89-4028-8bb0-7cf097cf0f88 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:27.059234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 148/278] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Jun 16 14:43:26 2022] GET /identity/v3/role_assignments?user.id=df970dcaa9a84427b15042480bec1e90&scope.system=all&role.id=6832f9f0b207495a9a247504bcb6b49f => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:27.123416 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 131/279] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:26 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:43:27.269880 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d1826-b26d-4c57-a785-9bb18721f888 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.270202 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d1826-b26d-4c57-a785-9bb18721f888 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.270458 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d1826-b26d-4c57-a785-9bb18721f888 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.272014 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 149/280] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:27.280561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd22a4-2ff4-421e-ab2d-d2cd063f3d94 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.280561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd22a4-2ff4-421e-ab2d-d2cd063f3d94 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.280561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd22a4-2ff4-421e-ab2d-d2cd063f3d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.299334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-c4dd22a4-2ff4-421e-ab2d-d2cd063f3d94 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:27.300886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c4dd22a4-2ff4-421e-ab2d-d2cd063f3d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:27.376298 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 132/281] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:27.387402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69d0a3-83b5-4a70-b569-50fdced8fbbf None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.387842 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69d0a3-83b5-4a70-b569-50fdced8fbbf None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.387940 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69d0a3-83b5-4a70-b569-50fdced8fbbf None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.389662 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 150/282] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:27.394920 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc648fb-0ece-46bc-94b6-4279a402a59a None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.395509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc648fb-0ece-46bc-94b6-4279a402a59a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.396008 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc648fb-0ece-46bc-94b6-4279a402a59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.400256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69d0a3-83b5-4a70-b569-50fdced8fbbf None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:27.414348 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-5fc648fb-0ece-46bc-94b6-4279a402a59a None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:27.416341 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-5fc648fb-0ece-46bc-94b6-4279a402a59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:27.498166 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 133/283] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:27.524735 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc648fb-0ece-46bc-94b6-4279a402a59a None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:27.529279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69d0a3-83b5-4a70-b569-50fdced8fbbf None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:27.555128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:27.573825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642deb4-e6bb-4946-a19e-d29bada8afae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:27.574683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642deb4-e6bb-4946-a19e-d29bada8afae None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.574981 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642deb4-e6bb-4946-a19e-d29bada8afae None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.575268 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642deb4-e6bb-4946-a19e-d29bada8afae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.577556 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:27.587106 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642deb4-e6bb-4946-a19e-d29bada8afae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:27.595907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-b642deb4-e6bb-4946-a19e-d29bada8afae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:27.595907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:27.595907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:27.595907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:27.595907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:27.595907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:27.595907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:27.595907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:27.595907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:27.595907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:27.595907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:27.595907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:27.595907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:27.595907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:27.595907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:27.595907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:27.597653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:27.597653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:27.597653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:27.597653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:27.597653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:27.597653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:27.597653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:27.597653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:27.597653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:27.597653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:27.597653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:27.597653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:27.597653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:27.597653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:27.597653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:27.597653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:27.598426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:27.598426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:27.598426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:27.598426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:27.598426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:27.598426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:27.598426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:27.598426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:27.598426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:27.598426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:27.598426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:27.598426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:27.598426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 151/284] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:27.609387 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642deb4-e6bb-4946-a19e-d29bada8afae None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:27.637850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc648fb-0ece-46bc-94b6-4279a402a59a None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:27.688768 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8ac0d-e6c3-444f-8949-0c52c512c93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:27.689616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8ac0d-e6c3-444f-8949-0c52c512c93f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.689898 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8ac0d-e6c3-444f-8949-0c52c512c93f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.690179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8ac0d-e6c3-444f-8949-0c52c512c93f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.710557 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8ac0d-e6c3-444f-8949-0c52c512c93f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:27.725714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-a9b8ac0d-e6c3-444f-8949-0c52c512c93f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:27.725714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:27.725714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:27.725714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:27.725714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:27.725714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:27.725714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:27.725714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:27.725714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:27.725714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:27.725714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:27.725714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:27.725714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:27.725714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:27.725714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:27.725714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:27.726641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:27.726641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:27.726641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:27.726641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:27.726641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:27.726641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:27.726641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:27.726641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:27.726641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:27.726641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:27.726641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:27.726641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:27.726641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:27.726641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:27.726641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:27.726641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:27.727406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:27.727406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:27.727406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:27.727406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:27.727406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:27.727406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:27.727406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:27.727406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:27.727406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:27.727406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:27.727406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:27.727406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:27.727406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 134/285] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:27.734493 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8ac0d-e6c3-444f-8949-0c52c512c93f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:27.827258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642deb4-e6bb-4946-a19e-d29bada8afae None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:27.900222 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e268c-ae9b-4d1f-ade9-d2b660dc4957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:27.902554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e268c-ae9b-4d1f-ade9-d2b660dc4957 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.903208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e268c-ae9b-4d1f-ade9-d2b660dc4957 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.904703 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e268c-ae9b-4d1f-ade9-d2b660dc4957 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.905762 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e268c-ae9b-4d1f-ade9-d2b660dc4957 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:27.906414 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e268c-ae9b-4d1f-ade9-d2b660dc4957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:27.909500 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e268c-ae9b-4d1f-ade9-d2b660dc4957 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:27.913029 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8ac0d-e6c3-444f-8949-0c52c512c93f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:27.920269 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:27.931455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 152/286] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:27.939048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e268c-ae9b-4d1f-ade9-d2b660dc4957 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:27.979992 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e622f25-14a3-4197-b950-ece5926215cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:27.980686 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e622f25-14a3-4197-b950-ece5926215cc None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:27.980979 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e622f25-14a3-4197-b950-ece5926215cc None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:27.981296 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e622f25-14a3-4197-b950-ece5926215cc None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:27.982054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e622f25-14a3-4197-b950-ece5926215cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:27.982368 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e622f25-14a3-4197-b950-ece5926215cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:27.983761 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e622f25-14a3-4197-b950-ece5926215cc None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:27.997167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 135/287] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:28.002817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:28.003052 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e622f25-14a3-4197-b950-ece5926215cc None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.093387 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e268c-ae9b-4d1f-ade9-d2b660dc4957 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.131798 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aab82f-57a5-476f-a4cb-ff82cea91aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.132766 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aab82f-57a5-476f-a4cb-ff82cea91aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.133060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aab82f-57a5-476f-a4cb-ff82cea91aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.133367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aab82f-57a5-476f-a4cb-ff82cea91aa0 None admin] PATH_INFO: `/v3/users/4ead05500c724690a5606ec2d3de416d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.139195 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aab82f-57a5-476f-a4cb-ff82cea91aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=4ead05500c724690a5606ec2d3de416d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.139195 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aab82f-57a5-476f-a4cb-ff82cea91aa0 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.139195 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 153/288] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:27 2022] GET /identity/v3/users/4ead05500c724690a5606ec2d3de416d => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:28.147253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aab82f-57a5-476f-a4cb-ff82cea91aa0 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.184326 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e622f25-14a3-4197-b950-ece5926215cc None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.233865 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe13c4-768e-4e8c-a3c1-1bc616374515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.234776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe13c4-768e-4e8c-a3c1-1bc616374515 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.235061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe13c4-768e-4e8c-a3c1-1bc616374515 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.235344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe13c4-768e-4e8c-a3c1-1bc616374515 None admin] PATH_INFO: `/v3/users/d9af40abf6c34d8197ab1b7b590f110f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.236609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe13c4-768e-4e8c-a3c1-1bc616374515 None admin] RBAC: Authorizing `identity:get_user(user_id=d9af40abf6c34d8197ab1b7b590f110f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.238093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe13c4-768e-4e8c-a3c1-1bc616374515 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.239969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 136/289] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/users/d9af40abf6c34d8197ab1b7b590f110f => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:28.245572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe13c4-768e-4e8c-a3c1-1bc616374515 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.282610 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:28.287109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aab82f-57a5-476f-a4cb-ff82cea91aa0 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.313299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:28.329340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3d968-0252-4580-a757-d04b492bb088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.330231 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3d968-0252-4580-a757-d04b492bb088 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.330523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3d968-0252-4580-a757-d04b492bb088 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.330808 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3d968-0252-4580-a757-d04b492bb088 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.332111 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3d968-0252-4580-a757-d04b492bb088 None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.333666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3d968-0252-4580-a757-d04b492bb088 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.335613 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 154/290] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:28.341102 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3d968-0252-4580-a757-d04b492bb088 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.394139 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe13c4-768e-4e8c-a3c1-1bc616374515 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.433619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6015016-6a54-41f5-8d77-47cb49184657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.434280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6015016-6a54-41f5-8d77-47cb49184657 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.434621 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6015016-6a54-41f5-8d77-47cb49184657 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.434844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6015016-6a54-41f5-8d77-47cb49184657 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.508853 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6015016-6a54-41f5-8d77-47cb49184657 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.511171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6015016-6a54-41f5-8d77-47cb49184657 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.547926 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:28.579456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3d968-0252-4580-a757-d04b492bb088 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.638920 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a59007-fe6b-49f8-acfa-7234bfa529da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.639819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a59007-fe6b-49f8-acfa-7234bfa529da None admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.640106 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a59007-fe6b-49f8-acfa-7234bfa529da None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.640385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a59007-fe6b-49f8-acfa-7234bfa529da None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da/users/4ead05500c724690a5606ec2d3de416d/roles/51d54eaf35fd45ccb7048e3f446f1eac` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.644439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a59007-fe6b-49f8-acfa-7234bfa529da None admin] RBAC: Authorizing `identity:create_grant(project_id=95ca3cd0264d43a2af05d5013692c2da, user_id=4ead05500c724690a5606ec2d3de416d, role_id=51d54eaf35fd45ccb7048e3f446f1eac)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.645914 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a59007-fe6b-49f8-acfa-7234bfa529da None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.673938 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 137/291] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 14:43:28.682161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6015016-6a54-41f5-8d77-47cb49184657 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.728000 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 155/292] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:43:28 2022] PUT /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da/users/4ead05500c724690a5606ec2d3de416d/roles/51d54eaf35fd45ccb7048e3f446f1eac => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:28.829411 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6015016-6a54-41f5-8d77-47cb49184657 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:28.880403 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7525694-28e4-47ce-aefe-f5e532bac746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:28.881335 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7525694-28e4-47ce-aefe-f5e532bac746 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:28.881627 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7525694-28e4-47ce-aefe-f5e532bac746 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:28.881907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7525694-28e4-47ce-aefe-f5e532bac746 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:28.883167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7525694-28e4-47ce-aefe-f5e532bac746 None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:28.885270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7525694-28e4-47ce-aefe-f5e532bac746 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:28.887454 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 138/293] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:28.893449 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a59007-fe6b-49f8-acfa-7234bfa529da None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:28.924193 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:29.006784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a59007-fe6b-49f8-acfa-7234bfa529da None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:29.043025 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05405faf-13c3-40fb-a5a2-69503a7365e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:29.043701 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05405faf-13c3-40fb-a5a2-69503a7365e0 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.043993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05405faf-13c3-40fb-a5a2-69503a7365e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.044276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05405faf-13c3-40fb-a5a2-69503a7365e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.045115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05405faf-13c3-40fb-a5a2-69503a7365e0 None admin] RBAC: Adding query filter params (role.id=6832f9f0b207495a9a247504bcb6b49f, scope.project.id=95ca3cd0264d43a2af05d5013692c2da, user.id=d9af40abf6c34d8197ab1b7b590f110f) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:29.045457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05405faf-13c3-40fb-a5a2-69503a7365e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:29.046893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05405faf-13c3-40fb-a5a2-69503a7365e0 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:29.053573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 156/294] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:28 2022] GET /identity/v3/role_assignments?user.id=d9af40abf6c34d8197ab1b7b590f110f&scope.project.id=95ca3cd0264d43a2af05d5013692c2da&role.id=6832f9f0b207495a9a247504bcb6b49f => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:29.508252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5619a8-4301-4cbe-b7ad-b2e1f25dad1e None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.508762 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5619a8-4301-4cbe-b7ad-b2e1f25dad1e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.508835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5619a8-4301-4cbe-b7ad-b2e1f25dad1e None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.510756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 139/295] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:29.515985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742845fe-8a0f-4417-83e9-5607a32ba0fd None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.516290 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742845fe-8a0f-4417-83e9-5607a32ba0fd None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.516575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742845fe-8a0f-4417-83e9-5607a32ba0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.535821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-742845fe-8a0f-4417-83e9-5607a32ba0fd None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:29.537037 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-742845fe-8a0f-4417-83e9-5607a32ba0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:29.609744 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 157/296] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:29.632599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5619a8-4301-4cbe-b7ad-b2e1f25dad1e None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:29.639674 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:29.758406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a1d0-1a25-4ec0-8fc6-5d95c0ed11cf None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.758805 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a1d0-1a25-4ec0-8fc6-5d95c0ed11cf None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.759322 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a1d0-1a25-4ec0-8fc6-5d95c0ed11cf None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.762324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 158/297] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:29.767481 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa801703-4fd8-4c22-9694-020363806600 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.767773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa801703-4fd8-4c22-9694-020363806600 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.768059 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa801703-4fd8-4c22-9694-020363806600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.773370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5619a8-4301-4cbe-b7ad-b2e1f25dad1e None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:29.788847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-aa801703-4fd8-4c22-9694-020363806600 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:29.790389 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-aa801703-4fd8-4c22-9694-020363806600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:29.808173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:29.813955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8fec4-6f23-4cc0-8c17-21b94aa7677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:29.814978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8fec4-6f23-4cc0-8c17-21b94aa7677a None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.815441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8fec4-6f23-4cc0-8c17-21b94aa7677a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.815922 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8fec4-6f23-4cc0-8c17-21b94aa7677a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.830098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8fec4-6f23-4cc0-8c17-21b94aa7677a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:29.840642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-79f8fec4-6f23-4cc0-8c17-21b94aa7677a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:29.840642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:29.840642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:29.840642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:29.840642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:29.840642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:29.840642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:29.840642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:29.840642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:29.840642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:29.840642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:29.840642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:29.840642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:29.840642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:29.840642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:29.840642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:29.841591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:29.841591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:29.841591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:29.841591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:29.841591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:29.841591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:29.841591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:29.841591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:29.841591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:29.841591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:29.841591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:29.841591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:29.841591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:29.841591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:29.841591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:29.841591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:29.842387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:29.842387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:29.842387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:29.842387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:29.842387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:29.842387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:29.842387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:29.842387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:29.842387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:29.842387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:29.842387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:29.842387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:29.845424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 140/298] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:29.850508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8fec4-6f23-4cc0-8c17-21b94aa7677a None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:29.874856 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 159/299] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:29.897080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa801703-4fd8-4c22-9694-020363806600 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:29.913599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:29.955956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8fec4-6f23-4cc0-8c17-21b94aa7677a None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:29.991799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f663f95-e3a3-4216-913b-689528bc83df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:29.992473 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f663f95-e3a3-4216-913b-689528bc83df None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:29.992762 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f663f95-e3a3-4216-913b-689528bc83df None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:29.993048 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f663f95-e3a3-4216-913b-689528bc83df None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:29.993845 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f663f95-e3a3-4216-913b-689528bc83df None admin] RBAC: Adding query filter params (name=member) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:29.994735 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f663f95-e3a3-4216-913b-689528bc83df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:29.996150 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f663f95-e3a3-4216-913b-689528bc83df None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:30.004519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 141/300] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:30.006832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b9b4d-2ba1-4c60-8282-50007d14d667 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.007713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b9b4d-2ba1-4c60-8282-50007d14d667 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.008560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b9b4d-2ba1-4c60-8282-50007d14d667 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.010137 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 142/301] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:30.010542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa801703-4fd8-4c22-9694-020363806600 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:30.011327 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b9b4d-2ba1-4c60-8282-50007d14d667 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:30.048525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfac64-c517-4fc7-82eb-b2acf785f580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:30.049355 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfac64-c517-4fc7-82eb-b2acf785f580 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.049644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfac64-c517-4fc7-82eb-b2acf785f580 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.049939 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfac64-c517-4fc7-82eb-b2acf785f580 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.051189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfac64-c517-4fc7-82eb-b2acf785f580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:30.053466 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfac64-c517-4fc7-82eb-b2acf785f580 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:30.059784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 160/302] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:30.059784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d8974-ca8d-477a-bc1e-428429d2cdb0 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.059784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d8974-ca8d-477a-bc1e-428429d2cdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.059784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d8974-ca8d-477a-bc1e-428429d2cdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.077965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-158d8974-ca8d-477a-bc1e-428429d2cdb0 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:30.079818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-158d8974-ca8d-477a-bc1e-428429d2cdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:30.095559 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:30.121080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b9b4d-2ba1-4c60-8282-50007d14d667 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:30.147472 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:30.153917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 161/303] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:30.159604 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3fb64-2b2a-46d9-8edc-f21c77ca1d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:30.162918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3fb64-2b2a-46d9-8edc-f21c77ca1d49 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.162918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3fb64-2b2a-46d9-8edc-f21c77ca1d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.162918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3fb64-2b2a-46d9-8edc-f21c77ca1d49 None admin] PATH_INFO: `/v3/users/df970dcaa9a84427b15042480bec1e90` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.162918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3fb64-2b2a-46d9-8edc-f21c77ca1d49 None admin] RBAC: Authorizing `identity:get_user(user_id=df970dcaa9a84427b15042480bec1e90)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:30.163651 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3fb64-2b2a-46d9-8edc-f21c77ca1d49 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:30.165420 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 143/304] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:30 2022] GET /identity/v3/users/df970dcaa9a84427b15042480bec1e90 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:30.166513 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d8974-ca8d-477a-bc1e-428429d2cdb0 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:30.173181 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3fb64-2b2a-46d9-8edc-f21c77ca1d49 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:30.280234 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3fb64-2b2a-46d9-8edc-f21c77ca1d49 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:30.283005 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d8974-ca8d-477a-bc1e-428429d2cdb0 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:30.315718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5595d46-2a6b-430a-ad7e-b2abe8333d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:30.316581 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5595d46-2a6b-430a-ad7e-b2abe8333d03 None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.316874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5595d46-2a6b-430a-ad7e-b2abe8333d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.317180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5595d46-2a6b-430a-ad7e-b2abe8333d03 None admin] PATH_INFO: `/v3/system/users/df970dcaa9a84427b15042480bec1e90/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.318656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5595d46-2a6b-430a-ad7e-b2abe8333d03 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=df970dcaa9a84427b15042480bec1e90, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:30.318911 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23da5f-5997-4846-a56f-43a7579b480d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:30.319543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23da5f-5997-4846-a56f-43a7579b480d None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.319829 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23da5f-5997-4846-a56f-43a7579b480d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.320050 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5595d46-2a6b-430a-ad7e-b2abe8333d03 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:30.320143 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23da5f-5997-4846-a56f-43a7579b480d None admin] PATH_INFO: `/v3/groups` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.320778 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23da5f-5997-4846-a56f-43a7579b480d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:30.322918 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23da5f-5997-4846-a56f-43a7579b480d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:30.396474 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 144/305] 10.222.0.23 () {58 vars in 1334 bytes} [Thu Jun 16 14:43:30 2022] PUT /identity/v3/system/users/df970dcaa9a84427b15042480bec1e90/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:43:30.404992 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5595d46-2a6b-430a-ad7e-b2abe8333d03 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:30.430600 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 162/306] 10.222.0.23 () {60 vars in 1134 bytes} [Thu Jun 16 14:43:30 2022] POST /identity/v3/groups => generated 229 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:30.475979 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:30.528241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5595d46-2a6b-430a-ad7e-b2abe8333d03 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:30.575549 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4214e3-0584-421a-8e38-cc36a4f0a32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:30.575549 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4214e3-0584-421a-8e38-cc36a4f0a32f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.575549 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4214e3-0584-421a-8e38-cc36a4f0a32f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.575880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4214e3-0584-421a-8e38-cc36a4f0a32f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.587788 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4214e3-0584-421a-8e38-cc36a4f0a32f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:30.596599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-3f4214e3-0584-421a-8e38-cc36a4f0a32f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:30.596599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:30.596599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:30.596599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:30.596599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:30.596599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:30.596599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:30.596599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:30.596599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:30.596599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:30.596599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:30.596599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:30.596599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:30.596599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:30.596599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:30.596599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:30.597576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:30.597576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:30.597576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:30.597576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:30.597576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:30.597576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:30.597576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:30.597576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:30.597576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:30.597576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:30.597576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:30.597576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:30.597576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:30.597576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:30.597576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:30.597576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:30.598355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:30.598355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:30.598355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:30.598355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:30.598355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:30.598355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:30.598355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:30.598355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:30.598355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:30.598355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:30.598355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:30.598355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:30.598984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 145/307] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:30.604444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23da5f-5997-4846-a56f-43a7579b480d None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:30.616765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:30.710487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23da5f-5997-4846-a56f-43a7579b480d None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:30.745490 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b4dce-fa7f-4872-9156-52de78340772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:30.746166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b4dce-fa7f-4872-9156-52de78340772 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.746454 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b4dce-fa7f-4872-9156-52de78340772 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.746734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b4dce-fa7f-4872-9156-52de78340772 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.747486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b4dce-fa7f-4872-9156-52de78340772 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:30.747808 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b4dce-fa7f-4872-9156-52de78340772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:30.749211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b4dce-fa7f-4872-9156-52de78340772 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:30.757999 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 163/308] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:30.763538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4214e3-0584-421a-8e38-cc36a4f0a32f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:30.875977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4214e3-0584-421a-8e38-cc36a4f0a32f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:30.897403 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:30.915342 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec40e9d-52de-4924-b028-6fa5facf63b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:30.916734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec40e9d-52de-4924-b028-6fa5facf63b2 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:30.917028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec40e9d-52de-4924-b028-6fa5facf63b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:30.917346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec40e9d-52de-4924-b028-6fa5facf63b2 None admin] PATH_INFO: `/v3/users/02d8c7c41ec8469cad952b920fcc4286` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:30.931412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec40e9d-52de-4924-b028-6fa5facf63b2 None admin] RBAC: Authorizing `identity:get_user(user_id=02d8c7c41ec8469cad952b920fcc4286)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:30.932983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec40e9d-52de-4924-b028-6fa5facf63b2 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:30.934733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 146/309] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:30 2022] GET /identity/v3/users/02d8c7c41ec8469cad952b920fcc4286 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:30.940397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b4dce-fa7f-4872-9156-52de78340772 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.014198 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:31.045706 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b4dce-fa7f-4872-9156-52de78340772 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.080337 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8fcd8-7b25-45c8-bdac-80132e481ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.081001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8fcd8-7b25-45c8-bdac-80132e481ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.081315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8fcd8-7b25-45c8-bdac-80132e481ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.081598 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8fcd8-7b25-45c8-bdac-80132e481ab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.082434 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8fcd8-7b25-45c8-bdac-80132e481ab6 None admin] RBAC: Adding query filter params (role.id=51d54eaf35fd45ccb7048e3f446f1eac, user.id=02d8c7c41ec8469cad952b920fcc4286, scope.system=all) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:31.082751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8fcd8-7b25-45c8-bdac-80132e481ab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:31.084268 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8fcd8-7b25-45c8-bdac-80132e481ab6 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:31.090011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 164/310] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Jun 16 14:43:30 2022] GET /identity/v3/role_assignments?user.id=02d8c7c41ec8469cad952b920fcc4286&scope.system=all&role.id=51d54eaf35fd45ccb7048e3f446f1eac => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:31.203012 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3076420-4cb8-4a73-b47c-f234ae3cc9ca None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.203338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3076420-4cb8-4a73-b47c-f234ae3cc9ca None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.203583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3076420-4cb8-4a73-b47c-f234ae3cc9ca None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.205258 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 147/311] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:31.214559 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0ea3-d2b8-4b42-bdf4-9bafc4aadcc4 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.214852 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0ea3-d2b8-4b42-bdf4-9bafc4aadcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.215140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0ea3-d2b8-4b42-bdf4-9bafc4aadcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.233715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-d06c0ea3-d2b8-4b42-bdf4-9bafc4aadcc4 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:31.235307 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-d06c0ea3-d2b8-4b42-bdf4-9bafc4aadcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:31.315730 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 165/312] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:31.339166 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3076420-4cb8-4a73-b47c-f234ae3cc9ca None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.441543 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3076420-4cb8-4a73-b47c-f234ae3cc9ca None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.476168 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a34160-7f3f-42b6-ac20-04c0b171e756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.476898 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a34160-7f3f-42b6-ac20-04c0b171e756 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.477211 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a34160-7f3f-42b6-ac20-04c0b171e756 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.477497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a34160-7f3f-42b6-ac20-04c0b171e756 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.488253 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a34160-7f3f-42b6-ac20-04c0b171e756 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:31.496814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-36a34160-7f3f-42b6-ac20-04c0b171e756 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:31.496814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:31.496814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:31.496814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:31.496814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:31.496814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:31.496814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:31.496814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:31.496814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:31.496814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:31.496814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:31.496814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:31.496814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:31.496814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:31.496814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:31.496814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:31.497743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:31.497743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:31.497743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:31.497743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:31.497743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:31.497743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:31.497743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:31.497743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:31.497743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:31.497743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:31.497743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:31.497743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:31.497743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:31.497743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:31.497743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:31.497743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:31.498552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:31.498552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:31.498552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:31.498552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:31.498552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:31.498552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:31.498552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:31.498552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:31.498552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:31.498552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:31.498552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:31.498552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:31.498552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 148/313] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:31.507718 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c0ea3-d2b8-4b42-bdf4-9bafc4aadcc4 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.571431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:31.611604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c0ea3-d2b8-4b42-bdf4-9bafc4aadcc4 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.648565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4f159-9942-40ba-aaa2-14b92634ae7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.650497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4f159-9942-40ba-aaa2-14b92634ae7c None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.651030 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4f159-9942-40ba-aaa2-14b92634ae7c None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.651508 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4f159-9942-40ba-aaa2-14b92634ae7c None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.652511 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4f159-9942-40ba-aaa2-14b92634ae7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:31.653034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4f159-9942-40ba-aaa2-14b92634ae7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:31.654741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4f159-9942-40ba-aaa2-14b92634ae7c None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:31.664450 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 166/314] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:31.670815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a34160-7f3f-42b6-ac20-04c0b171e756 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.708485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:31.777881 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a34160-7f3f-42b6-ac20-04c0b171e756 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.812878 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48654172-80a5-41ad-8c26-da16b7b9c24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.814303 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48654172-80a5-41ad-8c26-da16b7b9c24e None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.814811 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48654172-80a5-41ad-8c26-da16b7b9c24e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.815289 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48654172-80a5-41ad-8c26-da16b7b9c24e None admin] PATH_INFO: `/v3/users/4ead05500c724690a5606ec2d3de416d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:31.816688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48654172-80a5-41ad-8c26-da16b7b9c24e None admin] RBAC: Authorizing `identity:get_user(user_id=4ead05500c724690a5606ec2d3de416d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:31.818431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48654172-80a5-41ad-8c26-da16b7b9c24e None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:31.820334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 149/315] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/users/4ead05500c724690a5606ec2d3de416d => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:31.827176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4f159-9942-40ba-aaa2-14b92634ae7c None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:31.936612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4f159-9942-40ba-aaa2-14b92634ae7c None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:31.965724 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:31.973190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e5dec-f0e7-4ca6-bbff-c8ee38f30f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:31.974163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e5dec-f0e7-4ca6-bbff-c8ee38f30f73 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:31.974650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e5dec-f0e7-4ca6-bbff-c8ee38f30f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:31.975123 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e5dec-f0e7-4ca6-bbff-c8ee38f30f73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.046668 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e5dec-f0e7-4ca6-bbff-c8ee38f30f73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:32.048276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e5dec-f0e7-4ca6-bbff-c8ee38f30f73 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:32.148970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 167/316] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:32.162449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48654172-80a5-41ad-8c26-da16b7b9c24e None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:32.292125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48654172-80a5-41ad-8c26-da16b7b9c24e None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:32.293749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:32.333538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a8374-89e0-46e6-935e-11bf09fe5a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:32.334338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a8374-89e0-46e6-935e-11bf09fe5a5a None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:32.334634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a8374-89e0-46e6-935e-11bf09fe5a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:32.334915 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a8374-89e0-46e6-935e-11bf09fe5a5a None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.336128 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a8374-89e0-46e6-935e-11bf09fe5a5a None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:32.338160 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a8374-89e0-46e6-935e-11bf09fe5a5a None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:32.346534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e5dec-f0e7-4ca6-bbff-c8ee38f30f73 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:32.357967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 150/317] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:32 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:32.381526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:32.523031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e5dec-f0e7-4ca6-bbff-c8ee38f30f73 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:32.607114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2683ce0-65c4-4063-a6f6-703d02135722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:32.607705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2683ce0-65c4-4063-a6f6-703d02135722 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:32.607991 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2683ce0-65c4-4063-a6f6-703d02135722 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:32.608272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2683ce0-65c4-4063-a6f6-703d02135722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.609103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2683ce0-65c4-4063-a6f6-703d02135722 None admin] RBAC: Adding query filter params (role.id=51d54eaf35fd45ccb7048e3f446f1eac, scope.project.id=95ca3cd0264d43a2af05d5013692c2da, user.id=4ead05500c724690a5606ec2d3de416d) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:32.609442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2683ce0-65c4-4063-a6f6-703d02135722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:32.610880 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2683ce0-65c4-4063-a6f6-703d02135722 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:32.619072 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 168/318] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:32 2022] GET /identity/v3/role_assignments?user.id=4ead05500c724690a5606ec2d3de416d&scope.project.id=95ca3cd0264d43a2af05d5013692c2da&role.id=51d54eaf35fd45ccb7048e3f446f1eac => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:32.710606 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f39554-9ca4-4d89-9e30-1c233fd41748 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:32.711584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f39554-9ca4-4d89-9e30-1c233fd41748 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:32.712071 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f39554-9ca4-4d89-9e30-1c233fd41748 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.714715 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 151/319] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:32.720851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb7083-1aaa-420a-a0fa-6d57fa0cb2b2 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:32.721843 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb7083-1aaa-420a-a0fa-6d57fa0cb2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:32.722328 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb7083-1aaa-420a-a0fa-6d57fa0cb2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.740555 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-2ceb7083-1aaa-420a-a0fa-6d57fa0cb2b2 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:32.741803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2ceb7083-1aaa-420a-a0fa-6d57fa0cb2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:32.754363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8cb99-b04b-4b51-b61f-224d89b2fc2a None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:32.754665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8cb99-b04b-4b51-b61f-224d89b2fc2a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:32.754932 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8cb99-b04b-4b51-b61f-224d89b2fc2a None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.756542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 152/320] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:32.762345 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd2bde-2fcd-44e9-9dc6-c4cfd21e6b52 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:32.762624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd2bde-2fcd-44e9-9dc6-c4cfd21e6b52 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:32.762902 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd2bde-2fcd-44e9-9dc6-c4cfd21e6b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:32.786226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-11cd2bde-2fcd-44e9-9dc6-c4cfd21e6b52 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:32.787458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-11cd2bde-2fcd-44e9-9dc6-c4cfd21e6b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:32.829071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 169/321] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:32.861015 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb7083-1aaa-420a-a0fa-6d57fa0cb2b2 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:32.882875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 153/322] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:32.888911 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:32.906075 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd2bde-2fcd-44e9-9dc6-c4cfd21e6b52 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:32.986090 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb7083-1aaa-420a-a0fa-6d57fa0cb2b2 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:33.013022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:33.017593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd2bde-2fcd-44e9-9dc6-c4cfd21e6b52 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:33.020873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ed3a9-d05b-4c40-b907-4e7e8af5da7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:33.021807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ed3a9-d05b-4c40-b907-4e7e8af5da7b None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.024442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ed3a9-d05b-4c40-b907-4e7e8af5da7b None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.024442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ed3a9-d05b-4c40-b907-4e7e8af5da7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.033623 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ed3a9-d05b-4c40-b907-4e7e8af5da7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:33.042240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-1f5ed3a9-d05b-4c40-b907-4e7e8af5da7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:33.042240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:33.042240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:33.042240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:33.042240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:33.042240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:33.042240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:33.042240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:33.042240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:33.042240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:33.042240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:33.042240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:33.042240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:33.042240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:33.042240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:33.042240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:33.043139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:33.043139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:33.043139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:33.043139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:33.043139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:33.043139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:33.043139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:33.043139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:33.043139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:33.043139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:33.043139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:33.043139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:33.043139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:33.043139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:33.043139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:33.043139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:33.043928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:33.043928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:33.043928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:33.043928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:33.043928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:33.043928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:33.043928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:33.043928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:33.043928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:33.043928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:33.043928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:33.043928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:33.043928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 170/323] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:33.049054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ed3a9-d05b-4c40-b907-4e7e8af5da7b None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:33.057930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f538aca-006a-48ad-a025-c77d4ec3d197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:33.058726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f538aca-006a-48ad-a025-c77d4ec3d197 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.059015 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f538aca-006a-48ad-a025-c77d4ec3d197 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.059297 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f538aca-006a-48ad-a025-c77d4ec3d197 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.060470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f538aca-006a-48ad-a025-c77d4ec3d197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:33.061949 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f538aca-006a-48ad-a025-c77d4ec3d197 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:33.063854 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 154/324] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:33.069245 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f538aca-006a-48ad-a025-c77d4ec3d197 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:33.131013 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:33.151593 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ed3a9-d05b-4c40-b907-4e7e8af5da7b None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:33.179869 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f538aca-006a-48ad-a025-c77d4ec3d197 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:33.187891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da001d-36e3-4634-8b1c-2ae8d3fd0bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:33.188665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da001d-36e3-4634-8b1c-2ae8d3fd0bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.188950 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da001d-36e3-4634-8b1c-2ae8d3fd0bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.189254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da001d-36e3-4634-8b1c-2ae8d3fd0bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.190114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da001d-36e3-4634-8b1c-2ae8d3fd0bc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:33.190303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da001d-36e3-4634-8b1c-2ae8d3fd0bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:33.191855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da001d-36e3-4634-8b1c-2ae8d3fd0bc5 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:33.203330 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 171/325] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:33.208395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da001d-36e3-4634-8b1c-2ae8d3fd0bc5 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:33.223761 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293694eb-bf70-4ffb-bdc5-334b0a9f6609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:33.224478 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293694eb-bf70-4ffb-bdc5-334b0a9f6609 None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.224740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293694eb-bf70-4ffb-bdc5-334b0a9f6609 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.225019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293694eb-bf70-4ffb-bdc5-334b0a9f6609 None admin] PATH_INFO: `/v3/groups` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.225732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293694eb-bf70-4ffb-bdc5-334b0a9f6609 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:33.227162 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293694eb-bf70-4ffb-bdc5-334b0a9f6609 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:33.314139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da001d-36e3-4634-8b1c-2ae8d3fd0bc5 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:33.333327 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 155/326] 10.222.0.23 () {60 vars in 1134 bytes} [Thu Jun 16 14:43:33 2022] POST /identity/v3/groups => generated 226 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:33.353768 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00783fa7-9545-4794-9e96-7bc4f7db5801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:33.355018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00783fa7-9545-4794-9e96-7bc4f7db5801 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.355495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00783fa7-9545-4794-9e96-7bc4f7db5801 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.355948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00783fa7-9545-4794-9e96-7bc4f7db5801 None admin] PATH_INFO: `/v3/users/df970dcaa9a84427b15042480bec1e90` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.357573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00783fa7-9545-4794-9e96-7bc4f7db5801 None admin] RBAC: Authorizing `identity:get_user(user_id=df970dcaa9a84427b15042480bec1e90)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:33.359279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00783fa7-9545-4794-9e96-7bc4f7db5801 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:33.361576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 172/327] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:33 2022] GET /identity/v3/users/df970dcaa9a84427b15042480bec1e90 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:33.367444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293694eb-bf70-4ffb-bdc5-334b0a9f6609 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:33.399634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:33.476830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293694eb-bf70-4ffb-bdc5-334b0a9f6609 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:33.516285 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf3329-64ea-4e28-944b-88ab9cd36383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:33.516972 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf3329-64ea-4e28-944b-88ab9cd36383 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.517293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf3329-64ea-4e28-944b-88ab9cd36383 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.517579 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf3329-64ea-4e28-944b-88ab9cd36383 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.518498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf3329-64ea-4e28-944b-88ab9cd36383 None admin] RBAC: Adding query filter params (role.id=6832f9f0b207495a9a247504bcb6b49f, user.id=df970dcaa9a84427b15042480bec1e90, scope.system=all) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:33.518821 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf3329-64ea-4e28-944b-88ab9cd36383 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:33.520346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf3329-64ea-4e28-944b-88ab9cd36383 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:33.534805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 156/328] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Jun 16 14:43:33 2022] GET /identity/v3/role_assignments?user.id=df970dcaa9a84427b15042480bec1e90&scope.system=all&role.id=6832f9f0b207495a9a247504bcb6b49f => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:33.587939 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd194-dbf3-4cd5-817c-54b9851fa641 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.588350 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd194-dbf3-4cd5-817c-54b9851fa641 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.588625 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd194-dbf3-4cd5-817c-54b9851fa641 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.590542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 173/329] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:33.597577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead3947-8601-4ec8-af16-665bc7c64d0d None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.597883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead3947-8601-4ec8-af16-665bc7c64d0d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.598150 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead3947-8601-4ec8-af16-665bc7c64d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.616712 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-2ead3947-8601-4ec8-af16-665bc7c64d0d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:33.617993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2ead3947-8601-4ec8-af16-665bc7c64d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:33.698516 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 157/330] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:33.721568 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd194-dbf3-4cd5-817c-54b9851fa641 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:33.734945 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:33.834101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd194-dbf3-4cd5-817c-54b9851fa641 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:33.873908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dcc03-acff-4733-bd78-4d8886e043db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:33.874749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dcc03-acff-4733-bd78-4d8886e043db None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:33.875043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dcc03-acff-4733-bd78-4d8886e043db None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:33.875324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dcc03-acff-4733-bd78-4d8886e043db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:33.887792 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406dcc03-acff-4733-bd78-4d8886e043db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:33.895904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-406dcc03-acff-4733-bd78-4d8886e043db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:33.895904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:33.895904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:33.895904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:33.895904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:33.895904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:33.895904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:33.895904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:33.895904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:33.895904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:33.895904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:33.895904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:33.895904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:33.895904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:33.895904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:33.895904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:33.896822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:33.896822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:33.896822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:33.896822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:33.896822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:33.896822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:33.896822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:33.896822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:33.896822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:33.896822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:33.896822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:33.896822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:33.896822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:33.896822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:33.896822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:33.896822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:33.897631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:33.897631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:33.897631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:33.897631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:33.897631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:33.897631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:33.897631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:33.897631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:33.897631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:33.897631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:33.897631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:33.897631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:33.897631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 174/331] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:33.905895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead3947-8601-4ec8-af16-665bc7c64d0d None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:33.936666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:34.022529 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead3947-8601-4ec8-af16-665bc7c64d0d None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:34.058201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbf606-cc46-494e-b682-7803362e9f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:34.058881 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbf606-cc46-494e-b682-7803362e9f51 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:34.059171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbf606-cc46-494e-b682-7803362e9f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:34.059454 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbf606-cc46-494e-b682-7803362e9f51 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:34.060214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbf606-cc46-494e-b682-7803362e9f51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:34.060522 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbf606-cc46-494e-b682-7803362e9f51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:34.061953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbf606-cc46-494e-b682-7803362e9f51 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:34.076076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 158/332] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:34.077433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dcc03-acff-4733-bd78-4d8886e043db None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:34.152672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:34.186947 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dcc03-acff-4733-bd78-4d8886e043db None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:34.223352 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa41f62-bc9f-4c16-ae3f-3ab1b29ef248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:34.224486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa41f62-bc9f-4c16-ae3f-3ab1b29ef248 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:34.224911 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa41f62-bc9f-4c16-ae3f-3ab1b29ef248 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:34.226670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa41f62-bc9f-4c16-ae3f-3ab1b29ef248 None admin] PATH_INFO: `/v3/users/02d8c7c41ec8469cad952b920fcc4286` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:34.228097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa41f62-bc9f-4c16-ae3f-3ab1b29ef248 None admin] RBAC: Authorizing `identity:get_user(user_id=02d8c7c41ec8469cad952b920fcc4286)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:34.229812 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa41f62-bc9f-4c16-ae3f-3ab1b29ef248 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:34.233830 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 175/333] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:34 2022] GET /identity/v3/users/02d8c7c41ec8469cad952b920fcc4286 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:34.240560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbf606-cc46-494e-b682-7803362e9f51 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:34.348688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:34.372491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbf606-cc46-494e-b682-7803362e9f51 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:34.412960 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff43a32-f37c-44cb-91ea-599d3be9a28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:34.413878 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff43a32-f37c-44cb-91ea-599d3be9a28a None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:34.414165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff43a32-f37c-44cb-91ea-599d3be9a28a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:34.414451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff43a32-f37c-44cb-91ea-599d3be9a28a None admin] PATH_INFO: `/v3/system/users/02d8c7c41ec8469cad952b920fcc4286/roles/51d54eaf35fd45ccb7048e3f446f1eac` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:34.415973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff43a32-f37c-44cb-91ea-599d3be9a28a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=02d8c7c41ec8469cad952b920fcc4286, role_id=51d54eaf35fd45ccb7048e3f446f1eac)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:34.417433 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff43a32-f37c-44cb-91ea-599d3be9a28a None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:34.483053 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 159/334] 10.222.0.23 () {58 vars in 1334 bytes} [Thu Jun 16 14:43:34 2022] PUT /identity/v3/system/users/02d8c7c41ec8469cad952b920fcc4286/roles/51d54eaf35fd45ccb7048e3f446f1eac => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:36.040310 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a233d-02c4-45a4-ae4b-66c5c41d527b None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.041485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a233d-02c4-45a4-ae4b-66c5c41d527b None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.042573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a233d-02c4-45a4-ae4b-66c5c41d527b None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.044388 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 176/335] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:36.050145 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca57d25-6abf-46e0-a29b-003e07eb3957 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.050982 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca57d25-6abf-46e0-a29b-003e07eb3957 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.051479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca57d25-6abf-46e0-a29b-003e07eb3957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.075868 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-dca57d25-6abf-46e0-a29b-003e07eb3957 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:36.077433 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-dca57d25-6abf-46e0-a29b-003e07eb3957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:36.163761 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 160/336] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:36.200327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a233d-02c4-45a4-ae4b-66c5c41d527b None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:36.327149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a233d-02c4-45a4-ae4b-66c5c41d527b None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:36.363810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91a08c-825d-4f7a-9f36-e0e9487f84ba None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.364425 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91a08c-825d-4f7a-9f36-e0e9487f84ba None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.364892 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91a08c-825d-4f7a-9f36-e0e9487f84ba None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.366542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 161/337] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:36.371995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95852fc-bf0b-4a9b-942c-cd1e429c978a None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.372562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95852fc-bf0b-4a9b-942c-cd1e429c978a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.373050 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95852fc-bf0b-4a9b-942c-cd1e429c978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.377695 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1866dfc-e2c6-40f5-abe8-6faee47327f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:36.378540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1866dfc-e2c6-40f5-abe8-6faee47327f9 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.378827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1866dfc-e2c6-40f5-abe8-6faee47327f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.379100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1866dfc-e2c6-40f5-abe8-6faee47327f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.394319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:36.399946 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1866dfc-e2c6-40f5-abe8-6faee47327f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:36.408925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-b1866dfc-e2c6-40f5-abe8-6faee47327f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:36.408925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:36.408925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:36.408925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:36.408925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:36.408925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:36.408925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:36.408925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:36.408925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:36.408925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:36.408925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:36.408925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:36.408925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:36.408925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:36.408925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:36.408925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:36.409886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:36.409886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:36.409886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:36.409886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:36.409886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:36.409886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:36.409886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:36.409886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:36.409886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:36.409886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:36.409886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:36.409886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:36.409886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:36.409886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:36.409886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:36.409886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:36.410666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:36.410666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:36.410666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:36.410666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:36.410666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:36.410666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:36.410666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:36.410666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:36.410666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:36.410666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:36.410666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:36.410666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:36.411259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-a95852fc-bf0b-4a9b-942c-cd1e429c978a None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:36.411259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a95852fc-bf0b-4a9b-942c-cd1e429c978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:36.415345 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 177/338] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:36.420041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1866dfc-e2c6-40f5-abe8-6faee47327f9 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:36.524408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 162/339] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:36.526579 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c030df6-f590-4414-9e4a-7ac43a453e00 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.526878 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c030df6-f590-4414-9e4a-7ac43a453e00 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.527157 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c030df6-f590-4414-9e4a-7ac43a453e00 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.528903 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 163/340] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:36.534310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb9474-00d3-4b23-8e14-694e2cbb2f93 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.534769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb9474-00d3-4b23-8e14-694e2cbb2f93 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.535198 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb9474-00d3-4b23-8e14-694e2cbb2f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.540243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:36.559558 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-07eb9474-00d3-4b23-8e14-694e2cbb2f93 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:36.560990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-07eb9474-00d3-4b23-8e14-694e2cbb2f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:36.583031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1866dfc-e2c6-40f5-abe8-6faee47327f9 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:36.622034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef6a7c-99da-4a95-8e88-5f383794fd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:36.622726 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef6a7c-99da-4a95-8e88-5f383794fd63 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.623015 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef6a7c-99da-4a95-8e88-5f383794fd63 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.623296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef6a7c-99da-4a95-8e88-5f383794fd63 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.624078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef6a7c-99da-4a95-8e88-5f383794fd63 None admin] RBAC: Adding query filter params (name=member) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:36.624388 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef6a7c-99da-4a95-8e88-5f383794fd63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:36.625891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef6a7c-99da-4a95-8e88-5f383794fd63 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:36.635513 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 178/341] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:36.636371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef6a7c-99da-4a95-8e88-5f383794fd63 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:36.663005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 164/342] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:36.663666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb9474-00d3-4b23-8e14-694e2cbb2f93 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:36.715892 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:36.749685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef6a7c-99da-4a95-8e88-5f383794fd63 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:36.791306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0524550-9c7a-48c4-a370-b69063ac3567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:36.792682 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0524550-9c7a-48c4-a370-b69063ac3567 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.792977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0524550-9c7a-48c4-a370-b69063ac3567 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.793288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0524550-9c7a-48c4-a370-b69063ac3567 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.794378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb9474-00d3-4b23-8e14-694e2cbb2f93 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:36.805205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0524550-9c7a-48c4-a370-b69063ac3567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:36.814116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-e0524550-9c7a-48c4-a370-b69063ac3567 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:36.814116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:36.814116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:36.814116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:36.814116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:36.814116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:36.814116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:36.814116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:36.814116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:36.814116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:36.814116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:36.814116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:36.814116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:36.814116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:36.814116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:36.814116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:36.824402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:36.824402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:36.824402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:36.824402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:36.824402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:36.824402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:36.824402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:36.824402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:36.824402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:36.824402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:36.824402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:36.824402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:36.824402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:36.824402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:36.824402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:36.824402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:36.825215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:36.825215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:36.825215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:36.825215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:36.825215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:36.825215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:36.825215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:36.825215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:36.825215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:36.825215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:36.825215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:36.825215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:36.825215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 179/343] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:36.825215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0524550-9c7a-48c4-a370-b69063ac3567 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:36.826189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:36.837492 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16d2db-91db-4878-a312-3fe8b14dbc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:36.838198 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16d2db-91db-4878-a312-3fe8b14dbc8f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.838368 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16d2db-91db-4878-a312-3fe8b14dbc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.839213 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16d2db-91db-4878-a312-3fe8b14dbc8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.925835 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0524550-9c7a-48c4-a370-b69063ac3567 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:36.932124 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16d2db-91db-4878-a312-3fe8b14dbc8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:36.933799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16d2db-91db-4878-a312-3fe8b14dbc8f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:36.950065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:36.964184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08001b5c-681e-440d-97d0-d5c83d50e07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:36.965370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08001b5c-681e-440d-97d0-d5c83d50e07e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:36.965862 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08001b5c-681e-440d-97d0-d5c83d50e07e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:36.966358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08001b5c-681e-440d-97d0-d5c83d50e07e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:36.981093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08001b5c-681e-440d-97d0-d5c83d50e07e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:36.989636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-08001b5c-681e-440d-97d0-d5c83d50e07e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:36.989636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:36.989636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:36.989636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:36.989636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:36.989636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:36.989636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:36.989636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:36.989636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:36.989636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:36.989636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:36.989636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:36.989636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:36.989636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:36.989636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:36.989636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:36.990547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:36.990547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:36.990547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:36.990547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:36.990547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:36.990547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:36.990547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:36.990547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:36.990547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:36.990547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:36.990547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:36.990547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:36.990547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:36.990547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:36.990547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:36.990547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:36.991404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:36.991404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:36.991404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:36.991404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:36.991404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:36.991404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:36.991404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:36.991404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:36.991404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:36.991404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:36.991404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:36.991404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:36.991404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 180/344] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:36.992056 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08001b5c-681e-440d-97d0-d5c83d50e07e None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:37.104051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08001b5c-681e-440d-97d0-d5c83d50e07e None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:37.142426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2eb974-67c2-4458-bfa5-28652f101513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:37.143111 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2eb974-67c2-4458-bfa5-28652f101513 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:37.143403 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2eb974-67c2-4458-bfa5-28652f101513 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:37.143678 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2eb974-67c2-4458-bfa5-28652f101513 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:37.144651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2eb974-67c2-4458-bfa5-28652f101513 None admin] RBAC: Adding query filter params (name=member) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:37.145017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2eb974-67c2-4458-bfa5-28652f101513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:37.147607 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2eb974-67c2-4458-bfa5-28652f101513 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:37.157869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 181/345] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:37.158658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2eb974-67c2-4458-bfa5-28652f101513 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:37.185342 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 165/346] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:37.186218 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16d2db-91db-4878-a312-3fe8b14dbc8f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:37.213633 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:37.254327 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:37.268683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2eb974-67c2-4458-bfa5-28652f101513 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:37.310758 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfff283-fcb6-49a4-aaf1-a7860de11272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:37.311675 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfff283-fcb6-49a4-aaf1-a7860de11272 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:37.312130 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfff283-fcb6-49a4-aaf1-a7860de11272 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:37.312534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfff283-fcb6-49a4-aaf1-a7860de11272 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:37.313599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfff283-fcb6-49a4-aaf1-a7860de11272 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:37.314085 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfff283-fcb6-49a4-aaf1-a7860de11272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:37.315754 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfff283-fcb6-49a4-aaf1-a7860de11272 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:37.325646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 182/347] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:37.326752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfff283-fcb6-49a4-aaf1-a7860de11272 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:37.389479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16d2db-91db-4878-a312-3fe8b14dbc8f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:37.445368 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ad38e-b84a-445d-a784-ef0ecc666ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:37.446328 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ad38e-b84a-445d-a784-ef0ecc666ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:37.446816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ad38e-b84a-445d-a784-ef0ecc666ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:37.447270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ad38e-b84a-445d-a784-ef0ecc666ac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:37.528188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfff283-fcb6-49a4-aaf1-a7860de11272 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:37.558091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:37.569647 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b381167-278b-4817-aaca-09cae7923dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:37.570934 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b381167-278b-4817-aaca-09cae7923dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:37.571418 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b381167-278b-4817-aaca-09cae7923dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:37.571973 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b381167-278b-4817-aaca-09cae7923dd7 None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:37.573409 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b381167-278b-4817-aaca-09cae7923dd7 None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:37.575253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b381167-278b-4817-aaca-09cae7923dd7 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:37.577667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 183/348] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:37 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:37.578324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b381167-278b-4817-aaca-09cae7923dd7 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:37.588485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ad38e-b84a-445d-a784-ef0ecc666ac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:37.594289 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ad38e-b84a-445d-a784-ef0ecc666ac7 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:37.641904 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:37.693663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b381167-278b-4817-aaca-09cae7923dd7 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:37.724631 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 166/349] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:37.725697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ad38e-b84a-445d-a784-ef0ecc666ac7 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:37.733532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9212abf-14af-4579-b56e-ba4ff444aa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:37.734590 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9212abf-14af-4579-b56e-ba4ff444aa16 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:37.735144 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9212abf-14af-4579-b56e-ba4ff444aa16 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:37.735666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9212abf-14af-4579-b56e-ba4ff444aa16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:37.785611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:37.816020 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9212abf-14af-4579-b56e-ba4ff444aa16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:37.817886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9212abf-14af-4579-b56e-ba4ff444aa16 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:37.841639 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ad38e-b84a-445d-a784-ef0ecc666ac7 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:37.874497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:37.891285 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dd4cb-cb13-407c-978c-fc4a0e75ad6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:37.892229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dd4cb-cb13-407c-978c-fc4a0e75ad6a None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:37.892504 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dd4cb-cb13-407c-978c-fc4a0e75ad6a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:37.892784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dd4cb-cb13-407c-978c-fc4a0e75ad6a None admin] PATH_INFO: `/v3/groups/20823663c72547cdb2aa7a83ad1bdde0` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:37.909852 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517dd4cb-cb13-407c-978c-fc4a0e75ad6a None admin] RBAC: Authorizing `identity:get_group(group_id=20823663c72547cdb2aa7a83ad1bdde0)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:37.911331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517dd4cb-cb13-407c-978c-fc4a0e75ad6a None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:37.913179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 167/350] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:37 2022] GET /identity/v3/groups/20823663c72547cdb2aa7a83ad1bdde0 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:37.914015 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dd4cb-cb13-407c-978c-fc4a0e75ad6a None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:37.934015 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 184/351] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:37.935640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c09779-6fba-48ae-9e16-5a2f184f7780 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:37.936357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c09779-6fba-48ae-9e16-5a2f184f7780 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:37.936816 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c09779-6fba-48ae-9e16-5a2f184f7780 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:37.938563 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 185/352] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:37.939666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c09779-6fba-48ae-9e16-5a2f184f7780 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:38.029047 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:38.045554 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dd4cb-cb13-407c-978c-fc4a0e75ad6a None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:38.059461 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c09779-6fba-48ae-9e16-5a2f184f7780 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:38.083798 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94e4e7-5d80-406b-81c1-190d80d8ece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:38.084666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94e4e7-5d80-406b-81c1-190d80d8ece0 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.084986 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94e4e7-5d80-406b-81c1-190d80d8ece0 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.085357 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94e4e7-5d80-406b-81c1-190d80d8ece0 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.086660 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94e4e7-5d80-406b-81c1-190d80d8ece0 None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:38.088419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94e4e7-5d80-406b-81c1-190d80d8ece0 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:38.090853 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 168/353] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:37 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:38.092284 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854ac7d-2779-4e57-b0ec-f0f5bf7cf207 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.092574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854ac7d-2779-4e57-b0ec-f0f5bf7cf207 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.092850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854ac7d-2779-4e57-b0ec-f0f5bf7cf207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.101995 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53b546-d573-49df-aa90-bd2559695b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:38.103137 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53b546-d573-49df-aa90-bd2559695b5e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.103137 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53b546-d573-49df-aa90-bd2559695b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.103410 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53b546-d573-49df-aa90-bd2559695b5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.104288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53b546-d573-49df-aa90-bd2559695b5e None admin] RBAC: Adding query filter params (group.id=20823663c72547cdb2aa7a83ad1bdde0, role.id=6832f9f0b207495a9a247504bcb6b49f, scope.project.id=54dee477b50d4b1283589452d92ce93f) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:38.105359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53b546-d573-49df-aa90-bd2559695b5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:38.106562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53b546-d573-49df-aa90-bd2559695b5e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:38.113377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 186/354] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 16 14:43:37 2022] GET /identity/v3/role_assignments?group.id=20823663c72547cdb2aa7a83ad1bdde0&scope.project.id=54dee477b50d4b1283589452d92ce93f&role.id=6832f9f0b207495a9a247504bcb6b49f => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:38.113514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-1854ac7d-2779-4e57-b0ec-f0f5bf7cf207 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:38.123070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53b546-d573-49df-aa90-bd2559695b5e None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:38.123276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-1854ac7d-2779-4e57-b0ec-f0f5bf7cf207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:38.197103 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:38.207456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 169/355] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:38.209030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df9f0b-1dd2-41b8-b397-39222ab30511 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.209365 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df9f0b-1dd2-41b8-b397-39222ab30511 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.209645 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df9f0b-1dd2-41b8-b397-39222ab30511 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.211025 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 170/356] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:38.211883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df9f0b-1dd2-41b8-b397-39222ab30511 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:38.290244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53b546-d573-49df-aa90-bd2559695b5e None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:38.338048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cee759-90e8-40fd-a8b3-1514d7c6889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:38.339618 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cee759-90e8-40fd-a8b3-1514d7c6889e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.339906 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cee759-90e8-40fd-a8b3-1514d7c6889e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.340309 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cee759-90e8-40fd-a8b3-1514d7c6889e None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.341604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cee759-90e8-40fd-a8b3-1514d7c6889e None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:38.343177 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cee759-90e8-40fd-a8b3-1514d7c6889e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:38.345309 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 187/357] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:38 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:38.346509 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8129964-99ad-4f90-9417-d62a76cd9590 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.346802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8129964-99ad-4f90-9417-d62a76cd9590 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.347092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8129964-99ad-4f90-9417-d62a76cd9590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.349917 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df9f0b-1dd2-41b8-b397-39222ab30511 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:38.353827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:38.366081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-b8129964-99ad-4f90-9417-d62a76cd9590 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:38.367282 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b8129964-99ad-4f90-9417-d62a76cd9590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:38.389887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c979b1-6860-441f-9a95-4a5b180ce0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:38.390756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c979b1-6860-441f-9a95-4a5b180ce0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.391044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c979b1-6860-441f-9a95-4a5b180ce0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.391330 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c979b1-6860-441f-9a95-4a5b180ce0d1 None admin] PATH_INFO: `/v3/groups/20823663c72547cdb2aa7a83ad1bdde0` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.392608 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c979b1-6860-441f-9a95-4a5b180ce0d1 None admin] RBAC: Authorizing `identity:get_group(group_id=20823663c72547cdb2aa7a83ad1bdde0)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:38.394325 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c979b1-6860-441f-9a95-4a5b180ce0d1 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:38.396722 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 171/358] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:38 2022] GET /identity/v3/groups/20823663c72547cdb2aa7a83ad1bdde0 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:38.398211 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c979b1-6860-441f-9a95-4a5b180ce0d1 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:38.468266 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:38.468432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 188/359] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:38.470216 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76985d-c12e-48f2-b7c1-68b7bfb169c0 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.470512 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76985d-c12e-48f2-b7c1-68b7bfb169c0 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.470786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76985d-c12e-48f2-b7c1-68b7bfb169c0 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.473270 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 189/360] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:38.474207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76985d-c12e-48f2-b7c1-68b7bfb169c0 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:38.542446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c979b1-6860-441f-9a95-4a5b180ce0d1 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:38.592093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68074e73-6eea-4162-85a8-50479e20b08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:38.592914 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68074e73-6eea-4162-85a8-50479e20b08a None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.595270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68074e73-6eea-4162-85a8-50479e20b08a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.595270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68074e73-6eea-4162-85a8-50479e20b08a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.597635 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76985d-c12e-48f2-b7c1-68b7bfb169c0 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:38.613166 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68074e73-6eea-4162-85a8-50479e20b08a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:38.623043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-68074e73-6eea-4162-85a8-50479e20b08a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:38.623043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:38.623043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:38.623043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:38.623043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:38.623043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:38.623043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:38.623043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:38.623043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:38.623043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:38.623043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:38.623043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:38.623043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:38.623043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:38.623043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:38.623043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:38.623977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:38.623977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:38.623977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:38.623977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:38.623977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:38.623977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:38.623977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:38.623977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:38.623977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:38.623977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:38.623977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:38.623977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:38.623977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:38.623977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:38.623977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:38.623977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:38.624748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:38.624748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:38.624748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:38.624748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:38.624748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:38.624748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:38.624748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:38.624748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:38.624748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:38.624748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:38.624748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:38.624748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:38.624748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 172/361] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:38.625939 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68074e73-6eea-4162-85a8-50479e20b08a None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:38.642644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396c260-36e6-4bdd-9ed5-a2a82a7bd48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:38.643901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396c260-36e6-4bdd-9ed5-a2a82a7bd48d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.644393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396c260-36e6-4bdd-9ed5-a2a82a7bd48d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.644677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396c260-36e6-4bdd-9ed5-a2a82a7bd48d None admin] PATH_INFO: `/v3/groups/20823663c72547cdb2aa7a83ad1bdde0` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.645988 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396c260-36e6-4bdd-9ed5-a2a82a7bd48d None admin] RBAC: Authorizing `identity:get_group(group_id=20823663c72547cdb2aa7a83ad1bdde0)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:38.647507 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396c260-36e6-4bdd-9ed5-a2a82a7bd48d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:38.649347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 190/362] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:38 2022] GET /identity/v3/groups/20823663c72547cdb2aa7a83ad1bdde0 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:38.650652 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f102f1-c160-4595-b5e8-2b08959f7599 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.650939 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f102f1-c160-4595-b5e8-2b08959f7599 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.652242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f102f1-c160-4595-b5e8-2b08959f7599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.658471 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:38.670707 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-15f102f1-c160-4595-b5e8-2b08959f7599 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:38.672712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-15f102f1-c160-4595-b5e8-2b08959f7599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:38.754469 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68074e73-6eea-4162-85a8-50479e20b08a None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:38.767669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 191/363] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:38.768229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f102f1-c160-4595-b5e8-2b08959f7599 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:38.784648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:38.798223 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89f4f7-cefb-4daa-b832-da1c4b48e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:38.799066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89f4f7-cefb-4daa-b832-da1c4b48e06b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.799456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89f4f7-cefb-4daa-b832-da1c4b48e06b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.799836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89f4f7-cefb-4daa-b832-da1c4b48e06b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.801332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89f4f7-cefb-4daa-b832-da1c4b48e06b None admin] RBAC: Adding query filter params (group.id=20823663c72547cdb2aa7a83ad1bdde0, role.id=6832f9f0b207495a9a247504bcb6b49f, scope.project.id=95ca3cd0264d43a2af05d5013692c2da) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:38.801332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89f4f7-cefb-4daa-b832-da1c4b48e06b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:38.802733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89f4f7-cefb-4daa-b832-da1c4b48e06b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:38.813386 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 173/364] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 16 14:43:38 2022] GET /identity/v3/role_assignments?group.id=20823663c72547cdb2aa7a83ad1bdde0&scope.project.id=95ca3cd0264d43a2af05d5013692c2da&role.id=6832f9f0b207495a9a247504bcb6b49f => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:38.814791 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89f4f7-cefb-4daa-b832-da1c4b48e06b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:38.905434 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f102f1-c160-4595-b5e8-2b08959f7599 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:38.945079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:38.952356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1935ae-31de-4103-aff6-59c0d5d26da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:38.953776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1935ae-31de-4103-aff6-59c0d5d26da6 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:38.958386 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1935ae-31de-4103-aff6-59c0d5d26da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:38.958386 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1935ae-31de-4103-aff6-59c0d5d26da6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:38.972296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1935ae-31de-4103-aff6-59c0d5d26da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:38.972806 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89f4f7-cefb-4daa-b832-da1c4b48e06b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:38.982575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-6d1935ae-31de-4103-aff6-59c0d5d26da6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:38.982575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:38.982575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:38.982575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:38.982575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:38.982575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:38.982575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:38.982575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:38.982575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:38.982575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:38.982575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:38.982575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:38.982575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:38.982575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:38.982575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:38.982575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:38.983653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:38.983653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:38.983653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:38.983653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:38.983653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:38.983653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:38.983653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:38.983653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:38.983653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:38.983653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:38.983653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:38.983653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:38.983653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:38.983653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:38.983653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:38.983653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:38.984992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:38.984992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:38.984992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:38.984992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:38.984992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:38.984992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:38.984992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:38.984992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:38.984992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:38.984992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:38.984992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 14:43:38.984992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:38.987036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 192/365] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:38.988030 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1935ae-31de-4103-aff6-59c0d5d26da6 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.030622 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5ef59-cfd8-4223-b02d-a770ccbe99af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.031652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5ef59-cfd8-4223-b02d-a770ccbe99af None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.032184 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5ef59-cfd8-4223-b02d-a770ccbe99af None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.032667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5ef59-cfd8-4223-b02d-a770ccbe99af None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.033688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5ef59-cfd8-4223-b02d-a770ccbe99af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:39.034219 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5ef59-cfd8-4223-b02d-a770ccbe99af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:39.035929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5ef59-cfd8-4223-b02d-a770ccbe99af None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:39.046096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 174/366] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:39.047295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5ef59-cfd8-4223-b02d-a770ccbe99af None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.099932 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:39.119650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1935ae-31de-4103-aff6-59c0d5d26da6 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.160204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5ef59-cfd8-4223-b02d-a770ccbe99af None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.165469 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9cd1d-625a-41fc-97ee-d64a0a558a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.166216 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9cd1d-625a-41fc-97ee-d64a0a558a72 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.166571 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9cd1d-625a-41fc-97ee-d64a0a558a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.167455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9cd1d-625a-41fc-97ee-d64a0a558a72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.168368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9cd1d-625a-41fc-97ee-d64a0a558a72 None admin] RBAC: Adding query filter params (group.id=20823663c72547cdb2aa7a83ad1bdde0, role.id=602eca0d730345ff8999a6bbd7124092, scope.project.id=54dee477b50d4b1283589452d92ce93f) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:39.168756 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9cd1d-625a-41fc-97ee-d64a0a558a72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:39.171000 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9cd1d-625a-41fc-97ee-d64a0a558a72 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:39.185220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 193/367] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 16 14:43:38 2022] GET /identity/v3/role_assignments?group.id=20823663c72547cdb2aa7a83ad1bdde0&scope.project.id=54dee477b50d4b1283589452d92ce93f&role.id=602eca0d730345ff8999a6bbd7124092 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:39.187316 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9cd1d-625a-41fc-97ee-d64a0a558a72 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.226831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d72fa-bcbb-46ff-a125-93ade3df2ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.230074 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d72fa-bcbb-46ff-a125-93ade3df2ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.230592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d72fa-bcbb-46ff-a125-93ade3df2ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.231027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d72fa-bcbb-46ff-a125-93ade3df2ed8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.257320 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d72fa-bcbb-46ff-a125-93ade3df2ed8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:39.270112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-599d72fa-bcbb-46ff-a125-93ade3df2ed8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:39.270112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:39.270112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:39.270112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:39.270112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:39.270112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:39.270112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:39.270112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:39.270112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:39.270112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:39.270112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:39.270112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:39.270112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:39.270112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:39.270112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:39.270112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:39.271248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:39.271248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:39.271248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:39.271248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:39.271248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:39.271248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:39.271248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:39.271248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:39.271248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:39.271248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:39.271248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:39.271248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:39.271248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:39.271248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:39.271248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:39.271248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:39.272238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:39.272238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:39.272238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:39.272238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:39.272238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:39.272238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:39.272238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:39.272238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:39.272238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:39.272238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:39.272238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:39.272238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:39.275300 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 175/368] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:39.279991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d72fa-bcbb-46ff-a125-93ade3df2ed8 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.311410 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:39.397168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9cd1d-625a-41fc-97ee-d64a0a558a72 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.447853 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bfec1-d615-4113-90a9-af45819f8655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.453077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bfec1-d615-4113-90a9-af45819f8655 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.453905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bfec1-d615-4113-90a9-af45819f8655 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.455691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bfec1-d615-4113-90a9-af45819f8655 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.457496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bfec1-d615-4113-90a9-af45819f8655 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:39.458626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bfec1-d615-4113-90a9-af45819f8655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:39.460384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bfec1-d615-4113-90a9-af45819f8655 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:39.475276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d72fa-bcbb-46ff-a125-93ade3df2ed8 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.480306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 194/369] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:39.484313 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bfec1-d615-4113-90a9-af45819f8655 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.497564 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:39.543963 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476d9a0-db1b-4e37-9aca-918b24a1f9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.545843 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476d9a0-db1b-4e37-9aca-918b24a1f9ff None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.547414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476d9a0-db1b-4e37-9aca-918b24a1f9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.547905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476d9a0-db1b-4e37-9aca-918b24a1f9ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.630768 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bfec1-d615-4113-90a9-af45819f8655 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.649569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:39.667726 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246db6ae-e074-47ff-970e-6f20b1438bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.668735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246db6ae-e074-47ff-970e-6f20b1438bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.669258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246db6ae-e074-47ff-970e-6f20b1438bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.669763 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246db6ae-e074-47ff-970e-6f20b1438bd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.670722 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246db6ae-e074-47ff-970e-6f20b1438bd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:39.671229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246db6ae-e074-47ff-970e-6f20b1438bd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:39.673017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246db6ae-e074-47ff-970e-6f20b1438bd8 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:39.682337 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 195/370] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:39.683962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246db6ae-e074-47ff-970e-6f20b1438bd8 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.734257 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476d9a0-db1b-4e37-9aca-918b24a1f9ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:39.735805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476d9a0-db1b-4e37-9aca-918b24a1f9ff None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:39.789579 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246db6ae-e074-47ff-970e-6f20b1438bd8 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:39.863268 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e532e-6682-42d2-84cc-b79802e5296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:39.864175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e532e-6682-42d2-84cc-b79802e5296f None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:39.864457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e532e-6682-42d2-84cc-b79802e5296f None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:39.864734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e532e-6682-42d2-84cc-b79802e5296f None admin] PATH_INFO: `/v3/users/02d8c7c41ec8469cad952b920fcc4286` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:39.866091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e532e-6682-42d2-84cc-b79802e5296f None admin] RBAC: Authorizing `identity:get_user(user_id=02d8c7c41ec8469cad952b920fcc4286)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:39.867608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e532e-6682-42d2-84cc-b79802e5296f None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:39.869578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 196/371] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:43:39 2022] GET /identity/v3/users/02d8c7c41ec8469cad952b920fcc4286 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:39.871253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e532e-6682-42d2-84cc-b79802e5296f None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.890002 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 176/372] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:39.890792 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476d9a0-db1b-4e37-9aca-918b24a1f9ff None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:39.902497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:39.992774 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:40.008789 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476d9a0-db1b-4e37-9aca-918b24a1f9ff None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:40.050282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251861ff-133b-4f99-b964-fe902913f35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.050952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251861ff-133b-4f99-b964-fe902913f35f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.051243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251861ff-133b-4f99-b964-fe902913f35f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.051528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251861ff-133b-4f99-b964-fe902913f35f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.052360 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251861ff-133b-4f99-b964-fe902913f35f None admin] RBAC: Adding query filter params (role.id=51d54eaf35fd45ccb7048e3f446f1eac, user.id=02d8c7c41ec8469cad952b920fcc4286, scope.system=all) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:40.052678 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251861ff-133b-4f99-b964-fe902913f35f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:40.054563 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251861ff-133b-4f99-b964-fe902913f35f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:40.068983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 177/373] 10.222.0.23 () {56 vars in 1308 bytes} [Thu Jun 16 14:43:39 2022] GET /identity/v3/role_assignments?user.id=02d8c7c41ec8469cad952b920fcc4286&scope.system=all&role.id=51d54eaf35fd45ccb7048e3f446f1eac => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:40.069680 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251861ff-133b-4f99-b964-fe902913f35f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:40.101472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e532e-6682-42d2-84cc-b79802e5296f None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:40.149032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:40.185514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936979e8-6788-42d1-9195-27f1516c2cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.186191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936979e8-6788-42d1-9195-27f1516c2cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.186481 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936979e8-6788-42d1-9195-27f1516c2cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.186839 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936979e8-6788-42d1-9195-27f1516c2cf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.192535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251861ff-133b-4f99-b964-fe902913f35f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:40.240369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b517342-d20c-46b4-a2a3-37fe9b2855c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.242426 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b517342-d20c-46b4-a2a3-37fe9b2855c5 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.242880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b517342-d20c-46b4-a2a3-37fe9b2855c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.243503 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b517342-d20c-46b4-a2a3-37fe9b2855c5 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.245083 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b517342-d20c-46b4-a2a3-37fe9b2855c5 None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:40.246762 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b517342-d20c-46b4-a2a3-37fe9b2855c5 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:40.248831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 178/374] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:40 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:40.255240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b517342-d20c-46b4-a2a3-37fe9b2855c5 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:40.361925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936979e8-6788-42d1-9195-27f1516c2cf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:40.363426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936979e8-6788-42d1-9195-27f1516c2cf5 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:40.375970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b517342-d20c-46b4-a2a3-37fe9b2855c5 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:40.428826 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c7700-55c6-4b76-922a-0530fbc9fd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.430095 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c7700-55c6-4b76-922a-0530fbc9fd4a None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.430551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c7700-55c6-4b76-922a-0530fbc9fd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.430976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c7700-55c6-4b76-922a-0530fbc9fd4a None admin] PATH_INFO: `/v3/groups/20823663c72547cdb2aa7a83ad1bdde0` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.435375 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c7700-55c6-4b76-922a-0530fbc9fd4a None admin] RBAC: Authorizing `identity:get_group(group_id=20823663c72547cdb2aa7a83ad1bdde0)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:40.437031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c7700-55c6-4b76-922a-0530fbc9fd4a None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:40.439642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 179/375] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:40 2022] GET /identity/v3/groups/20823663c72547cdb2aa7a83ad1bdde0 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:40.445635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c7700-55c6-4b76-922a-0530fbc9fd4a None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:40.482526 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:40.489803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:40.574433 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c7700-55c6-4b76-922a-0530fbc9fd4a None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:40.576156 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 197/376] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:40.582071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936979e8-6788-42d1-9195-27f1516c2cf5 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:40.614183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b0e4b-56d7-4a6f-9d2b-2d48c3fe41f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.614850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b0e4b-56d7-4a6f-9d2b-2d48c3fe41f4 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.615142 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b0e4b-56d7-4a6f-9d2b-2d48c3fe41f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.615424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b0e4b-56d7-4a6f-9d2b-2d48c3fe41f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.616266 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b0e4b-56d7-4a6f-9d2b-2d48c3fe41f4 None admin] RBAC: Adding query filter params (group.id=20823663c72547cdb2aa7a83ad1bdde0, role.id=602eca0d730345ff8999a6bbd7124092, scope.project.id=95ca3cd0264d43a2af05d5013692c2da) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:40.616586 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b0e4b-56d7-4a6f-9d2b-2d48c3fe41f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:40.618061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b0e4b-56d7-4a6f-9d2b-2d48c3fe41f4 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:40.625643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 180/377] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 16 14:43:40 2022] GET /identity/v3/role_assignments?group.id=20823663c72547cdb2aa7a83ad1bdde0&scope.project.id=95ca3cd0264d43a2af05d5013692c2da&role.id=602eca0d730345ff8999a6bbd7124092 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:40.719139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936979e8-6788-42d1-9195-27f1516c2cf5 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:40.752665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8806-6f00-4933-98f9-b5fef51756b1 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.752995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8806-6f00-4933-98f9-b5fef51756b1 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.753284 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8806-6f00-4933-98f9-b5fef51756b1 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.754855 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 181/378] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:40.761568 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4beaa-1ea7-4b15-8784-1757acd31432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.761795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0464d6a-86db-4532-a0bf-c313c59db35e None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.761887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0464d6a-86db-4532-a0bf-c313c59db35e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.762134 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0464d6a-86db-4532-a0bf-c313c59db35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.762443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4beaa-1ea7-4b15-8784-1757acd31432 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.762732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4beaa-1ea7-4b15-8784-1757acd31432 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.763011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4beaa-1ea7-4b15-8784-1757acd31432 None admin] PATH_INFO: `/v3/projects/8bf0562aee55477696055292ce72d79e` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.768917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4beaa-1ea7-4b15-8784-1757acd31432 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf0562aee55477696055292ce72d79e)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:40.770501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4beaa-1ea7-4b15-8784-1757acd31432 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:40.772321 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 198/379] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:40 2022] GET /identity/v3/projects/8bf0562aee55477696055292ce72d79e => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:40.778526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4beaa-1ea7-4b15-8784-1757acd31432 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:40.781718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-e0464d6a-86db-4532-a0bf-c313c59db35e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:40.782917 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e0464d6a-86db-4532-a0bf-c313c59db35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:40.824311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:40.912774 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:40.927845 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 182/380] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:40.942563 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4beaa-1ea7-4b15-8784-1757acd31432 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:40.989908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d037ae-3052-4639-8603-ef6cc2482f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:40.990856 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d037ae-3052-4639-8603-ef6cc2482f27 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:40.991137 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d037ae-3052-4639-8603-ef6cc2482f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:40.991408 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d037ae-3052-4639-8603-ef6cc2482f27 None admin] PATH_INFO: `/v3/groups/40b62be8aa41464982bf061ce90d4ad0` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:40.999003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d037ae-3052-4639-8603-ef6cc2482f27 None admin] RBAC: Authorizing `identity:get_group(group_id=40b62be8aa41464982bf061ce90d4ad0)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:41.000530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d037ae-3052-4639-8603-ef6cc2482f27 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:41.002523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 199/381] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:40 2022] GET /identity/v3/groups/40b62be8aa41464982bf061ce90d4ad0 => generated 229 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:41.006951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0464d6a-86db-4532-a0bf-c313c59db35e None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:41.014161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d037ae-3052-4639-8603-ef6cc2482f27 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:41.101715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:41.121504 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d037ae-3052-4639-8603-ef6cc2482f27 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:41.133182 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0464d6a-86db-4532-a0bf-c313c59db35e None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:41.158942 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe30523-501d-4a93-b2c1-df183837b7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:41.159654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe30523-501d-4a93-b2c1-df183837b7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.159943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe30523-501d-4a93-b2c1-df183837b7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.160223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe30523-501d-4a93-b2c1-df183837b7a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.161062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe30523-501d-4a93-b2c1-df183837b7a9 None admin] RBAC: Adding query filter params (group.id=40b62be8aa41464982bf061ce90d4ad0, role.id=c865040abd6c4b099381557da21c471d, scope.project.id=8bf0562aee55477696055292ce72d79e) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:41.161408 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe30523-501d-4a93-b2c1-df183837b7a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:41.162852 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe30523-501d-4a93-b2c1-df183837b7a9 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:41.164970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03531f9-bcb8-4269-bde5-a8f0ea2b92cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:41.166072 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03531f9-bcb8-4269-bde5-a8f0ea2b92cf None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.166538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03531f9-bcb8-4269-bde5-a8f0ea2b92cf None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.166988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03531f9-bcb8-4269-bde5-a8f0ea2b92cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.169111 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 200/382] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 16 14:43:41 2022] GET /identity/v3/role_assignments?group.id=40b62be8aa41464982bf061ce90d4ad0&scope.project.id=8bf0562aee55477696055292ce72d79e&role.id=c865040abd6c4b099381557da21c471d => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:41.182465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03531f9-bcb8-4269-bde5-a8f0ea2b92cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:41.192077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-d03531f9-bcb8-4269-bde5-a8f0ea2b92cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:41.192077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:41.192077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:41.192077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:41.192077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:41.192077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:41.192077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:41.192077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:41.192077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:41.192077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:41.192077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:41.192077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:41.192077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:41.192077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:41.192077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:41.192077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:41.193295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:41.193295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:41.193295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:41.193295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:41.193295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:41.193295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:41.193295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:41.193295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:41.193295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:41.193295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:41.193295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:41.193295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:41.193295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:41.193295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:41.193295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:41.193295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:41.194273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:41.194273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:41.194273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:41.194273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:41.194273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:41.194273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:41.194273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:41.194273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:41.194273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:41.194273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:41.194273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:41.194273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:41.196841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 183/383] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:41.203906 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe30523-501d-4a93-b2c1-df183837b7a9 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:41.319976 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe30523-501d-4a93-b2c1-df183837b7a9 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:41.361076 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f79942-f470-42ae-9511-370b52e373c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:41.361823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f79942-f470-42ae-9511-370b52e373c5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.362112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f79942-f470-42ae-9511-370b52e373c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.362393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f79942-f470-42ae-9511-370b52e373c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.365533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f79942-f470-42ae-9511-370b52e373c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:41.365854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f79942-f470-42ae-9511-370b52e373c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:41.367250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f79942-f470-42ae-9511-370b52e373c5 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:41.377166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 201/384] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:41.382620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03531f9-bcb8-4269-bde5-a8f0ea2b92cf None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:41.492248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:41.542626 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03531f9-bcb8-4269-bde5-a8f0ea2b92cf None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:41.589041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00a935-1e3c-43eb-befd-511a8f1d84fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:41.590292 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00a935-1e3c-43eb-befd-511a8f1d84fa None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.590778 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00a935-1e3c-43eb-befd-511a8f1d84fa None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.591251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00a935-1e3c-43eb-befd-511a8f1d84fa None admin] PATH_INFO: `/v3/groups/20823663c72547cdb2aa7a83ad1bdde0` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.593443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00a935-1e3c-43eb-befd-511a8f1d84fa None admin] RBAC: Authorizing `identity:get_group(group_id=20823663c72547cdb2aa7a83ad1bdde0)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:41.595160 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00a935-1e3c-43eb-befd-511a8f1d84fa None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:41.597394 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 184/385] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:41 2022] GET /identity/v3/groups/20823663c72547cdb2aa7a83ad1bdde0 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:41.603164 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f79942-f470-42ae-9511-370b52e373c5 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:41.621564 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:41.649274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503c399-ee33-4c50-b0de-9d7e4d985c4c None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.649913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503c399-ee33-4c50-b0de-9d7e4d985c4c None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.650421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503c399-ee33-4c50-b0de-9d7e4d985c4c None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.652519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 185/386] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:41.663316 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ad538-e97e-40fa-8d57-cf61079f1707 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.663702 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ad538-e97e-40fa-8d57-cf61079f1707 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.664076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ad538-e97e-40fa-8d57-cf61079f1707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.693848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-c79ad538-e97e-40fa-8d57-cf61079f1707 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:41.695504 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c79ad538-e97e-40fa-8d57-cf61079f1707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:41.790116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f79942-f470-42ae-9511-370b52e373c5 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:41.838424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 186/387] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:41.862894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d003e-1830-484c-959c-2e57385f50b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:41.863723 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d003e-1830-484c-959c-2e57385f50b1 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:41.864009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d003e-1830-484c-959c-2e57385f50b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:41.864289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d003e-1830-484c-959c-2e57385f50b1 None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:41.865537 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d003e-1830-484c-959c-2e57385f50b1 None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:41.866991 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d003e-1830-484c-959c-2e57385f50b1 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:41.869045 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 202/388] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:41 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:41.872190 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ad538-e97e-40fa-8d57-cf61079f1707 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:41.884750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d003e-1830-484c-959c-2e57385f50b1 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:41.939282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:41.991048 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ad538-e97e-40fa-8d57-cf61079f1707 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.006698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:42.031517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d535-45d7-452b-b5d3-12b95462dcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.032693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d535-45d7-452b-b5d3-12b95462dcea None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.033195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d535-45d7-452b-b5d3-12b95462dcea None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.033688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0d535-45d7-452b-b5d3-12b95462dcea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.051556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d003e-1830-484c-959c-2e57385f50b1 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.053978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0d535-45d7-452b-b5d3-12b95462dcea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:42.067412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-54c0d535-45d7-452b-b5d3-12b95462dcea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:42.067412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:42.067412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:42.067412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:42.067412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:42.067412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:42.067412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:42.067412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:42.067412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:42.067412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:42.067412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:42.067412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:42.067412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:42.067412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:42.067412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:42.067412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:42.068387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:42.068387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:42.068387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:42.068387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:42.068387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:42.068387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:42.068387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:42.068387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:42.068387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:42.068387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:42.068387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:42.068387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:42.068387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:42.068387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:42.068387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:42.068387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:42.069175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:42.069175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:42.069175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:42.069175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:42.069175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:42.069175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:42.069175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:42.069175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:42.069175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:42.069175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:42.069175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:42.069175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:42.074790 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 187/389] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:42.082330 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d535-45d7-452b-b5d3-12b95462dcea None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.133467 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4432263-99d7-4191-bd20-8c70d3fb3413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.134765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4432263-99d7-4191-bd20-8c70d3fb3413 None admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.135251 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4432263-99d7-4191-bd20-8c70d3fb3413 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.135733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4432263-99d7-4191-bd20-8c70d3fb3413 None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f/groups/20823663c72547cdb2aa7a83ad1bdde0/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.138740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4432263-99d7-4191-bd20-8c70d3fb3413 None admin] RBAC: Authorizing `identity:create_grant(project_id=54dee477b50d4b1283589452d92ce93f, group_id=20823663c72547cdb2aa7a83ad1bdde0, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.141642 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4432263-99d7-4191-bd20-8c70d3fb3413 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.208989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 203/390] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Jun 16 14:43:41 2022] PUT /identity/v3/projects/54dee477b50d4b1283589452d92ce93f/groups/20823663c72547cdb2aa7a83ad1bdde0/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:42.239209 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0d535-45d7-452b-b5d3-12b95462dcea None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.266558 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:42.286116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb76454-5636-46c0-8bfa-026985ac27d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.287247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb76454-5636-46c0-8bfa-026985ac27d3 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.287602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb76454-5636-46c0-8bfa-026985ac27d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.287887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb76454-5636-46c0-8bfa-026985ac27d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.288645 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb76454-5636-46c0-8bfa-026985ac27d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:42.288947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb76454-5636-46c0-8bfa-026985ac27d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.290355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb76454-5636-46c0-8bfa-026985ac27d3 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.300334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 188/391] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:42.306731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4432263-99d7-4191-bd20-8c70d3fb3413 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.438181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4432263-99d7-4191-bd20-8c70d3fb3413 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.483519 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13e98e-1687-4473-adab-908acea0eee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.484457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13e98e-1687-4473-adab-908acea0eee5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.484742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13e98e-1687-4473-adab-908acea0eee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.485015 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13e98e-1687-4473-adab-908acea0eee5 None admin] PATH_INFO: `/v3/groups/20823663c72547cdb2aa7a83ad1bdde0` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.487472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13e98e-1687-4473-adab-908acea0eee5 None admin] RBAC: Authorizing `identity:get_group(group_id=20823663c72547cdb2aa7a83ad1bdde0)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.488959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13e98e-1687-4473-adab-908acea0eee5 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.491021 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 204/392] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:42 2022] GET /identity/v3/groups/20823663c72547cdb2aa7a83ad1bdde0 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:42.499079 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb76454-5636-46c0-8bfa-026985ac27d3 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.551508 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b902e7-981c-4a53-84de-e8ad366fe1b7 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.552147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b902e7-981c-4a53-84de-e8ad366fe1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.552626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b902e7-981c-4a53-84de-e8ad366fe1b7 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.555572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 205/393] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:42.560290 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523086e-0b53-4047-a870-075edcdc8ed0 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.560874 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523086e-0b53-4047-a870-075edcdc8ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.561417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523086e-0b53-4047-a870-075edcdc8ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.567851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:42.582026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-d523086e-0b53-4047-a870-075edcdc8ed0 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:42.583575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-d523086e-0b53-4047-a870-075edcdc8ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:42.622511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb76454-5636-46c0-8bfa-026985ac27d3 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.659825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b189f0-3174-4d54-8707-fc2ef9a000db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.660686 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b189f0-3174-4d54-8707-fc2ef9a000db None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.660971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b189f0-3174-4d54-8707-fc2ef9a000db None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.661280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b189f0-3174-4d54-8707-fc2ef9a000db None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.662617 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b189f0-3174-4d54-8707-fc2ef9a000db None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.664060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b189f0-3174-4d54-8707-fc2ef9a000db None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.666006 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 189/394] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:42 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:42.672026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b189f0-3174-4d54-8707-fc2ef9a000db None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.737241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:42.768930 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 206/395] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:42.813044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b189f0-3174-4d54-8707-fc2ef9a000db None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.838383 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523086e-0b53-4047-a870-075edcdc8ed0 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:42.881520 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05308ca2-bb70-452b-a197-156567f7e3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:42.882942 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05308ca2-bb70-452b-a197-156567f7e3cf None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:42.884523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05308ca2-bb70-452b-a197-156567f7e3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:42.885722 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05308ca2-bb70-452b-a197-156567f7e3cf None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da/groups/20823663c72547cdb2aa7a83ad1bdde0/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:42.891127 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05308ca2-bb70-452b-a197-156567f7e3cf None admin] RBAC: Authorizing `identity:create_grant(project_id=95ca3cd0264d43a2af05d5013692c2da, group_id=20823663c72547cdb2aa7a83ad1bdde0, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:42.893659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05308ca2-bb70-452b-a197-156567f7e3cf None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:42.973027 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523086e-0b53-4047-a870-075edcdc8ed0 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:42.989428 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 190/396] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Jun 16 14:43:42 2022] PUT /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da/groups/20823663c72547cdb2aa7a83ad1bdde0/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:43:43.035371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:43.043348 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b132ca-0c49-4688-be11-a9799df0005a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:43.044196 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b132ca-0c49-4688-be11-a9799df0005a None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.045191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b132ca-0c49-4688-be11-a9799df0005a None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.045191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b132ca-0c49-4688-be11-a9799df0005a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.065458 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b132ca-0c49-4688-be11-a9799df0005a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:43.078697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-c1b132ca-0c49-4688-be11-a9799df0005a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:43.078697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:43.078697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:43.078697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:43.078697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:43.078697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:43.078697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:43.078697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:43.078697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:43.078697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:43.078697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:43.078697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:43.078697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:43.078697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:43.078697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:43.078697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:43.079898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:43.079898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:43.079898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:43.079898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:43.079898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:43.079898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:43.079898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:43.079898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:43.079898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:43.079898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:43.079898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:43.079898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:43.079898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:43.079898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:43.079898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:43.079898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:43.080963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:43.080963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:43.080963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:43.080963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:43.080963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:43.080963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:43.080963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:43.080963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:43.080963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:43.080963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:43.080963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:43.080963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:43.080963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 207/397] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:43.088024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05308ca2-bb70-452b-a197-156567f7e3cf None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:43.231353 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05308ca2-bb70-452b-a197-156567f7e3cf None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:43.234312 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:43.272397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549269d-ac97-4a00-b4c1-c7300f95af1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:43.272580 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549269d-ac97-4a00-b4c1-c7300f95af1a None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.272809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549269d-ac97-4a00-b4c1-c7300f95af1a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.273047 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549269d-ac97-4a00-b4c1-c7300f95af1a None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.273831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549269d-ac97-4a00-b4c1-c7300f95af1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:43.274184 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549269d-ac97-4a00-b4c1-c7300f95af1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:43.276439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549269d-ac97-4a00-b4c1-c7300f95af1a None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:43.288098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 191/398] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:43.291198 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b132ca-0c49-4688-be11-a9799df0005a None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:43.415644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b132ca-0c49-4688-be11-a9799df0005a None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:43.455839 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bb894-50ea-40e0-9255-0ece54145c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:43.456715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bb894-50ea-40e0-9255-0ece54145c5e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.457006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bb894-50ea-40e0-9255-0ece54145c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.457351 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bb894-50ea-40e0-9255-0ece54145c5e None admin] PATH_INFO: `/v3/groups/20823663c72547cdb2aa7a83ad1bdde0` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.458546 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bb894-50ea-40e0-9255-0ece54145c5e None admin] RBAC: Authorizing `identity:get_group(group_id=20823663c72547cdb2aa7a83ad1bdde0)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:43.460020 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bb894-50ea-40e0-9255-0ece54145c5e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:43.461997 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 208/399] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:43 2022] GET /identity/v3/groups/20823663c72547cdb2aa7a83ad1bdde0 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:43.467290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549269d-ac97-4a00-b4c1-c7300f95af1a None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:43.587867 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549269d-ac97-4a00-b4c1-c7300f95af1a None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:43.627262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f4a63-b0b0-47c1-8284-33f2a4b33678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:43.628429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f4a63-b0b0-47c1-8284-33f2a4b33678 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.628917 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f4a63-b0b0-47c1-8284-33f2a4b33678 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.629408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f4a63-b0b0-47c1-8284-33f2a4b33678 None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.630876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f4a63-b0b0-47c1-8284-33f2a4b33678 None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:43.633115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472c8d2-3b4b-4442-b89f-199259aa05a1 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.633612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472c8d2-3b4b-4442-b89f-199259aa05a1 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.634066 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472c8d2-3b4b-4442-b89f-199259aa05a1 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.635609 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 209/400] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:43.637426 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f4a63-b0b0-47c1-8284-33f2a4b33678 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:43.639632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 192/401] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:43 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:43.641283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7196a0e-fc98-4d9d-83d8-5ca8e09e5940 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.641758 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7196a0e-fc98-4d9d-83d8-5ca8e09e5940 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.642215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7196a0e-fc98-4d9d-83d8-5ca8e09e5940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.655318 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f4a63-b0b0-47c1-8284-33f2a4b33678 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:43.669693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-c7196a0e-fc98-4d9d-83d8-5ca8e09e5940 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:43.671186 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c7196a0e-fc98-4d9d-83d8-5ca8e09e5940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:43.706079 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:43.784016 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f4a63-b0b0-47c1-8284-33f2a4b33678 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:43.786060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:43.814960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 210/402] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:43.845161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7196a0e-fc98-4d9d-83d8-5ca8e09e5940 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:43.863901 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353887a6-b9f1-46f0-a6bb-e867661c3b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:43.864808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353887a6-b9f1-46f0-a6bb-e867661c3b25 None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.865099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353887a6-b9f1-46f0-a6bb-e867661c3b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.865408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353887a6-b9f1-46f0-a6bb-e867661c3b25 None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f/groups/20823663c72547cdb2aa7a83ad1bdde0/roles/602eca0d730345ff8999a6bbd7124092` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:43.871230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353887a6-b9f1-46f0-a6bb-e867661c3b25 None admin] RBAC: Authorizing `identity:create_grant(project_id=54dee477b50d4b1283589452d92ce93f, group_id=20823663c72547cdb2aa7a83ad1bdde0, role_id=602eca0d730345ff8999a6bbd7124092)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:43.872692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353887a6-b9f1-46f0-a6bb-e867661c3b25 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:43.958814 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7196a0e-fc98-4d9d-83d8-5ca8e09e5940 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:43.993123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 193/403] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Jun 16 14:43:43 2022] PUT /identity/v3/projects/54dee477b50d4b1283589452d92ce93f/groups/20823663c72547cdb2aa7a83ad1bdde0/roles/602eca0d730345ff8999a6bbd7124092 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:43.995160 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6f421-6346-4b4a-a91e-391b0ff8c6e2 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:43.995761 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6f421-6346-4b4a-a91e-391b0ff8c6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:43.996293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6f421-6346-4b4a-a91e-391b0ff8c6e2 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.001515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 194/404] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:44.005909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b4c9-7209-48d1-8ca0-14e764d66579 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.008044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b4c9-7209-48d1-8ca0-14e764d66579 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.008044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b4c9-7209-48d1-8ca0-14e764d66579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.016252 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce4276-4133-449a-a69c-8887e2f3a840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:44.017155 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4276-4133-449a-a69c-8887e2f3a840 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.017450 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4276-4133-449a-a69c-8887e2f3a840 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.017727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4276-4133-449a-a69c-8887e2f3a840 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.029608 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-cb84b4c9-7209-48d1-8ca0-14e764d66579 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:44.031368 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-cb84b4c9-7209-48d1-8ca0-14e764d66579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:44.041971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce4276-4133-449a-a69c-8887e2f3a840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:44.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-99ce4276-4133-449a-a69c-8887e2f3a840 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:44.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:44.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:44.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:44.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:44.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:44.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:44.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:44.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:44.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:44.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:44.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:44.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:44.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:44.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:44.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:44.052324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:44.052324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:44.052324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:44.052324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:44.052324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:44.052324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:44.052324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:44.052324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:44.052324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:44.052324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:44.052324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:44.052324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:44.052324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:44.052324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:44.052324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:44.052324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:44.053114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:44.053114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:44.053114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:44.053114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:44.053114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:44.053114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:44.053114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:44.053114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:44.053114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:44.053114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:44.053114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:44.053114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:44.061730 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 211/405] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:44.067461 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce4276-4133-449a-a69c-8887e2f3a840 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:44.118113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 195/406] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:44.143783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84b4c9-7209-48d1-8ca0-14e764d66579 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:44.174892 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:44.176934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:44.275433 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84b4c9-7209-48d1-8ca0-14e764d66579 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:44.276266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce4276-4133-449a-a69c-8887e2f3a840 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:44.318155 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe11d3-129f-4f46-b589-60117fd64fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:44.318935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe11d3-129f-4f46-b589-60117fd64fee None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.319119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe11d3-129f-4f46-b589-60117fd64fee None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.319400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe11d3-129f-4f46-b589-60117fd64fee None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.320149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe11d3-129f-4f46-b589-60117fd64fee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:44.320461 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe11d3-129f-4f46-b589-60117fd64fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:44.321950 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe11d3-129f-4f46-b589-60117fd64fee None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:44.322596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b47ee8-9b65-428b-869a-17e746d5581c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:44.324390 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b47ee8-9b65-428b-869a-17e746d5581c None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.325311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b47ee8-9b65-428b-869a-17e746d5581c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.325769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b47ee8-9b65-428b-869a-17e746d5581c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.331608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 212/407] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:44.337396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe11d3-129f-4f46-b589-60117fd64fee None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:44.337945 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b47ee8-9b65-428b-869a-17e746d5581c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:44.346738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-02b47ee8-9b65-428b-869a-17e746d5581c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:44.346738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:44.346738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:44.346738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:44.346738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:44.346738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:44.346738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:44.346738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:44.346738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:44.346738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:44.346738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:44.346738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:44.346738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:44.346738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:44.346738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:44.346738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:44.347666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:44.347666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:44.347666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:44.347666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:44.347666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:44.347666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:44.347666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:44.347666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:44.347666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:44.347666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:44.347666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:44.347666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:44.347666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:44.347666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:44.347666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:44.347666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:44.348458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:44.348458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:44.348458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:44.348458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:44.348458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:44.348458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:44.348458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:44.348458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:44.348458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:44.348458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:44.348458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:44.348458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:44.351896 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 196/408] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:44.357808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b47ee8-9b65-428b-869a-17e746d5581c None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:44.450894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe11d3-129f-4f46-b589-60117fd64fee None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:44.456577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:44.466557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:44.474742 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b47ee8-9b65-428b-869a-17e746d5581c None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:44.489886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467c09a-2049-4f7f-a0f6-b171b1db080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:44.490827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c09a-2049-4f7f-a0f6-b171b1db080d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.491119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c09a-2049-4f7f-a0f6-b171b1db080d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.491398 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c09a-2049-4f7f-a0f6-b171b1db080d None admin] PATH_INFO: `/v3/groups/20823663c72547cdb2aa7a83ad1bdde0` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.492710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467c09a-2049-4f7f-a0f6-b171b1db080d None admin] RBAC: Authorizing `identity:get_group(group_id=20823663c72547cdb2aa7a83ad1bdde0)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:44.494627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467c09a-2049-4f7f-a0f6-b171b1db080d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:44.496929 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 213/409] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:44 2022] GET /identity/v3/groups/20823663c72547cdb2aa7a83ad1bdde0 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:44.502541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467c09a-2049-4f7f-a0f6-b171b1db080d None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:44.513013 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b57308-7df2-4ae2-b82f-0fe1253504aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:44.514090 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b57308-7df2-4ae2-b82f-0fe1253504aa None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.514572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b57308-7df2-4ae2-b82f-0fe1253504aa None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.515031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b57308-7df2-4ae2-b82f-0fe1253504aa None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.515949 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b57308-7df2-4ae2-b82f-0fe1253504aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:44.516534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b57308-7df2-4ae2-b82f-0fe1253504aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:44.518216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b57308-7df2-4ae2-b82f-0fe1253504aa None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:44.533159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 197/410] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:44.535093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b57308-7df2-4ae2-b82f-0fe1253504aa None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:44.621673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467c09a-2049-4f7f-a0f6-b171b1db080d None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:44.645217 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b57308-7df2-4ae2-b82f-0fe1253504aa None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:44.659723 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0aba3-baa5-47ac-ba4a-30a42939f859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:44.660781 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0aba3-baa5-47ac-ba4a-30a42939f859 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.661157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0aba3-baa5-47ac-ba4a-30a42939f859 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.661523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0aba3-baa5-47ac-ba4a-30a42939f859 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.662895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0aba3-baa5-47ac-ba4a-30a42939f859 None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:44.664420 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0aba3-baa5-47ac-ba4a-30a42939f859 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:44.666767 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 214/411] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:44 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:44.672398 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0aba3-baa5-47ac-ba4a-30a42939f859 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:44.689898 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327cc92-6d99-4766-9e84-68b02a823bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:44.691054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327cc92-6d99-4766-9e84-68b02a823bee None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.691514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327cc92-6d99-4766-9e84-68b02a823bee None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.691993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327cc92-6d99-4766-9e84-68b02a823bee None admin] PATH_INFO: `/v3/groups/40b62be8aa41464982bf061ce90d4ad0` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.697863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327cc92-6d99-4766-9e84-68b02a823bee None admin] RBAC: Authorizing `identity:get_group(group_id=40b62be8aa41464982bf061ce90d4ad0)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:44.700159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327cc92-6d99-4766-9e84-68b02a823bee None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:44.702240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 198/412] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:44 2022] GET /identity/v3/groups/40b62be8aa41464982bf061ce90d4ad0 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:44.707688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327cc92-6d99-4766-9e84-68b02a823bee None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:44.733518 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:44.733842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:44.780162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0aba3-baa5-47ac-ba4a-30a42939f859 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:44.820206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d067d-ca55-4fcb-9efc-4a9d217b82ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:44.821644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d067d-ca55-4fcb-9efc-4a9d217b82ef None admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.825215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d067d-ca55-4fcb-9efc-4a9d217b82ef None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.825677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d067d-ca55-4fcb-9efc-4a9d217b82ef None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da/groups/20823663c72547cdb2aa7a83ad1bdde0/roles/602eca0d730345ff8999a6bbd7124092` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.830287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d067d-ca55-4fcb-9efc-4a9d217b82ef None admin] RBAC: Authorizing `identity:create_grant(project_id=95ca3cd0264d43a2af05d5013692c2da, group_id=20823663c72547cdb2aa7a83ad1bdde0, role_id=602eca0d730345ff8999a6bbd7124092)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:44.832158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d067d-ca55-4fcb-9efc-4a9d217b82ef None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:44.905838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 215/413] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Jun 16 14:43:44 2022] PUT /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da/groups/20823663c72547cdb2aa7a83ad1bdde0/roles/602eca0d730345ff8999a6bbd7124092 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 14:43:44.907009 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327cc92-6d99-4766-9e84-68b02a823bee None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:44.964472 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14847c9-81f4-41bd-80d5-3f8c99845ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:44.965619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14847c9-81f4-41bd-80d5-3f8c99845ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:44.966049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14847c9-81f4-41bd-80d5-3f8c99845ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:44.966471 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14847c9-81f4-41bd-80d5-3f8c99845ca8 None admin] PATH_INFO: `/v3/projects/8bf0562aee55477696055292ce72d79e` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:44.974161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14847c9-81f4-41bd-80d5-3f8c99845ca8 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf0562aee55477696055292ce72d79e)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:44.976240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14847c9-81f4-41bd-80d5-3f8c99845ca8 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:44.978222 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 199/414] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:44 2022] GET /identity/v3/projects/8bf0562aee55477696055292ce72d79e => generated 344 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:44.983722 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d067d-ca55-4fcb-9efc-4a9d217b82ef None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:45.122502 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d067d-ca55-4fcb-9efc-4a9d217b82ef None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:45.138062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:45.175651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81572c-fe7c-4992-a415-5c2dfb31d3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:45.176630 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81572c-fe7c-4992-a415-5c2dfb31d3b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.176926 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81572c-fe7c-4992-a415-5c2dfb31d3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.177234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81572c-fe7c-4992-a415-5c2dfb31d3b4 None admin] PATH_INFO: `/v3/projects/8bf0562aee55477696055292ce72d79e/groups/40b62be8aa41464982bf061ce90d4ad0/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.179340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81572c-fe7c-4992-a415-5c2dfb31d3b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bf0562aee55477696055292ce72d79e, group_id=40b62be8aa41464982bf061ce90d4ad0, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:45.180856 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81572c-fe7c-4992-a415-5c2dfb31d3b4 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:45.274555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b885739-bfca-4eb7-bd29-f0a45b4fded9 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.274850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b885739-bfca-4eb7-bd29-f0a45b4fded9 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.275062 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b885739-bfca-4eb7-bd29-f0a45b4fded9 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.277609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 200/415] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:43:45.284701 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4b11a-296c-400a-b03c-1ed1ca6f17f2 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.284701 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4b11a-296c-400a-b03c-1ed1ca6f17f2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.284701 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4b11a-296c-400a-b03c-1ed1ca6f17f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.301158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 216/416] 10.222.0.23 () {58 vars in 1442 bytes} [Thu Jun 16 14:43:44 2022] PUT /identity/v3/projects/8bf0562aee55477696055292ce72d79e/groups/40b62be8aa41464982bf061ce90d4ad0/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:43:45.301461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-81d4b11a-296c-400a-b03c-1ed1ca6f17f2 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:45.302837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-81d4b11a-296c-400a-b03c-1ed1ca6f17f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:45.384965 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 201/417] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:45.409316 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81572c-fe7c-4992-a415-5c2dfb31d3b4 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:45.525195 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81572c-fe7c-4992-a415-5c2dfb31d3b4 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:45.561018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a44e61-071e-441e-a36b-0a0d3b056b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:45.561888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a44e61-071e-441e-a36b-0a0d3b056b42 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.562180 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a44e61-071e-441e-a36b-0a0d3b056b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.562464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a44e61-071e-441e-a36b-0a0d3b056b42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.575279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a44e61-071e-441e-a36b-0a0d3b056b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:45.583358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-b7a44e61-071e-441e-a36b-0a0d3b056b42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:45.583358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:45.583358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:45.583358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:45.583358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:45.583358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:45.583358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:45.583358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:45.583358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:45.583358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:45.583358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:45.583358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:45.583358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:45.583358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:45.583358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:45.583358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:45.584220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:45.584220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:45.584220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:45.584220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:45.584220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:45.584220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:45.584220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:45.584220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:45.584220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:45.584220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:45.584220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:45.584220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:45.584220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:45.584220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:45.584220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:45.584220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:45.585026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:45.585026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:45.585026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:45.585026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:45.585026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:45.585026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:45.585026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:45.585026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:45.585026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:45.585026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:45.585026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:45.585026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:45.585026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 217/418] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:45.591060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4b11a-296c-400a-b03c-1ed1ca6f17f2 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:45.606024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:45.716690 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f6484-693b-40f2-a967-bf1ade9c0d3e None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.716878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f6484-693b-40f2-a967-bf1ade9c0d3e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.717103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f6484-693b-40f2-a967-bf1ade9c0d3e None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.721246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 218/419] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:45.724361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2273-f9b7-4b3c-96fd-441f5c09ea46 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.724656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2273-f9b7-4b3c-96fd-441f5c09ea46 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.724943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2273-f9b7-4b3c-96fd-441f5c09ea46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.731236 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4b11a-296c-400a-b03c-1ed1ca6f17f2 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:45.742671 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-787c2273-f9b7-4b3c-96fd-441f5c09ea46 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:45.744272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-787c2273-f9b7-4b3c-96fd-441f5c09ea46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:45.779070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:45.796648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86982d3d-dc6b-47e7-b493-798c0a1aabc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:45.797364 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86982d3d-dc6b-47e7-b493-798c0a1aabc9 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:45.797660 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86982d3d-dc6b-47e7-b493-798c0a1aabc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:45.800017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86982d3d-dc6b-47e7-b493-798c0a1aabc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:45.800837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86982d3d-dc6b-47e7-b493-798c0a1aabc9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:45.802613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86982d3d-dc6b-47e7-b493-798c0a1aabc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:45.804031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86982d3d-dc6b-47e7-b493-798c0a1aabc9 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:45.825301 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 202/420] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:45.829666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86982d3d-dc6b-47e7-b493-798c0a1aabc9 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:45.867300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 219/421] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:45.931695 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2273-f9b7-4b3c-96fd-441f5c09ea46 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:45.970925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:46.020620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86982d3d-dc6b-47e7-b493-798c0a1aabc9 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:46.090856 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2273-f9b7-4b3c-96fd-441f5c09ea46 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:46.094465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6a6a6-f2cf-48db-991b-16a4fe96087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:46.095139 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6a6a6-f2cf-48db-991b-16a4fe96087b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.095430 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6a6a6-f2cf-48db-991b-16a4fe96087b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.095712 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6a6a6-f2cf-48db-991b-16a4fe96087b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.128562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5a11f-1459-4ce5-8dfa-0b7fbb808468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:46.129504 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5a11f-1459-4ce5-8dfa-0b7fbb808468 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.129797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5a11f-1459-4ce5-8dfa-0b7fbb808468 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.130078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5a11f-1459-4ce5-8dfa-0b7fbb808468 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.140527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5a11f-1459-4ce5-8dfa-0b7fbb808468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:46.148925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-efd5a11f-1459-4ce5-8dfa-0b7fbb808468 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:46.148925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:46.148925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:46.148925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:46.148925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:46.148925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:46.148925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:46.148925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:46.148925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:46.148925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:46.148925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:46.148925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:46.148925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:46.148925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:46.148925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:46.148925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:46.149846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:46.149846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:46.149846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:46.149846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:46.149846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:46.149846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:46.149846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:46.149846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:46.149846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:46.149846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:46.149846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:46.149846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:46.149846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:46.149846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:46.149846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:46.149846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:46.150644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:46.150644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:46.150644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:46.150644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:46.150644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:46.150644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:46.150644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:46.150644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:46.150644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:46.150644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:46.150644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 14:43:46.150644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:46.150644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 220/422] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:43:46.156644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5a11f-1459-4ce5-8dfa-0b7fbb808468 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:46.221313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6a6a6-f2cf-48db-991b-16a4fe96087b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:46.221888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:46.222767 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6a6a6-f2cf-48db-991b-16a4fe96087b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:46.295884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5a11f-1459-4ce5-8dfa-0b7fbb808468 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:46.348663 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:46.377805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 203/423] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:46.387127 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6a6a6-f2cf-48db-991b-16a4fe96087b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:46.387562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a3319-772d-4603-8606-90ae05b5815a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:46.388252 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a3319-772d-4603-8606-90ae05b5815a None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.388541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a3319-772d-4603-8606-90ae05b5815a None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.388833 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a3319-772d-4603-8606-90ae05b5815a None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.389651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a3319-772d-4603-8606-90ae05b5815a None admin] RBAC: Adding query filter params (name=member) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:46.389961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a3319-772d-4603-8606-90ae05b5815a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:46.392745 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a3319-772d-4603-8606-90ae05b5815a None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:46.412841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 221/424] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:43:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:46.416683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a3319-772d-4603-8606-90ae05b5815a None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:46.561549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:46.578861 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6a6a6-f2cf-48db-991b-16a4fe96087b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:46.587798 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a3319-772d-4603-8606-90ae05b5815a None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:46.624271 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc5214-ad0f-4863-beb4-a54ae2f643ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:46.625305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc5214-ad0f-4863-beb4-a54ae2f643ba None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.625774 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc5214-ad0f-4863-beb4-a54ae2f643ba None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.626212 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc5214-ad0f-4863-beb4-a54ae2f643ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.683432 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55d6c0-bc91-4949-9d9b-83fb26c99567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:46.684322 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55d6c0-bc91-4949-9d9b-83fb26c99567 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.684637 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55d6c0-bc91-4949-9d9b-83fb26c99567 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.684878 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55d6c0-bc91-4949-9d9b-83fb26c99567 None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.690028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55d6c0-bc91-4949-9d9b-83fb26c99567 None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:46.691489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55d6c0-bc91-4949-9d9b-83fb26c99567 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:46.693638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 204/425] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:46 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:46.700190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc5214-ad0f-4863-beb4-a54ae2f643ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:46.701872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc5214-ad0f-4863-beb4-a54ae2f643ba None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:46.702132 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55d6c0-bc91-4949-9d9b-83fb26c99567 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:46.790595 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:46.801601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:46.813652 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 222/426] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 14:43:46.815330 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6da3d-ecc6-47de-982a-b095706626e5 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.815330 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6da3d-ecc6-47de-982a-b095706626e5 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.815520 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6da3d-ecc6-47de-982a-b095706626e5 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.825595 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 223/427] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:46.825595 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6da3d-ecc6-47de-982a-b095706626e5 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:46.875540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55d6c0-bc91-4949-9d9b-83fb26c99567 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:46.914002 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d70acd-3d98-4bd2-952e-a07fba8311eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:46.915118 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d70acd-3d98-4bd2-952e-a07fba8311eb None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.915641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d70acd-3d98-4bd2-952e-a07fba8311eb None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.916169 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d70acd-3d98-4bd2-952e-a07fba8311eb None admin] PATH_INFO: `/v3/groups/20823663c72547cdb2aa7a83ad1bdde0` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.918135 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d70acd-3d98-4bd2-952e-a07fba8311eb None admin] RBAC: Authorizing `identity:get_group(group_id=20823663c72547cdb2aa7a83ad1bdde0)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:46.919955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d70acd-3d98-4bd2-952e-a07fba8311eb None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:46.926923 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 205/428] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:46 2022] GET /identity/v3/groups/20823663c72547cdb2aa7a83ad1bdde0 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:46.928632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e8be1-97b7-4094-9c92-3c70bde1f95c None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.929148 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e8be1-97b7-4094-9c92-3c70bde1f95c None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.929748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e8be1-97b7-4094-9c92-3c70bde1f95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.941567 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6da3d-ecc6-47de-982a-b095706626e5 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:46.950597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-4b3e8be1-97b7-4094-9c92-3c70bde1f95c None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:46.952105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4b3e8be1-97b7-4094-9c92-3c70bde1f95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:46.979525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc6ebc-ae41-4452-a602-55ae68ef6b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:46.980975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc6ebc-ae41-4452-a602-55ae68ef6b30 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:46.981311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc6ebc-ae41-4452-a602-55ae68ef6b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:46.981594 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc6ebc-ae41-4452-a602-55ae68ef6b30 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:46.982835 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc6ebc-ae41-4452-a602-55ae68ef6b30 None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:46.984294 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc6ebc-ae41-4452-a602-55ae68ef6b30 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:46.986332 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 224/429] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:46 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:46.987183 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc6ebc-ae41-4452-a602-55ae68ef6b30 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.041355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 206/430] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:47.042531 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e8be1-97b7-4094-9c92-3c70bde1f95c None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.044625 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:47.097890 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc6ebc-ae41-4452-a602-55ae68ef6b30 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:47.103770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:47.135109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4739016-5d99-4dd9-be9a-0df5d3467c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:47.135680 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4739016-5d99-4dd9-be9a-0df5d3467c48 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.135978 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4739016-5d99-4dd9-be9a-0df5d3467c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.136259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4739016-5d99-4dd9-be9a-0df5d3467c48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.137144 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4739016-5d99-4dd9-be9a-0df5d3467c48 None admin] RBAC: Adding query filter params (group.id=20823663c72547cdb2aa7a83ad1bdde0, role.id=6832f9f0b207495a9a247504bcb6b49f, scope.project.id=54dee477b50d4b1283589452d92ce93f) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:47.137755 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4739016-5d99-4dd9-be9a-0df5d3467c48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:47.139666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4739016-5d99-4dd9-be9a-0df5d3467c48 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:47.145978 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 225/431] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 16 14:43:46 2022] GET /identity/v3/role_assignments?group.id=20823663c72547cdb2aa7a83ad1bdde0&scope.project.id=54dee477b50d4b1283589452d92ce93f&role.id=6832f9f0b207495a9a247504bcb6b49f => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:47.146844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4739016-5d99-4dd9-be9a-0df5d3467c48 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.169645 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e8be1-97b7-4094-9c92-3c70bde1f95c None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:47.208716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c99f07-a155-4b97-9225-bfbd82fbbe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:47.209949 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c99f07-a155-4b97-9225-bfbd82fbbe3c None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.210411 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c99f07-a155-4b97-9225-bfbd82fbbe3c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.210968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c99f07-a155-4b97-9225-bfbd82fbbe3c None admin] PATH_INFO: `/v3/groups/20823663c72547cdb2aa7a83ad1bdde0` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.212497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c99f07-a155-4b97-9225-bfbd82fbbe3c None admin] RBAC: Authorizing `identity:get_group(group_id=20823663c72547cdb2aa7a83ad1bdde0)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:47.214154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c99f07-a155-4b97-9225-bfbd82fbbe3c None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:47.216534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 207/432] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:47 2022] GET /identity/v3/groups/20823663c72547cdb2aa7a83ad1bdde0 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:47.225099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c99f07-a155-4b97-9225-bfbd82fbbe3c None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.280711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4739016-5d99-4dd9-be9a-0df5d3467c48 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:47.301703 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:47.320895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18f843-b71e-45ee-9907-d1d5eb22dab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:47.322176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18f843-b71e-45ee-9907-d1d5eb22dab1 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.322664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18f843-b71e-45ee-9907-d1d5eb22dab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.323168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18f843-b71e-45ee-9907-d1d5eb22dab1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.336293 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18f843-b71e-45ee-9907-d1d5eb22dab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:47.346627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-6d18f843-b71e-45ee-9907-d1d5eb22dab1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:47.346627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:47.346627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:47.346627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:47.346627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:47.346627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:47.346627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:47.346627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:47.346627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:47.346627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:47.346627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:47.346627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:47.346627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:47.346627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:47.346627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:47.346627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:47.347560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:47.347560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:47.347560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:47.347560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:47.347560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:47.347560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:47.347560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:47.347560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:47.347560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:47.347560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:47.347560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:47.347560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:47.347560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:47.347560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:47.347560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:47.347560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:47.348364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:47.348364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:47.348364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:47.348364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:47.348364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:47.348364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:47.348364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:47.348364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:47.348364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:47.348364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:47.348364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:47.348364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:47.350846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 226/433] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:47.357964 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18f843-b71e-45ee-9907-d1d5eb22dab1 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.422731 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c99f07-a155-4b97-9225-bfbd82fbbe3c None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:47.434775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:47.472868 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c6124-c584-4e25-97b3-37b6b2ba3f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:47.473586 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c6124-c584-4e25-97b3-37b6b2ba3f15 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.473877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c6124-c584-4e25-97b3-37b6b2ba3f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.474160 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c6124-c584-4e25-97b3-37b6b2ba3f15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.475012 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c6124-c584-4e25-97b3-37b6b2ba3f15 None admin] RBAC: Adding query filter params (group.id=20823663c72547cdb2aa7a83ad1bdde0, role.id=6832f9f0b207495a9a247504bcb6b49f, scope.project.id=95ca3cd0264d43a2af05d5013692c2da) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:47.475331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c6124-c584-4e25-97b3-37b6b2ba3f15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:47.476834 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c6124-c584-4e25-97b3-37b6b2ba3f15 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:47.485314 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 208/434] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 16 14:43:47 2022] GET /identity/v3/role_assignments?group.id=20823663c72547cdb2aa7a83ad1bdde0&scope.project.id=95ca3cd0264d43a2af05d5013692c2da&role.id=6832f9f0b207495a9a247504bcb6b49f => generated 611 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:47.491659 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18f843-b71e-45ee-9907-d1d5eb22dab1 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:47.534004 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11920005-e6b0-4aab-9b4a-7ffda5fc06fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:47.534710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11920005-e6b0-4aab-9b4a-7ffda5fc06fb None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.534997 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11920005-e6b0-4aab-9b4a-7ffda5fc06fb None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.535271 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11920005-e6b0-4aab-9b4a-7ffda5fc06fb None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.536044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11920005-e6b0-4aab-9b4a-7ffda5fc06fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:47.536354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11920005-e6b0-4aab-9b4a-7ffda5fc06fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:47.537812 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11920005-e6b0-4aab-9b4a-7ffda5fc06fb None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:47.547701 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 227/435] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:47.553610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c6124-c584-4e25-97b3-37b6b2ba3f15 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.556100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204fa6a-62d8-45b7-bbec-64a93ef4608e None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.556393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204fa6a-62d8-45b7-bbec-64a93ef4608e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.556949 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204fa6a-62d8-45b7-bbec-64a93ef4608e None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.559789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 228/436] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:47.565173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c4ce5-6823-4fa9-8b5c-9ff441a223c6 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.565524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c4ce5-6823-4fa9-8b5c-9ff441a223c6 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.565763 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c4ce5-6823-4fa9-8b5c-9ff441a223c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.588954 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-379c4ce5-6823-4fa9-8b5c-9ff441a223c6 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:47.591366 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-379c4ce5-6823-4fa9-8b5c-9ff441a223c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:47.628079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:47.679050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 229/437] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:47.689654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c6124-c584-4e25-97b3-37b6b2ba3f15 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:47.704890 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c4ce5-6823-4fa9-8b5c-9ff441a223c6 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.738463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f80f6-3fe5-4e08-a966-b82ac832654e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:47.739137 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f80f6-3fe5-4e08-a966-b82ac832654e None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.739536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f80f6-3fe5-4e08-a966-b82ac832654e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.739835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f80f6-3fe5-4e08-a966-b82ac832654e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.797571 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:47.825689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f80f6-3fe5-4e08-a966-b82ac832654e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:47.826902 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c4ce5-6823-4fa9-8b5c-9ff441a223c6 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:47.827162 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f80f6-3fe5-4e08-a966-b82ac832654e None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:47.877266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711df854-d544-49d7-8c77-2a61f4a81021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:47.878214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df854-d544-49d7-8c77-2a61f4a81021 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:47.878507 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df854-d544-49d7-8c77-2a61f4a81021 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:47.878789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df854-d544-49d7-8c77-2a61f4a81021 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:47.894108 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711df854-d544-49d7-8c77-2a61f4a81021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:47.904016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-711df854-d544-49d7-8c77-2a61f4a81021 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:47.904016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:47.904016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:47.904016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:47.904016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:47.904016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:47.904016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:47.904016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:47.904016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:47.904016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:47.904016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:47.904016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:47.904016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:47.904016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:47.904016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:47.904016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:47.907927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:47.907927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:47.907927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:47.907927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:47.907927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:47.907927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:47.907927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:47.907927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:47.907927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:47.907927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:47.907927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:47.907927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:47.907927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:47.907927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:47.907927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:47.907927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:47.908760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:47.908760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:47.908760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:47.908760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:47.908760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:47.908760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:47.908760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:47.908760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:47.908760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:47.908760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:47.908760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:47.908760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:47.908760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 230/438] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:47.911482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711df854-d544-49d7-8c77-2a61f4a81021 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:47.941001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:47.950870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 209/439] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:47.956273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f80f6-3fe5-4e08-a966-b82ac832654e None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.035090 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.038987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711df854-d544-49d7-8c77-2a61f4a81021 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.065283 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f80f6-3fe5-4e08-a966-b82ac832654e None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.073753 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1437c8-8359-4c82-b26d-4c866a00a0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.074968 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1437c8-8359-4c82-b26d-4c866a00a0fd None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.075256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1437c8-8359-4c82-b26d-4c866a00a0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.075535 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1437c8-8359-4c82-b26d-4c866a00a0fd None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.076285 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1437c8-8359-4c82-b26d-4c866a00a0fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:48.076599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1437c8-8359-4c82-b26d-4c866a00a0fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.078007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1437c8-8359-4c82-b26d-4c866a00a0fd None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.085899 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 231/440] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:48.089176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15ec41-1a45-4e19-a27d-e48488dc1ac9 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.089481 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15ec41-1a45-4e19-a27d-e48488dc1ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.090348 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15ec41-1a45-4e19-a27d-e48488dc1ac9 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.091614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 232/441] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:48.092308 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15ec41-1a45-4e19-a27d-e48488dc1ac9 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.100833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85030fab-ce5c-49e5-aca1-41043719375b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.101766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85030fab-ce5c-49e5-aca1-41043719375b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.102055 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85030fab-ce5c-49e5-aca1-41043719375b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.102336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85030fab-ce5c-49e5-aca1-41043719375b None admin] PATH_INFO: `/v3/projects/54dee477b50d4b1283589452d92ce93f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.103519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85030fab-ce5c-49e5-aca1-41043719375b None admin] RBAC: Authorizing `identity:get_project(project_id=54dee477b50d4b1283589452d92ce93f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.104958 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85030fab-ce5c-49e5-aca1-41043719375b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.107007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 210/442] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:47 2022] GET /identity/v3/projects/54dee477b50d4b1283589452d92ce93f => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:48.108226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573adfa-1a9a-4f59-bbda-a3d8c8ddf056 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.108505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573adfa-1a9a-4f59-bbda-a3d8c8ddf056 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.108784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573adfa-1a9a-4f59-bbda-a3d8c8ddf056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.124981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-3573adfa-1a9a-4f59-bbda-a3d8c8ddf056 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:48.126188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3573adfa-1a9a-4f59-bbda-a3d8c8ddf056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:48.181685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.193053 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 211/443] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:48.193842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573adfa-1a9a-4f59-bbda-a3d8c8ddf056 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.197477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15ec41-1a45-4e19-a27d-e48488dc1ac9 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.232482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df387a24-6251-4000-85a9-6503dd3df41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.233143 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df387a24-6251-4000-85a9-6503dd3df41e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.233442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df387a24-6251-4000-85a9-6503dd3df41e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.233722 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df387a24-6251-4000-85a9-6503dd3df41e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.263138 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.292700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573adfa-1a9a-4f59-bbda-a3d8c8ddf056 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.301955 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df387a24-6251-4000-85a9-6503dd3df41e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.303201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df387a24-6251-4000-85a9-6503dd3df41e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.325842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2abeaf-d1fb-434d-958e-92a8a7596d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.326697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2abeaf-d1fb-434d-958e-92a8a7596d2a None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.326981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2abeaf-d1fb-434d-958e-92a8a7596d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.327256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2abeaf-d1fb-434d-958e-92a8a7596d2a None admin] PATH_INFO: `/v3/groups/20823663c72547cdb2aa7a83ad1bdde0` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.328429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2abeaf-d1fb-434d-958e-92a8a7596d2a None admin] RBAC: Authorizing `identity:get_group(group_id=20823663c72547cdb2aa7a83ad1bdde0)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.329892 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2abeaf-d1fb-434d-958e-92a8a7596d2a None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.331492 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 212/444] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/groups/20823663c72547cdb2aa7a83ad1bdde0 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:48.332327 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2abeaf-d1fb-434d-958e-92a8a7596d2a None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.384945 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.400883 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 233/445] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:48.401978 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df387a24-6251-4000-85a9-6503dd3df41e None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.432249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2abeaf-d1fb-434d-958e-92a8a7596d2a None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.465785 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3e2ef-36a6-4fa0-9861-d7aa4d7d6116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.466502 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3e2ef-36a6-4fa0-9861-d7aa4d7d6116 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.466787 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3e2ef-36a6-4fa0-9861-d7aa4d7d6116 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.467065 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3e2ef-36a6-4fa0-9861-d7aa4d7d6116 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.473866 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.477744 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3e2ef-36a6-4fa0-9861-d7aa4d7d6116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:48.485659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-3de3e2ef-36a6-4fa0-9861-d7aa4d7d6116 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:48.485659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:48.485659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:48.485659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:48.485659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:48.485659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:48.485659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:48.485659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:48.485659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:48.485659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:48.485659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:48.485659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:48.485659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:48.485659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:48.485659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:48.485659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:48.490273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:48.490273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:48.490273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:48.490273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:48.490273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:48.490273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:48.490273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:48.490273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:48.490273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:48.490273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:48.490273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:48.490273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:48.490273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:48.490273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:48.490273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:48.490273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:48.491076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:48.491076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:48.491076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:48.491076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:48.491076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:48.491076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:48.491076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:48.491076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:48.491076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:48.491076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:48.491076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:43:48.491076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:48.491076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 213/446] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:48.491076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3e2ef-36a6-4fa0-9861-d7aa4d7d6116 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.502025 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df387a24-6251-4000-85a9-6503dd3df41e None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.535438 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156818c-14ea-4b2f-9546-7c697ae257d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.536094 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156818c-14ea-4b2f-9546-7c697ae257d0 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.536376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156818c-14ea-4b2f-9546-7c697ae257d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.536650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156818c-14ea-4b2f-9546-7c697ae257d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.537512 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156818c-14ea-4b2f-9546-7c697ae257d0 None admin] RBAC: Adding query filter params (group.id=20823663c72547cdb2aa7a83ad1bdde0, role.id=602eca0d730345ff8999a6bbd7124092, scope.project.id=54dee477b50d4b1283589452d92ce93f) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:48.537822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156818c-14ea-4b2f-9546-7c697ae257d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.539241 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156818c-14ea-4b2f-9546-7c697ae257d0 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.545261 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 234/447] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/role_assignments?group.id=20823663c72547cdb2aa7a83ad1bdde0&scope.project.id=54dee477b50d4b1283589452d92ce93f&role.id=602eca0d730345ff8999a6bbd7124092 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:48.545973 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156818c-14ea-4b2f-9546-7c697ae257d0 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.599017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3e2ef-36a6-4fa0-9861-d7aa4d7d6116 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.611706 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.643998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c02df-c378-43c3-acfc-d6c843d63da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.645396 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c02df-c378-43c3-acfc-d6c843d63da7 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.645837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c02df-c378-43c3-acfc-d6c843d63da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.646269 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c02df-c378-43c3-acfc-d6c843d63da7 None admin] PATH_INFO: `/v3/projects/95ca3cd0264d43a2af05d5013692c2da` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.647702 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c02df-c378-43c3-acfc-d6c843d63da7 None admin] RBAC: Authorizing `identity:get_project(project_id=95ca3cd0264d43a2af05d5013692c2da)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.649310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c02df-c378-43c3-acfc-d6c843d63da7 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.656223 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 214/448] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/projects/95ca3cd0264d43a2af05d5013692c2da => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:48.657886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c02df-c378-43c3-acfc-d6c843d63da7 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.675919 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156818c-14ea-4b2f-9546-7c697ae257d0 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.715005 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961b67d-7351-478d-8737-6dbbe1da2155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.715687 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961b67d-7351-478d-8737-6dbbe1da2155 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.716019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961b67d-7351-478d-8737-6dbbe1da2155 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.716242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961b67d-7351-478d-8737-6dbbe1da2155 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.716993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961b67d-7351-478d-8737-6dbbe1da2155 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:48.717346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961b67d-7351-478d-8737-6dbbe1da2155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.718724 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961b67d-7351-478d-8737-6dbbe1da2155 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.728909 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 235/449] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:48.734175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.734551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961b67d-7351-478d-8737-6dbbe1da2155 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.770678 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c02df-c378-43c3-acfc-d6c843d63da7 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.813162 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04b27c-bc13-4ee4-9eab-e97b32400fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.814117 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04b27c-bc13-4ee4-9eab-e97b32400fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.814359 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04b27c-bc13-4ee4-9eab-e97b32400fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.814648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04b27c-bc13-4ee4-9eab-e97b32400fe1 None admin] PATH_INFO: `/v3/groups/20823663c72547cdb2aa7a83ad1bdde0` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.815844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04b27c-bc13-4ee4-9eab-e97b32400fe1 None admin] RBAC: Authorizing `identity:get_group(group_id=20823663c72547cdb2aa7a83ad1bdde0)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.817320 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04b27c-bc13-4ee4-9eab-e97b32400fe1 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:48.819335 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 215/450] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/groups/20823663c72547cdb2aa7a83ad1bdde0 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:48.825698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04b27c-bc13-4ee4-9eab-e97b32400fe1 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:48.860303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961b67d-7351-478d-8737-6dbbe1da2155 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.877247 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:48.909929 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c599e11-91aa-470a-9bd3-bfef915f5f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.910603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c599e11-91aa-470a-9bd3-bfef915f5f0c None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.910891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c599e11-91aa-470a-9bd3-bfef915f5f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.911176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c599e11-91aa-470a-9bd3-bfef915f5f0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.948770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04b27c-bc13-4ee4-9eab-e97b32400fe1 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:48.995213 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90296ce-2520-4e3c-8450-c081a589f1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:48.995928 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90296ce-2520-4e3c-8450-c081a589f1bb None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:48.996838 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90296ce-2520-4e3c-8450-c081a589f1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:48.997119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90296ce-2520-4e3c-8450-c081a589f1bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:48.998228 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90296ce-2520-4e3c-8450-c081a589f1bb None admin] RBAC: Adding query filter params (group.id=20823663c72547cdb2aa7a83ad1bdde0, role.id=602eca0d730345ff8999a6bbd7124092, scope.project.id=95ca3cd0264d43a2af05d5013692c2da) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:48.998412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90296ce-2520-4e3c-8450-c081a589f1bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:48.999936 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90296ce-2520-4e3c-8450-c081a589f1bb None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:49.001676 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c599e11-91aa-470a-9bd3-bfef915f5f0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:49.002111 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:49.003441 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c599e11-91aa-470a-9bd3-bfef915f5f0c None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:49.007170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 216/451] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/role_assignments?group.id=20823663c72547cdb2aa7a83ad1bdde0&scope.project.id=95ca3cd0264d43a2af05d5013692c2da&role.id=602eca0d730345ff8999a6bbd7124092 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:49.130233 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 236/452] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 14:43:49.136152 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90296ce-2520-4e3c-8450-c081a589f1bb None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:49.242948 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90296ce-2520-4e3c-8450-c081a589f1bb None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:49.275821 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ab912-2abd-4ab0-a779-1b004765f339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:49.276970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ab912-2abd-4ab0-a779-1b004765f339 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:49.277834 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ab912-2abd-4ab0-a779-1b004765f339 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:49.278121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ab912-2abd-4ab0-a779-1b004765f339 None admin] PATH_INFO: `/v3/projects/8bf0562aee55477696055292ce72d79e` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:49.279437 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ab912-2abd-4ab0-a779-1b004765f339 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf0562aee55477696055292ce72d79e)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:49.281518 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ab912-2abd-4ab0-a779-1b004765f339 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:49.284260 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 217/453] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:43:49 2022] GET /identity/v3/projects/8bf0562aee55477696055292ce72d79e => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:49.289828 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c599e11-91aa-470a-9bd3-bfef915f5f0c None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:49.306202 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:49.391838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c599e11-91aa-470a-9bd3-bfef915f5f0c None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:49.427075 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179a37d-fac9-4470-b8f8-7ac7b722aa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:49.427928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179a37d-fac9-4470-b8f8-7ac7b722aa5b None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:49.428216 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179a37d-fac9-4470-b8f8-7ac7b722aa5b None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:49.428494 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179a37d-fac9-4470-b8f8-7ac7b722aa5b None admin] PATH_INFO: `/v3/groups/40b62be8aa41464982bf061ce90d4ad0` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:49.429668 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179a37d-fac9-4470-b8f8-7ac7b722aa5b None admin] RBAC: Authorizing `identity:get_group(group_id=40b62be8aa41464982bf061ce90d4ad0)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:49.431107 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179a37d-fac9-4470-b8f8-7ac7b722aa5b None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:49.432709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 237/454] 10.222.0.23 () {56 vars in 1180 bytes} [Thu Jun 16 14:43:49 2022] GET /identity/v3/groups/40b62be8aa41464982bf061ce90d4ad0 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:49.438717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ab912-2abd-4ab0-a779-1b004765f339 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:49.502727 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:49.535950 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ab912-2abd-4ab0-a779-1b004765f339 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:49.568711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16d665-a37a-423d-808a-e5941b2956f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:49.569389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16d665-a37a-423d-808a-e5941b2956f1 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:49.569682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16d665-a37a-423d-808a-e5941b2956f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:49.569963 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16d665-a37a-423d-808a-e5941b2956f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:49.570785 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16d665-a37a-423d-808a-e5941b2956f1 None admin] RBAC: Adding query filter params (group.id=40b62be8aa41464982bf061ce90d4ad0, role.id=c865040abd6c4b099381557da21c471d, scope.project.id=8bf0562aee55477696055292ce72d79e) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:49.571102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16d665-a37a-423d-808a-e5941b2956f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:49.572538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16d665-a37a-423d-808a-e5941b2956f1 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:49.579830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 218/455] 10.222.0.23 () {56 vars in 1376 bytes} [Thu Jun 16 14:43:49 2022] GET /identity/v3/role_assignments?group.id=40b62be8aa41464982bf061ce90d4ad0&scope.project.id=8bf0562aee55477696055292ce72d79e&role.id=c865040abd6c4b099381557da21c471d => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:52.394796 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd165f3-b40d-461c-a2a9-3df98ef37e23 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:52.395303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd165f3-b40d-461c-a2a9-3df98ef37e23 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:52.395303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd165f3-b40d-461c-a2a9-3df98ef37e23 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:52.396832 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 238/456] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:52.403179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881751a-ce3c-46f7-8d7e-c89efc24e050 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:52.403988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881751a-ce3c-46f7-8d7e-c89efc24e050 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:52.404465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881751a-ce3c-46f7-8d7e-c89efc24e050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:52.424961 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-f881751a-ce3c-46f7-8d7e-c89efc24e050 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:52.426541 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f881751a-ce3c-46f7-8d7e-c89efc24e050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:52.522756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 219/457] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:52.562006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd165f3-b40d-461c-a2a9-3df98ef37e23 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:52.682275 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:52.709782 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd165f3-b40d-461c-a2a9-3df98ef37e23 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:52.755386 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790be957-37b2-4370-b2ba-3841db86a94d None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:52.755674 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790be957-37b2-4370-b2ba-3841db86a94d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:52.756198 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790be957-37b2-4370-b2ba-3841db86a94d None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:52.759584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cf188-5923-4962-904f-612e5d1917c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:52.760383 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cf188-5923-4962-904f-612e5d1917c7 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:52.760642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 220/458] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:52.760771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cf188-5923-4962-904f-612e5d1917c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:52.760971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cf188-5923-4962-904f-612e5d1917c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:52.765794 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e2b62-ec3d-4a91-87b0-19c642e3ef50 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:52.766080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e2b62-ec3d-4a91-87b0-19c642e3ef50 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:52.766358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e2b62-ec3d-4a91-87b0-19c642e3ef50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:52.780248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cf188-5923-4962-904f-612e5d1917c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:52.781736 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cf188-5923-4962-904f-612e5d1917c7 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:52.798282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-416e2b62-ec3d-4a91-87b0-19c642e3ef50 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:52.799828 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-416e2b62-ec3d-4a91-87b0-19c642e3ef50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:52.810650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-432cf188-5923-4962-904f-612e5d1917c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:52.810650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:52.810650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:52.810650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:52.810650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:52.810650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:52.810650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:52.810650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:52.810650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:52.810650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:52.810650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:52.810650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:52.810650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:52.810650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:52.810650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:52.811710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:52.812757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:52.812757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:52.812757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:52.812757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:52.812757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 239/459] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:52.814297 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3803a4-54e4-48a7-abbb-d1bb985e627e None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:52.814746 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3803a4-54e4-48a7-abbb-d1bb985e627e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:52.815165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3803a4-54e4-48a7-abbb-d1bb985e627e None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:52.821223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 240/460] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:52.822328 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3803a4-54e4-48a7-abbb-d1bb985e627e None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:52.878730 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:52.893913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 221/461] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:43:52.895442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b34e1-ea99-4a7d-86de-84ac5ba524f8 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:52.895889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b34e1-ea99-4a7d-86de-84ac5ba524f8 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:52.896323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b34e1-ea99-4a7d-86de-84ac5ba524f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:52.915772 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-b14b34e1-ea99-4a7d-86de-84ac5ba524f8 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:52.918017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b14b34e1-ea99-4a7d-86de-84ac5ba524f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:52.964889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3803a4-54e4-48a7-abbb-d1bb985e627e None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:53.009538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:53.015255 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e53f79-1c3d-4bbe-ae24-c22103317b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:53.015765 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 222/462] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:53.015921 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e53f79-1c3d-4bbe-ae24-c22103317b11 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.016205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e53f79-1c3d-4bbe-ae24-c22103317b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.016486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e53f79-1c3d-4bbe-ae24-c22103317b11 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.022584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e53f79-1c3d-4bbe-ae24-c22103317b11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:53.022584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e53f79-1c3d-4bbe-ae24-c22103317b11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:53.022584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e53f79-1c3d-4bbe-ae24-c22103317b11 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:53.022797 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b34e1-ea99-4a7d-86de-84ac5ba524f8 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:53.041327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 241/463] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:53.042910 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcee03-4ab4-4d36-9b52-6075dc2618e3 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.043238 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcee03-4ab4-4d36-9b52-6075dc2618e3 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.043525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcee03-4ab4-4d36-9b52-6075dc2618e3 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.044948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 242/464] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:53.046465 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34224a9a-af25-46c0-b444-d5af11675c56 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.046764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34224a9a-af25-46c0-b444-d5af11675c56 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.047044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34224a9a-af25-46c0-b444-d5af11675c56 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.048599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 243/465] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:53.050029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34224a9a-af25-46c0-b444-d5af11675c56 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:53.129530 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b34e1-ea99-4a7d-86de-84ac5ba524f8 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:53.149327 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:53.155960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34224a9a-af25-46c0-b444-d5af11675c56 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:53.162961 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f0579-333b-4a5f-86b4-38e0b6a073c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:53.165311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f0579-333b-4a5f-86b4-38e0b6a073c1 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.165311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f0579-333b-4a5f-86b4-38e0b6a073c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.165311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f0579-333b-4a5f-86b4-38e0b6a073c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.174238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f0579-333b-4a5f-86b4-38e0b6a073c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:53.176041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f0579-333b-4a5f-86b4-38e0b6a073c1 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:53.190059 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fc516-9b10-408d-b80a-b70283d73be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:53.190724 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fc516-9b10-408d-b80a-b70283d73be4 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.191012 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fc516-9b10-408d-b80a-b70283d73be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.191289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fc516-9b10-408d-b80a-b70283d73be4 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.191984 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fc516-9b10-408d-b80a-b70283d73be4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:53.193448 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fc516-9b10-408d-b80a-b70283d73be4 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:53.194241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-3b0f0579-333b-4a5f-86b4-38e0b6a073c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:53.194241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:53.194241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:53.194241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:53.194241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:53.194241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:53.194241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:53.194241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:53.194241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:53.194241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:53.194241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:53.194241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:53.194241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:53.194241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:53.194241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:53.195183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:53.196294 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:53.196294 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:53.196294 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:53.196294 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:53.196294 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 223/466] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:53.196723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f0579-333b-4a5f-86b4-38e0b6a073c1 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:53.272316 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 244/467] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:53 2022] POST /identity/v3/users => generated 246 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:53.273653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68b27c-60a9-445c-ac5e-b487fdd6f5ea None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.273901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68b27c-60a9-445c-ac5e-b487fdd6f5ea None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.274183 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68b27c-60a9-445c-ac5e-b487fdd6f5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.295201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f0579-333b-4a5f-86b4-38e0b6a073c1 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:53.302884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-eb68b27c-60a9-445c-ac5e-b487fdd6f5ea None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:53.305287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-eb68b27c-60a9-445c-ac5e-b487fdd6f5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:53.335369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbb94b-f846-4cd1-aab0-d27e1294d8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:53.336191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbb94b-f846-4cd1-aab0-d27e1294d8bd None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.336483 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbb94b-f846-4cd1-aab0-d27e1294d8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.336768 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbb94b-f846-4cd1-aab0-d27e1294d8bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.348211 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbb94b-f846-4cd1-aab0-d27e1294d8bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:53.349758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bbb94b-f846-4cd1-aab0-d27e1294d8bd None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:53.359683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:53.369638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-39bbb94b-f846-4cd1-aab0-d27e1294d8bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:53.369638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:53.369638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:53.369638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:53.369638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:53.369638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:53.369638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:53.369638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:53.369638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:53.369638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:53.369638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:53.369638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:53.369638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:53.369638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:53.369638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:53.377983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:53.378817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:53.378817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:53.378817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:53.378817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:53.378817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 224/468] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:53.378817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbf2d6-edf6-4f43-8cfa-4737e3a682e5 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.378817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbf2d6-edf6-4f43-8cfa-4737e3a682e5 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.378817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbf2d6-edf6-4f43-8cfa-4737e3a682e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.392214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-8acbf2d6-edf6-4f43-8cfa-4737e3a682e5 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:53.392214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-8acbf2d6-edf6-4f43-8cfa-4737e3a682e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:53.402702 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 245/469] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:53.403850 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68b27c-60a9-445c-ac5e-b487fdd6f5ea None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:53.427300 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:53.485250 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 225/470] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:53.490008 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbf2d6-edf6-4f43-8cfa-4737e3a682e5 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:53.518048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68b27c-60a9-445c-ac5e-b487fdd6f5ea None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:53.556329 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1fe39-5409-4b46-bc29-f528fe67791b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:53.556914 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1fe39-5409-4b46-bc29-f528fe67791b None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.557225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1fe39-5409-4b46-bc29-f528fe67791b None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.557506 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1fe39-5409-4b46-bc29-f528fe67791b None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.558402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1fe39-5409-4b46-bc29-f528fe67791b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:53.558711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1fe39-5409-4b46-bc29-f528fe67791b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:53.561155 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1fe39-5409-4b46-bc29-f528fe67791b None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:53.573162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 246/471] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:53.573895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1fe39-5409-4b46-bc29-f528fe67791b None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:53.597229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbf2d6-edf6-4f43-8cfa-4737e3a682e5 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:53.617576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:53.637221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7776f-03ed-4169-84fd-46d30a57ea85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:53.637910 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7776f-03ed-4169-84fd-46d30a57ea85 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.638198 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7776f-03ed-4169-84fd-46d30a57ea85 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.638472 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7776f-03ed-4169-84fd-46d30a57ea85 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.639188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7776f-03ed-4169-84fd-46d30a57ea85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:53.639497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7776f-03ed-4169-84fd-46d30a57ea85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:53.640917 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7776f-03ed-4169-84fd-46d30a57ea85 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:53.657294 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 226/472] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:53.657294 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7776f-03ed-4169-84fd-46d30a57ea85 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:53.672214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:53.685362 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1fe39-5409-4b46-bc29-f528fe67791b None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:53.722877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34913701-40a8-4856-b2c4-ce476704b791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:53.723926 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34913701-40a8-4856-b2c4-ce476704b791 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.724479 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34913701-40a8-4856-b2c4-ce476704b791 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.725065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34913701-40a8-4856-b2c4-ce476704b791 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.726095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34913701-40a8-4856-b2c4-ce476704b791 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:53.727520 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34913701-40a8-4856-b2c4-ce476704b791 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:53.752608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.sql.core [None req-34913701-40a8-4856-b2c4-ce476704b791 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 14:43:53.752608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 14:43:53.752608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [parameters: {'id': 'f1070369ad8b49a995e6cf4314e70ba5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 14:43:53.752608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80274) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 14:43:53.755897 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7776f-03ed-4169-84fd-46d30a57ea85 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:53.769913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-34913701-40a8-4856-b2c4-ce476704b791 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 14:43:53.769913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:53.769913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:43:53.769913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:43:53.769913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:43:53.769913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:43:53.769913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:43:53.769913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:43:53.769913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:43:53.769913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:43:53.769913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:43:53.769913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:43:53.769913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:43:53.769913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application result.read() Jun 16 14:43:53.769913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return ref.to_dict() Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:43:53.770810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application yield resource Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise self.value Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application session.commit() Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 14:43:53.771720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self.session.flush() Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application compat.raise_( Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 14:43:53.772557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 14:43:53.773456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 14:43:53.773456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 14:43:53.773456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 14:43:53.773456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 14:43:53.773456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 14:43:53.773456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 14:43:53.773456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 14:43:53.773456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 14:43:53.773456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 14:43:53.773456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 14:43:53.773456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 14:43:53.773456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 14:43:53.773456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 14:43:53.773456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 14:43:53.773456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:43:53.773456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception Jun 16 14:43:53.774384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:43:53.774384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:43:53.774384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:43:53.774384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:43:53.774384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:43:53.774384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:43:53.774384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:43:53.774384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:43:53.774384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:43:53.774384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:43:53.774384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:43:53.774384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application result.read() Jun 16 14:43:53.774384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:43:53.774384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:43:53.774384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:43:53.774384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:43:53.775150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:43:53.775150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:43:53.775150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:43:53.775150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:43:53.775150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 14:43:53.775150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 14:43:53.775150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [parameters: {'id': 'f1070369ad8b49a995e6cf4314e70ba5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 14:43:53.775150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 14:43:53.775150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:53.775150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:43:53.775150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:53.775150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:53.775150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:53.775150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:53.775150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:53.775150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:53.778396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:53.778396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:53.778396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:53.778396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:53.778396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:53.778396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:53.778396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 16 14:43:53.778396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 16 14:43:53.778396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:53.778396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:53.778396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 16 14:43:53.778396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 16 14:43:53.778396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 14:43:53.778396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 14:43:53.778396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 14:43:53.778396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:53.779407 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 247/473] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Jun 16 14:43:53 2022] POST /identity/v3/roles => generated 144 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:53.779407 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34913701-40a8-4856-b2c4-ce476704b791 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:53.802552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102cf62-7d79-4007-9277-9b00379b94f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:53.803490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102cf62-7d79-4007-9277-9b00379b94f6 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.803749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102cf62-7d79-4007-9277-9b00379b94f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.804025 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102cf62-7d79-4007-9277-9b00379b94f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.819634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102cf62-7d79-4007-9277-9b00379b94f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:53.821048 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102cf62-7d79-4007-9277-9b00379b94f6 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:53.839110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-9102cf62-7d79-4007-9277-9b00379b94f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:53.839110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:53.839110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:53.839110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:53.839110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:53.839110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:53.839110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:53.839110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:53.839110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:53.839110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:53.839110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:53.839110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:53.839110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:53.839110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:53.839110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:53.840000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:53.841448 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:53.841448 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:53.841448 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:53.841448 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:53.841448 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 227/474] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:53.841727 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102cf62-7d79-4007-9277-9b00379b94f6 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:53.891462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34913701-40a8-4856-b2c4-ce476704b791 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:53.893611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:53.908645 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:53.928859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef8c59-f7ef-467a-8320-2240d6012bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:53.929746 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef8c59-f7ef-467a-8320-2240d6012bda None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.930395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef8c59-f7ef-467a-8320-2240d6012bda None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.930669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef8c59-f7ef-467a-8320-2240d6012bda None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.931425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef8c59-f7ef-467a-8320-2240d6012bda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:53.932928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef8c59-f7ef-467a-8320-2240d6012bda None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:53.943615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102cf62-7d79-4007-9277-9b00379b94f6 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:53.978692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afb1e6-fa87-40bd-9d7c-7c3a0c76cbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:53.979371 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afb1e6-fa87-40bd-9d7c-7c3a0c76cbec None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:53.979668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afb1e6-fa87-40bd-9d7c-7c3a0c76cbec None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:53.980036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afb1e6-fa87-40bd-9d7c-7c3a0c76cbec None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:53.980766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afb1e6-fa87-40bd-9d7c-7c3a0c76cbec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:53.982802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afb1e6-fa87-40bd-9d7c-7c3a0c76cbec None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:54.015539 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 248/475] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:53 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:54.016541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef8c59-f7ef-467a-8320-2240d6012bda None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:54.108439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 228/476] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:53 2022] POST /identity/v3/users => generated 248 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:54.110539 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afb1e6-fa87-40bd-9d7c-7c3a0c76cbec None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:54.159518 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef8c59-f7ef-467a-8320-2240d6012bda None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:54.210189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac32a6-647e-4768-a2c2-37ec866d9083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:54.211042 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac32a6-647e-4768-a2c2-37ec866d9083 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:54.211320 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac32a6-647e-4768-a2c2-37ec866d9083 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:54.211670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac32a6-647e-4768-a2c2-37ec866d9083 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:54.226536 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac32a6-647e-4768-a2c2-37ec866d9083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:54.235740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-9aac32a6-647e-4768-a2c2-37ec866d9083 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:54.235740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:54.235740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:54.235740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:54.235740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:54.235740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:54.235740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:54.235740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:54.235740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:54.235740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:54.235740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:54.235740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:54.235740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:54.235740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:54.235740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:54.235740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:54.236698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:54.236698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:54.236698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:54.236698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:54.236698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:54.236698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:54.236698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:54.236698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:54.236698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:54.236698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:54.236698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:54.236698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:54.236698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:54.236698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:54.236698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:54.236698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:54.237961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:54.237961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:54.237961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:54.237961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:54.237961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:54.237961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:54.237961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:54.237961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:54.237961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:54.237961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:54.237961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 14:43:54.237961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:54.237961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 249/477] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:43:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:54.243234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac32a6-647e-4768-a2c2-37ec866d9083 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:54.265922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:54.285388 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afb1e6-fa87-40bd-9d7c-7c3a0c76cbec None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:54.313517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:54.335812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ae951-37c9-4a1e-9c87-e49675ab3e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:54.336778 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ae951-37c9-4a1e-9c87-e49675ab3e39 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:54.337293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ae951-37c9-4a1e-9c87-e49675ab3e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:54.337744 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ae951-37c9-4a1e-9c87-e49675ab3e39 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:54.338671 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ae951-37c9-4a1e-9c87-e49675ab3e39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:54.339155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ae951-37c9-4a1e-9c87-e49675ab3e39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:54.341810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ae951-37c9-4a1e-9c87-e49675ab3e39 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:54.357527 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 229/478] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:54.363646 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ae951-37c9-4a1e-9c87-e49675ab3e39 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:54.382416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac32a6-647e-4768-a2c2-37ec866d9083 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:54.428606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae935f5-6d28-42b2-8a65-66d81baba053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:54.429422 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae935f5-6d28-42b2-8a65-66d81baba053 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:54.429784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae935f5-6d28-42b2-8a65-66d81baba053 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:54.430138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae935f5-6d28-42b2-8a65-66d81baba053 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:54.431141 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae935f5-6d28-42b2-8a65-66d81baba053 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:54.431530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae935f5-6d28-42b2-8a65-66d81baba053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:54.433638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae935f5-6d28-42b2-8a65-66d81baba053 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:54.443678 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 250/479] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:54.482311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ae951-37c9-4a1e-9c87-e49675ab3e39 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:54.523937 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db084b-653a-47f2-a82e-2c8cd5d34f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:54.524880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db084b-653a-47f2-a82e-2c8cd5d34f44 None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:54.525353 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db084b-653a-47f2-a82e-2c8cd5d34f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:54.525774 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db084b-653a-47f2-a82e-2c8cd5d34f44 None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:54.526649 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db084b-653a-47f2-a82e-2c8cd5d34f44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:54.528685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db084b-653a-47f2-a82e-2c8cd5d34f44 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:54.611210 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 230/480] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:54 2022] POST /identity/v3/users => generated 249 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:55.588884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c9570-fc96-4115-a9d0-ebb2e55d3370 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:55.589444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c9570-fc96-4115-a9d0-ebb2e55d3370 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:55.589601 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c9570-fc96-4115-a9d0-ebb2e55d3370 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:55.591251 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 251/481] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:55.596508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de7866-f8e5-4a41-a3f2-d45b4b3b87f8 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:55.596896 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de7866-f8e5-4a41-a3f2-d45b4b3b87f8 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:55.597068 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de7866-f8e5-4a41-a3f2-d45b4b3b87f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:55.618460 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-02de7866-f8e5-4a41-a3f2-d45b4b3b87f8 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:55.619645 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-02de7866-f8e5-4a41-a3f2-d45b4b3b87f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:55.659470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:55.711547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 231/482] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:55.749525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c9570-fc96-4115-a9d0-ebb2e55d3370 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:55.860424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:55.888658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c9570-fc96-4115-a9d0-ebb2e55d3370 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:55.931124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971d862-490c-48aa-8371-cd3853b9d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:55.931941 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971d862-490c-48aa-8371-cd3853b9d8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:55.932230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971d862-490c-48aa-8371-cd3853b9d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:55.932513 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971d862-490c-48aa-8371-cd3853b9d8b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:55.950585 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971d862-490c-48aa-8371-cd3853b9d8b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:55.958377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-4971d862-490c-48aa-8371-cd3853b9d8b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:55.958377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:55.958377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:55.958377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:55.958377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:55.958377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:55.958377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:55.958377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:55.958377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:55.958377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:55.958377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:55.958377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:55.958377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:55.958377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:55.958377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:55.958377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:55.959225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:55.959225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:55.959225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:55.959225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:55.959225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:55.959225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:55.959225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:55.959225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:55.959225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:55.959225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:55.959225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:55.959225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:55.959225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:55.959225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:55.959225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:55.959225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:55.960018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:55.960018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:55.960018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:55.960018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:55.960018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:55.960018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:55.960018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:55.960018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:55.960018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:55.960018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:55.960018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:55.960018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:55.964037 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 252/483] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:55.966282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de7866-f8e5-4a41-a3f2-d45b4b3b87f8 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:56.090045 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de7866-f8e5-4a41-a3f2-d45b4b3b87f8 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:56.123123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3229d-c831-47f5-b434-7c3581c61668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:56.123718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3229d-c831-47f5-b434-7c3581c61668 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:56.124002 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3229d-c831-47f5-b434-7c3581c61668 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:56.124275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3229d-c831-47f5-b434-7c3581c61668 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:56.125010 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3229d-c831-47f5-b434-7c3581c61668 None admin] RBAC: Adding query filter params (name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:56.125345 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3229d-c831-47f5-b434-7c3581c61668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:56.126710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3229d-c831-47f5-b434-7c3581c61668 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:56.135063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 232/484] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:56.141076 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971d862-490c-48aa-8371-cd3853b9d8b7 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:56.249256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971d862-490c-48aa-8371-cd3853b9d8b7 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:56.288095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adad1d-dfcd-4951-8ec8-b2a331d56b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:56.288892 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adad1d-dfcd-4951-8ec8-b2a331d56b10 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:56.289194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adad1d-dfcd-4951-8ec8-b2a331d56b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:56.289475 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adad1d-dfcd-4951-8ec8-b2a331d56b10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:56.302079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:56.304839 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adad1d-dfcd-4951-8ec8-b2a331d56b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:56.306356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adad1d-dfcd-4951-8ec8-b2a331d56b10 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:56.335319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-33adad1d-dfcd-4951-8ec8-b2a331d56b10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:56.335319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:56.335319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:56.335319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:56.335319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:56.335319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:56.335319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:56.335319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:56.335319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:56.335319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:56.335319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:56.335319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:56.335319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:56.335319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:56.335319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:56.336229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:56.337047 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:56.337047 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:56.337047 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:56.337047 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:56.337047 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 253/485] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:56.342521 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3229d-c831-47f5-b434-7c3581c61668 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:56.385231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:56.471566 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3229d-c831-47f5-b434-7c3581c61668 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:56.520601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169afb7b-59e0-41c8-a2a8-f1e9b4df5165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:56.521702 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169afb7b-59e0-41c8-a2a8-f1e9b4df5165 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:56.522188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169afb7b-59e0-41c8-a2a8-f1e9b4df5165 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:56.522659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169afb7b-59e0-41c8-a2a8-f1e9b4df5165 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:56.523568 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169afb7b-59e0-41c8-a2a8-f1e9b4df5165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:56.524087 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169afb7b-59e0-41c8-a2a8-f1e9b4df5165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:56.525693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169afb7b-59e0-41c8-a2a8-f1e9b4df5165 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:56.539089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 233/486] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:56.544389 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adad1d-dfcd-4951-8ec8-b2a331d56b10 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:56.714353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adad1d-dfcd-4951-8ec8-b2a331d56b10 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:56.758753 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3297d61-a426-4cd3-8b98-41de2123d7c2 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:56.759725 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3297d61-a426-4cd3-8b98-41de2123d7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:56.760201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3297d61-a426-4cd3-8b98-41de2123d7c2 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:56.762052 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 234/487] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:56.765152 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97840c60-3c59-49ee-83fb-a662559ab2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:56.765152 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97840c60-3c59-49ee-83fb-a662559ab2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:56.765152 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97840c60-3c59-49ee-83fb-a662559ab2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:56.765152 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97840c60-3c59-49ee-83fb-a662559ab2d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:56.770381 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463a53e-62a2-40aa-ab55-ddcaee11dcb9 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:56.770896 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463a53e-62a2-40aa-ab55-ddcaee11dcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:56.771401 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463a53e-62a2-40aa-ab55-ddcaee11dcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:56.776449 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97840c60-3c59-49ee-83fb-a662559ab2d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:56.778452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97840c60-3c59-49ee-83fb-a662559ab2d6 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:56.803807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-97840c60-3c59-49ee-83fb-a662559ab2d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:43:56.803807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:56.803807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:56.803807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:56.803807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:56.803807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:56.803807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:56.803807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:56.803807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:56.803807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:56.803807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:56.803807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:56.803807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:56.803807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:56.803807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:56.803807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:56.804797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:56.805729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:56.805729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:56.805729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:56.805729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:56.805729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:56.805729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:56.805729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:56.805729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:56.805729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:43:56.805729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:56.811096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 254/488] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 16 14:43:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:56.811417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-7463a53e-62a2-40aa-ab55-ddcaee11dcb9 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:56.812815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-7463a53e-62a2-40aa-ab55-ddcaee11dcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:56.816135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97840c60-3c59-49ee-83fb-a662559ab2d6 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:56.918674 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:56.945312 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 235/489] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:56.981643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463a53e-62a2-40aa-ab55-ddcaee11dcb9 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:57.017229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:57.025206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97840c60-3c59-49ee-83fb-a662559ab2d6 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:57.069997 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9e06f-0f11-416b-ae45-c7aaee061c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:57.071189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9e06f-0f11-416b-ae45-c7aaee061c71 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.071782 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9e06f-0f11-416b-ae45-c7aaee061c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.072264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9e06f-0f11-416b-ae45-c7aaee061c71 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.073389 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9e06f-0f11-416b-ae45-c7aaee061c71 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:57.073964 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9e06f-0f11-416b-ae45-c7aaee061c71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:57.075875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9e06f-0f11-416b-ae45-c7aaee061c71 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:57.118606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 255/490] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 16 14:43:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:43:57.126247 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9e06f-0f11-416b-ae45-c7aaee061c71 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:57.151989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463a53e-62a2-40aa-ab55-ddcaee11dcb9 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:57.189665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0dc2f4-dbc4-4fbc-9d42-b9f55adfdf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:57.190755 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0dc2f4-dbc4-4fbc-9d42-b9f55adfdf9b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.191184 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0dc2f4-dbc4-4fbc-9d42-b9f55adfdf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.191612 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0dc2f4-dbc4-4fbc-9d42-b9f55adfdf9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.202998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0dc2f4-dbc4-4fbc-9d42-b9f55adfdf9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:57.212149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-fe0dc2f4-dbc4-4fbc-9d42-b9f55adfdf9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:57.212149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:57.212149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:57.212149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:57.212149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:57.212149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:57.212149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:57.212149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:57.212149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:57.212149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:57.212149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:57.212149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:57.212149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:57.212149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:57.212149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:57.212149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:57.213063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:57.213063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:57.213063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:57.213063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:57.213063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:57.213063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:57.213063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:57.213063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:57.213063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:57.213063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:57.213063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:57.213063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:57.213063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:57.213063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:57.213063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:57.213063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:57.213883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:57.213883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:57.213883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:57.213883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:57.213883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:57.213883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:57.213883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:57.213883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:57.213883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:57.213883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:57.213883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:57.213883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:57.213883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 236/491] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:57.214688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57484272-f6b0-492a-b55c-4894d6acfaf9 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.215824 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57484272-f6b0-492a-b55c-4894d6acfaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.215824 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57484272-f6b0-492a-b55c-4894d6acfaf9 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.216718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 237/492] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:57.217935 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183a912-fe1c-409e-b32a-d148a5f166f2 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.218230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183a912-fe1c-409e-b32a-d148a5f166f2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.218512 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183a912-fe1c-409e-b32a-d148a5f166f2 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.223999 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 238/493] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:57.223999 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183a912-fe1c-409e-b32a-d148a5f166f2 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:57.250696 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9e06f-0f11-416b-ae45-c7aaee061c71 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:57.261452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:57.285377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d117f-095b-43ed-a70d-8bded3268d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:57.286034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d117f-095b-43ed-a70d-8bded3268d5d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.286323 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d117f-095b-43ed-a70d-8bded3268d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.286606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d117f-095b-43ed-a70d-8bded3268d5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.312397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:57.332687 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183a912-fe1c-409e-b32a-d148a5f166f2 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:57.358991 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d117f-095b-43ed-a70d-8bded3268d5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:57.360454 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d117f-095b-43ed-a70d-8bded3268d5d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:57.370547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beba189-a32b-4408-9ad8-21a883e05b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:57.371344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beba189-a32b-4408-9ad8-21a883e05b8f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.371634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beba189-a32b-4408-9ad8-21a883e05b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.372554 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beba189-a32b-4408-9ad8-21a883e05b8f None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.373353 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beba189-a32b-4408-9ad8-21a883e05b8f None admin] RBAC: Adding query filter params (name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:57.373673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beba189-a32b-4408-9ad8-21a883e05b8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:57.375311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beba189-a32b-4408-9ad8-21a883e05b8f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:57.389058 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 239/494] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:57.390351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f215396-f37a-479a-9b8c-a79e5f14007b None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.390636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f215396-f37a-479a-9b8c-a79e5f14007b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.390924 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f215396-f37a-479a-9b8c-a79e5f14007b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.408446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-5f215396-f37a-479a-9b8c-a79e5f14007b None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:57.409677 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-5f215396-f37a-479a-9b8c-a79e5f14007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:57.460823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 256/495] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:57.463522 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c839d14-b6fb-4895-b9b0-503c5a74f773 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.463817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c839d14-b6fb-4895-b9b0-503c5a74f773 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.464102 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c839d14-b6fb-4895-b9b0-503c5a74f773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.483563 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-5c839d14-b6fb-4895-b9b0-503c5a74f773 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:57.484701 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5c839d14-b6fb-4895-b9b0-503c5a74f773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:57.488957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 240/496] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:57.489086 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:57.489828 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f215396-f37a-479a-9b8c-a79e5f14007b None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:57.564735 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:57.567857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 257/497] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:57.568684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c839d14-b6fb-4895-b9b0-503c5a74f773 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:57.594611 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f215396-f37a-479a-9b8c-a79e5f14007b None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:57.628370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddcb22-e81e-4495-905a-0c87a2e7f4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:57.629187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddcb22-e81e-4495-905a-0c87a2e7f4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.629477 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddcb22-e81e-4495-905a-0c87a2e7f4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.629758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddcb22-e81e-4495-905a-0c87a2e7f4e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.639620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddcb22-e81e-4495-905a-0c87a2e7f4e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:57.641059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddcb22-e81e-4495-905a-0c87a2e7f4e3 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:57.659057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-66ddcb22-e81e-4495-905a-0c87a2e7f4e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:57.659057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:57.659057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:57.659057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:57.659057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:57.659057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:57.659057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:57.659057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:57.659057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:57.659057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:57.659057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:57.659057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:57.659057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:57.659057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:57.659057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:57.659890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:57.660747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:57.660747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:57.660747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:57.660747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:57.660747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 241/498] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:57.661542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09007d04-9cb5-4d3c-b881-0147acd44de1 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.661886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09007d04-9cb5-4d3c-b881-0147acd44de1 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.662163 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09007d04-9cb5-4d3c-b881-0147acd44de1 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.663412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 242/499] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:43:57.664089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09007d04-9cb5-4d3c-b881-0147acd44de1 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:57.672897 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c839d14-b6fb-4895-b9b0-503c5a74f773 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:57.705502 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a6235-c341-4852-818b-e3c1a329e5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:57.706297 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a6235-c341-4852-818b-e3c1a329e5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.706586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a6235-c341-4852-818b-e3c1a329e5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.706861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a6235-c341-4852-818b-e3c1a329e5a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.714903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:57.717458 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a6235-c341-4852-818b-e3c1a329e5a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:57.719089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a6235-c341-4852-818b-e3c1a329e5a7 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:57.742286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-c66a6235-c341-4852-818b-e3c1a329e5a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:57.742286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:57.742286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:57.742286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:57.742286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:57.742286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:57.742286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:57.742286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:57.742286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:57.742286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:57.742286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:57.742286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:57.742286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:57.742286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:57.742286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:57.743172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:57.744242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:57.744242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:57.744242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:57.744242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:57.744242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 258/500] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:57.744242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a6235-c341-4852-818b-e3c1a329e5a7 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:57.767293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09007d04-9cb5-4d3c-b881-0147acd44de1 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:57.791613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:57.802943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fc957-8c04-4c2a-b75f-b385b7177891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:57.803740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fc957-8c04-4c2a-b75f-b385b7177891 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.804035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fc957-8c04-4c2a-b75f-b385b7177891 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.804349 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fc957-8c04-4c2a-b75f-b385b7177891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.815924 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fc957-8c04-4c2a-b75f-b385b7177891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:57.817420 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fc957-8c04-4c2a-b75f-b385b7177891 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:57.837971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a6235-c341-4852-818b-e3c1a329e5a7 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:57.839499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-394fc957-8c04-4c2a-b75f-b385b7177891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:57.839499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:57.839499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:57.839499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:57.839499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:57.839499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:57.839499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:57.839499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:57.839499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:57.839499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:57.839499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:57.839499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:57.839499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:57.839499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:57.839499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:57.840442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:57.842009 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:57.842009 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:57.842009 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:57.842009 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:57.845194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 243/501] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:57.846047 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fc957-8c04-4c2a-b75f-b385b7177891 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:57.880885 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b528ff4-e1f8-4bf0-a1dd-bead530dafec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:57.881713 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b528ff4-e1f8-4bf0-a1dd-bead530dafec None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.881996 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b528ff4-e1f8-4bf0-a1dd-bead530dafec None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.882272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b528ff4-e1f8-4bf0-a1dd-bead530dafec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.892873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b528ff4-e1f8-4bf0-a1dd-bead530dafec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:57.900556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-7b528ff4-e1f8-4bf0-a1dd-bead530dafec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:57.900556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:57.900556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:57.900556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:57.900556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:57.900556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:57.900556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:57.900556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:57.900556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:57.900556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:57.900556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:57.900556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:57.900556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:57.900556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:57.900556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:57.900556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:57.901446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:57.901446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:57.901446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:57.901446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:57.901446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:57.901446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:57.901446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:57.901446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:57.901446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:57.901446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:57.901446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:57.901446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:57.901446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:57.901446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:57.901446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:57.901446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:57.910616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:57.910616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:57.910616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:57.910616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:57.910616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:57.910616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:57.910616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:57.910616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:57.910616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:57.910616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:57.910616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:57.910616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:57.910616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 259/502] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:57.910616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3068219-5e8f-4387-9d5f-986327372acb None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.911325 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3068219-5e8f-4387-9d5f-986327372acb None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.911325 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3068219-5e8f-4387-9d5f-986327372acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.920943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-a3068219-5e8f-4387-9d5f-986327372acb None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:43:57.922177 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a3068219-5e8f-4387-9d5f-986327372acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:43:57.945255 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fc957-8c04-4c2a-b75f-b385b7177891 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:57.970160 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:57.982796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef73591-cea0-41e1-b97e-91556865d74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:57.983467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef73591-cea0-41e1-b97e-91556865d74e None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:57.983759 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef73591-cea0-41e1-b97e-91556865d74e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:57.984042 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef73591-cea0-41e1-b97e-91556865d74e None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:57.994024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef73591-cea0-41e1-b97e-91556865d74e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:57.994024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef73591-cea0-41e1-b97e-91556865d74e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:57.994024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef73591-cea0-41e1-b97e-91556865d74e None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:57.994284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 260/503] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:43:57.994284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3068219-5e8f-4387-9d5f-986327372acb None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:57.997861 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 244/504] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:57.998574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef73591-cea0-41e1-b97e-91556865d74e None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.034832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:58.098457 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef73591-cea0-41e1-b97e-91556865d74e None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.098741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3068219-5e8f-4387-9d5f-986327372acb None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.131339 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc92d5a-67ae-4213-b4d3-76032f40ca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.132005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc92d5a-67ae-4213-b4d3-76032f40ca79 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.132290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc92d5a-67ae-4213-b4d3-76032f40ca79 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.132570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc92d5a-67ae-4213-b4d3-76032f40ca79 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.133325 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc92d5a-67ae-4213-b4d3-76032f40ca79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:58.133572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00a128-0d32-48e3-ba53-5e096a1bcfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.133695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc92d5a-67ae-4213-b4d3-76032f40ca79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.134238 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00a128-0d32-48e3-ba53-5e096a1bcfdd None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.134527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00a128-0d32-48e3-ba53-5e096a1bcfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.134809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00a128-0d32-48e3-ba53-5e096a1bcfdd None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.134990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc92d5a-67ae-4213-b4d3-76032f40ca79 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.135534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00a128-0d32-48e3-ba53-5e096a1bcfdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:58.135846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00a128-0d32-48e3-ba53-5e096a1bcfdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.137234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00a128-0d32-48e3-ba53-5e096a1bcfdd None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.147059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 245/505] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:58.147991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc92d5a-67ae-4213-b4d3-76032f40ca79 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.153182 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 261/506] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:58.153182 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00a128-0d32-48e3-ba53-5e096a1bcfdd None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.194083 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:58.253572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00a128-0d32-48e3-ba53-5e096a1bcfdd None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.254280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:58.261240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc92d5a-67ae-4213-b4d3-76032f40ca79 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.287553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb567-dfa5-4b69-92bc-9e8734c35eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.288352 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb567-dfa5-4b69-92bc-9e8734c35eef None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.288641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb567-dfa5-4b69-92bc-9e8734c35eef None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.288923 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb567-dfa5-4b69-92bc-9e8734c35eef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.295522 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3687a80-96b4-446f-afba-650f7bf98be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.296195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3687a80-96b4-446f-afba-650f7bf98be8 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.296380 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bb567-dfa5-4b69-92bc-9e8734c35eef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.296472 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3687a80-96b4-446f-afba-650f7bf98be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.296754 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3687a80-96b4-446f-afba-650f7bf98be8 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.297527 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3687a80-96b4-446f-afba-650f7bf98be8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:58.297840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3687a80-96b4-446f-afba-650f7bf98be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.297926 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bb567-dfa5-4b69-92bc-9e8734c35eef None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.299195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3687a80-96b4-446f-afba-650f7bf98be8 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.307027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 246/507] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:58.307792 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3687a80-96b4-446f-afba-650f7bf98be8 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.313036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-3b1bb567-dfa5-4b69-92bc-9e8734c35eef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:43:58.313036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:58.313036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:58.313036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:58.313036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:58.313036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:58.313036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:58.313036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:58.313036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:58.313036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:58.313036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:58.313036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:58.313036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:58.313036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:58.313036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:58.313036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:58.314135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:58.315040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:58.315040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:58.315040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:58.315040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:58.315040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:58.315040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:58.315040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:58.315040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:58.315040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:43:58.315040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:58.315040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 262/508] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:58.315595 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb567-dfa5-4b69-92bc-9e8734c35eef None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.407593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3687a80-96b4-446f-afba-650f7bf98be8 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.412433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb567-dfa5-4b69-92bc-9e8734c35eef None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.413952 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:58.440392 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617b8aa-f0c2-432a-8481-aff4f76d998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.441215 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617b8aa-f0c2-432a-8481-aff4f76d998c None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.441516 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617b8aa-f0c2-432a-8481-aff4f76d998c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.441802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617b8aa-f0c2-432a-8481-aff4f76d998c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.446378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c37c0d-8374-4b61-9f28-8ad6b4a25678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.447064 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c37c0d-8374-4b61-9f28-8ad6b4a25678 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.447346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c37c0d-8374-4b61-9f28-8ad6b4a25678 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.447621 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c37c0d-8374-4b61-9f28-8ad6b4a25678 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.448313 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c37c0d-8374-4b61-9f28-8ad6b4a25678 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.449837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c37c0d-8374-4b61-9f28-8ad6b4a25678 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.452442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617b8aa-f0c2-432a-8481-aff4f76d998c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:43:58.460594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-c617b8aa-f0c2-432a-8481-aff4f76d998c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:58.460594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:58.460594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:58.460594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:58.460594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:58.460594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:58.460594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:58.460594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:58.460594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:58.460594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:58.460594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:58.460594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:58.460594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:43:58.460594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:43:58.460594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:43:58.460594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:43:58.461718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:43:58.461718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:43:58.461718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:43:58.461718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:43:58.461718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:58.461718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:58.461718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:58.461718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:58.461718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:58.461718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:58.461718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:58.461718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:58.461718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:58.461718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:58.461718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:58.461718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:58.462658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:58.462658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:58.462658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:58.462658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:58.462658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:43:58.462658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:43:58.462658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:43:58.462658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:43:58.462658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:43:58.462658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:43:58.462658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:43:58.462658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:58.462658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 247/509] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:58.462658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617b8aa-f0c2-432a-8481-aff4f76d998c None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.480989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:58.535679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 263/510] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:43:58 2022] POST /identity/v3/users => generated 247 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:43:58.536654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c37c0d-8374-4b61-9f28-8ad6b4a25678 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.570518 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617b8aa-f0c2-432a-8481-aff4f76d998c None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.607662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f15de-4a01-4bb1-8b69-e43809574954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.608564 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f15de-4a01-4bb1-8b69-e43809574954 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.608857 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f15de-4a01-4bb1-8b69-e43809574954 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.609146 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f15de-4a01-4bb1-8b69-e43809574954 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.616654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f15de-4a01-4bb1-8b69-e43809574954 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.618195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f15de-4a01-4bb1-8b69-e43809574954 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.635728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-562f15de-4a01-4bb1-8b69-e43809574954 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:58.635728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:58.635728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:58.635728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:58.635728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:58.635728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:58.635728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:58.635728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:58.635728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:58.635728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:58.635728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:58.635728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:58.635728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:43:58.635728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:43:58.635728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:58.636644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:58.637930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:43:58.637930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:43:58.637930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:43:58.637930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:43:58.637930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:43:58.637930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:43:58.637930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:43:58.637930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:58.641870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 248/511] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:43:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:58.642815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f15de-4a01-4bb1-8b69-e43809574954 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.653082 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c37c0d-8374-4b61-9f28-8ad6b4a25678 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.693726 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd4b2f-a805-4840-825e-1ac60568eb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.694539 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd4b2f-a805-4840-825e-1ac60568eb20 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.694828 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd4b2f-a805-4840-825e-1ac60568eb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.695111 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd4b2f-a805-4840-825e-1ac60568eb20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.708777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd4b2f-a805-4840-825e-1ac60568eb20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.710432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd4b2f-a805-4840-825e-1ac60568eb20 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.728166 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:58.728374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-3acd4b2f-a805-4840-825e-1ac60568eb20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:58.728374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:58.728374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:58.728374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:58.728374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:58.728374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:58.728374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:58.728374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:58.728374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:58.728374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:58.728374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:58.728374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:58.728374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:58.728374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:58.728374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:58.729486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:58.730614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:58.730614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:58.730614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:58.730614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:58.730614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 264/512] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:58.730868 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd4b2f-a805-4840-825e-1ac60568eb20 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.748242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:58.758963 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f15de-4a01-4bb1-8b69-e43809574954 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:58.796264 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cd871-80f9-4d5d-bde6-f3a3d2034d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:58.796870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cd871-80f9-4d5d-bde6-f3a3d2034d3f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:58.797160 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cd871-80f9-4d5d-bde6-f3a3d2034d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:58.797448 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cd871-80f9-4d5d-bde6-f3a3d2034d3f None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:58.798276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cd871-80f9-4d5d-bde6-f3a3d2034d3f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:58.798588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cd871-80f9-4d5d-bde6-f3a3d2034d3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:58.800037 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cd871-80f9-4d5d-bde6-f3a3d2034d3f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:58.842858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 249/513] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jun 16 14:43:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:58.842858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cd871-80f9-4d5d-bde6-f3a3d2034d3f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:58.975944 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd4b2f-a805-4840-825e-1ac60568eb20 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:59.012305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c25d9-b197-43c6-8c2b-715fb04189e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.013006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c25d9-b197-43c6-8c2b-715fb04189e0 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.013327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c25d9-b197-43c6-8c2b-715fb04189e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.013606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c25d9-b197-43c6-8c2b-715fb04189e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.014359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c25d9-b197-43c6-8c2b-715fb04189e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:59.014670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c25d9-b197-43c6-8c2b-715fb04189e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.016056 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c25d9-b197-43c6-8c2b-715fb04189e0 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.025175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 265/514] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:43:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:59.026115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c25d9-b197-43c6-8c2b-715fb04189e0 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:59.048659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cd871-80f9-4d5d-bde6-f3a3d2034d3f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:59.093115 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f85b4-3016-4bfa-bdd1-bb649d816f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.093815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f85b4-3016-4bfa-bdd1-bb649d816f0f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.094106 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f85b4-3016-4bfa-bdd1-bb649d816f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.094388 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f85b4-3016-4bfa-bdd1-bb649d816f0f None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.095177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f85b4-3016-4bfa-bdd1-bb649d816f0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:59.095501 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f85b4-3016-4bfa-bdd1-bb649d816f0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.096958 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f85b4-3016-4bfa-bdd1-bb649d816f0f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.100507 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:59.101056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:59.115974 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 250/515] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:59.116611 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f85b4-3016-4bfa-bdd1-bb649d816f0f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:59.137463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c25d9-b197-43c6-8c2b-715fb04189e0 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:59.173176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33140c0d-ec81-41f5-8c90-daa7c3219fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.173847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33140c0d-ec81-41f5-8c90-daa7c3219fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.174136 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33140c0d-ec81-41f5-8c90-daa7c3219fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.174413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33140c0d-ec81-41f5-8c90-daa7c3219fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.175136 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33140c0d-ec81-41f5-8c90-daa7c3219fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:59.175444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33140c0d-ec81-41f5-8c90-daa7c3219fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.176823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33140c0d-ec81-41f5-8c90-daa7c3219fe6 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.193279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 266/516] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:59.193279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33140c0d-ec81-41f5-8c90-daa7c3219fe6 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:59.228954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f85b4-3016-4bfa-bdd1-bb649d816f0f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:59.266748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93394d-3cfd-45af-8f04-23327e471a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.267406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93394d-3cfd-45af-8f04-23327e471a49 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.267720 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93394d-3cfd-45af-8f04-23327e471a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.268087 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93394d-3cfd-45af-8f04-23327e471a49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.295502 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33140c0d-ec81-41f5-8c90-daa7c3219fe6 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:59.326016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:59.330926 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb863d7-90e2-44a0-a50c-1f49f2a3caf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.331839 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb863d7-90e2-44a0-a50c-1f49f2a3caf8 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.332132 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb863d7-90e2-44a0-a50c-1f49f2a3caf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.332414 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb863d7-90e2-44a0-a50c-1f49f2a3caf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.333194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:59.340029 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93394d-3cfd-45af-8f04-23327e471a49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.342167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93394d-3cfd-45af-8f04-23327e471a49 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.343133 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb863d7-90e2-44a0-a50c-1f49f2a3caf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.344572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb863d7-90e2-44a0-a50c-1f49f2a3caf8 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.362227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-6fb863d7-90e2-44a0-a50c-1f49f2a3caf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:59.362227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:59.362227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:59.362227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:59.362227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:59.362227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:59.362227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:59.362227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:59.362227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:59.362227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:59.362227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:59.362227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:59.362227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:59.362227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:59.362227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:59.363299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:59.364583 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:59.364583 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:59.364583 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:59.364583 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:43:59.371283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 267/517] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:59.372250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb863d7-90e2-44a0-a50c-1f49f2a3caf8 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:59.451050 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 251/518] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:43:59.452233 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93394d-3cfd-45af-8f04-23327e471a49 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:59.480491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb863d7-90e2-44a0-a50c-1f49f2a3caf8 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:59.515490 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df2550-7a6a-4b53-ba05-0f130e9586d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.516171 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df2550-7a6a-4b53-ba05-0f130e9586d3 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.516688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df2550-7a6a-4b53-ba05-0f130e9586d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.516860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df2550-7a6a-4b53-ba05-0f130e9586d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.517825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df2550-7a6a-4b53-ba05-0f130e9586d3 None admin] RBAC: Adding query filter params (role.id=037df45eceeb4cb7aec314c290fa7820, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=60c2f1c63a674e3195c490ab5ad1318f) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:59.518206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df2550-7a6a-4b53-ba05-0f130e9586d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.519721 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df2550-7a6a-4b53-ba05-0f130e9586d3 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.537178 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 268/519] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/role_assignments?user.id=60c2f1c63a674e3195c490ab5ad1318f&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=037df45eceeb4cb7aec314c290fa7820 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:59.537178 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df2550-7a6a-4b53-ba05-0f130e9586d3 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:59.553568 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:59.564409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93394d-3cfd-45af-8f04-23327e471a49 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:59.608160 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48142b2f-3a3f-40cc-93c8-7864beb8671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.608583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48142b2f-3a3f-40cc-93c8-7864beb8671c None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.608996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48142b2f-3a3f-40cc-93c8-7864beb8671c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.609422 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48142b2f-3a3f-40cc-93c8-7864beb8671c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.619581 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48142b2f-3a3f-40cc-93c8-7864beb8671c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.621772 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48142b2f-3a3f-40cc-93c8-7864beb8671c None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.626278 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:59.646805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-48142b2f-3a3f-40cc-93c8-7864beb8671c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:43:59.646805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:59.646805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:59.646805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:59.646805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:59.646805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:59.646805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:59.646805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:59.646805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:59.646805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:59.646805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:59.646805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:59.646805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:43:59.646805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:43:59.646805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:43:59.646805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:59.647925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:59.649005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:59.649005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:59.649005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:43:59.649005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:43:59.649005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:43:59.649005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:43:59.649005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:43:59.649005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:43:59.649005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:43:59.649005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:59.654697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 252/520] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:59.655810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48142b2f-3a3f-40cc-93c8-7864beb8671c None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:59.696448 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df2550-7a6a-4b53-ba05-0f130e9586d3 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:59.741989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10dc63-f6ac-4724-be37-88830cb6ce7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.743449 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10dc63-f6ac-4724-be37-88830cb6ce7f None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.743954 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10dc63-f6ac-4724-be37-88830cb6ce7f None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.744429 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10dc63-f6ac-4724-be37-88830cb6ce7f None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.745392 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10dc63-f6ac-4724-be37-88830cb6ce7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:59.745924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10dc63-f6ac-4724-be37-88830cb6ce7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.748044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10dc63-f6ac-4724-be37-88830cb6ce7f None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.761577 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 269/521] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:59.763371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10dc63-f6ac-4724-be37-88830cb6ce7f None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:59.787650 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48142b2f-3a3f-40cc-93c8-7864beb8671c None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:59.833511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de495252-ce65-46a8-9072-5c9b621874a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.834317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de495252-ce65-46a8-9072-5c9b621874a5 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.834604 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de495252-ce65-46a8-9072-5c9b621874a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.834882 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de495252-ce65-46a8-9072-5c9b621874a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.847651 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de495252-ce65-46a8-9072-5c9b621874a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.850552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de495252-ce65-46a8-9072-5c9b621874a5 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.869056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-de495252-ce65-46a8-9072-5c9b621874a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:59.869056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:43:59.869056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:43:59.869056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:43:59.869056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:43:59.869056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:43:59.869056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:43:59.869056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:43:59.869056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:43:59.869056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:43:59.869056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:43:59.869056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:43:59.869056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:43:59.869056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:43:59.869056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:43:59.870061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:43:59.870913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:43:59.870913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:43:59.870913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:43:59.870913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:43:59.873760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 253/522] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:43:59.874877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de495252-ce65-46a8-9072-5c9b621874a5 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:59.879911 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10dc63-f6ac-4724-be37-88830cb6ce7f None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:43:59.886927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:59.913541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:43:59.926008 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d9943-3863-4679-80a6-6b7cb2bbd40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:43:59.926686 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d9943-3863-4679-80a6-6b7cb2bbd40e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:43:59.927228 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d9943-3863-4679-80a6-6b7cb2bbd40e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:43:59.927511 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d9943-3863-4679-80a6-6b7cb2bbd40e None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:43:59.928367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d9943-3863-4679-80a6-6b7cb2bbd40e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:43:59.928740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d9943-3863-4679-80a6-6b7cb2bbd40e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:43:59.930675 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d9943-3863-4679-80a6-6b7cb2bbd40e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:43:59.949869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 270/523] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:43:59.951815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d9943-3863-4679-80a6-6b7cb2bbd40e None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:43:59.998163 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de495252-ce65-46a8-9072-5c9b621874a5 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:00.042223 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bc93e-574c-4614-8074-a2a5d969d6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:00.043128 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bc93e-574c-4614-8074-a2a5d969d6fc None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.043332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bc93e-574c-4614-8074-a2a5d969d6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.043619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bc93e-574c-4614-8074-a2a5d969d6fc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.053431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39bc93e-574c-4614-8074-a2a5d969d6fc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:00.055403 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39bc93e-574c-4614-8074-a2a5d969d6fc None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:00.081560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-b39bc93e-574c-4614-8074-a2a5d969d6fc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:44:00.081560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:00.081560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:00.081560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:00.081560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:00.081560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:00.081560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:00.081560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:00.081560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:00.081560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:00.081560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:00.081560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:00.081560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:00.081560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:00.081560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:00.081560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:00.082584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:00.083444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:00.083444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:00.083444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:00.083444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:00.083444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:00.083444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:00.083444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:00.083444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:00.083444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:44:00.083444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:00.084595 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 254/524] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:00.084595 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bc93e-574c-4614-8074-a2a5d969d6fc None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:00.085443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d9943-3863-4679-80a6-6b7cb2bbd40e None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:00.129293 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1648e29-2159-4b49-9e9d-0831ada77fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:00.130308 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1648e29-2159-4b49-9e9d-0831ada77fee None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.130785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1648e29-2159-4b49-9e9d-0831ada77fee None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.131413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1648e29-2159-4b49-9e9d-0831ada77fee None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.133118 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1648e29-2159-4b49-9e9d-0831ada77fee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:00.133651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1648e29-2159-4b49-9e9d-0831ada77fee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:00.135230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1648e29-2159-4b49-9e9d-0831ada77fee None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:00.149606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 271/525] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:00.151020 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1648e29-2159-4b49-9e9d-0831ada77fee None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:00.177526 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:00.187344 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:00.207726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bc93e-574c-4614-8074-a2a5d969d6fc None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:00.243525 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76962f28-49bf-41f2-aaa3-6c579c09c1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:00.244170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76962f28-49bf-41f2-aaa3-6c579c09c1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.244445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76962f28-49bf-41f2-aaa3-6c579c09c1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.244730 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76962f28-49bf-41f2-aaa3-6c579c09c1b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.263145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1648e29-2159-4b49-9e9d-0831ada77fee None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:00.298714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13d99a-cfb7-4a96-b317-8ca311467ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:00.299683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13d99a-cfb7-4a96-b317-8ca311467ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.300170 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13d99a-cfb7-4a96-b317-8ca311467ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.300617 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13d99a-cfb7-4a96-b317-8ca311467ad1 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.301649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13d99a-cfb7-4a96-b317-8ca311467ad1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:00.302261 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13d99a-cfb7-4a96-b317-8ca311467ad1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:00.303855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13d99a-cfb7-4a96-b317-8ca311467ad1 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:00.319692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76962f28-49bf-41f2-aaa3-6c579c09c1b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:00.321042 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76962f28-49bf-41f2-aaa3-6c579c09c1b0 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:00.323426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 272/526] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Jun 16 14:44:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:00.324772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13d99a-cfb7-4a96-b317-8ca311467ad1 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:00.411976 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:00.425584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:00.428821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13d99a-cfb7-4a96-b317-8ca311467ad1 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:00.437595 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 255/527] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:00.438451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76962f28-49bf-41f2-aaa3-6c579c09c1b0 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:00.465364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021eae7-bc00-4138-9d59-cf3f48866f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:00.467055 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021eae7-bc00-4138-9d59-cf3f48866f38 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.467513 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021eae7-bc00-4138-9d59-cf3f48866f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.467958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021eae7-bc00-4138-9d59-cf3f48866f38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.475217 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021eae7-bc00-4138-9d59-cf3f48866f38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:00.476888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021eae7-bc00-4138-9d59-cf3f48866f38 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:00.492019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-0021eae7-bc00-4138-9d59-cf3f48866f38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:00.492019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:00.492019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:00.492019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:00.492019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:00.492019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:00.492019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:00.492019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:00.492019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:00.492019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:00.492019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:00.492019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:00.492019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:00.492019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:00.492019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:00.492851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:00.493709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:00.493709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:00.493709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:00.493709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:00.493709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:00.493709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:00.493709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:00.493709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:00.496397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 273/528] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:00.497473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021eae7-bc00-4138-9d59-cf3f48866f38 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:00.548073 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76962f28-49bf-41f2-aaa3-6c579c09c1b0 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:00.583880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394867a1-1089-44cc-8706-cac3133e1543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:00.584634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394867a1-1089-44cc-8706-cac3133e1543 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.584975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394867a1-1089-44cc-8706-cac3133e1543 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.585293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394867a1-1089-44cc-8706-cac3133e1543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.600295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021eae7-bc00-4138-9d59-cf3f48866f38 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:00.623398 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:00.635625 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3cc07-077f-4190-9fd1-207b0c2d56a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:00.636661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3cc07-077f-4190-9fd1-207b0c2d56a6 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.637102 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3cc07-077f-4190-9fd1-207b0c2d56a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.637852 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3cc07-077f-4190-9fd1-207b0c2d56a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.648943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3cc07-077f-4190-9fd1-207b0c2d56a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:00.650663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3cc07-077f-4190-9fd1-207b0c2d56a6 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:00.654544 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:00.660588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394867a1-1089-44cc-8706-cac3133e1543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:00.662498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394867a1-1089-44cc-8706-cac3133e1543 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:00.671480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-75b3cc07-077f-4190-9fd1-207b0c2d56a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:00.671480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:00.671480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:00.671480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:00.671480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:00.671480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:00.671480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:00.671480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:00.671480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:00.671480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:00.671480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:00.671480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:00.671480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:00.671480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:00.671480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:00.672615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:00.673709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:00.673709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:00.673709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:00.673709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:00.679225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 274/529] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:00.683190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3cc07-077f-4190-9fd1-207b0c2d56a6 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:00.776998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 256/530] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:00.778894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394867a1-1089-44cc-8706-cac3133e1543 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:00.801761 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3cc07-077f-4190-9fd1-207b0c2d56a6 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:00.837339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0636be6-107b-42f3-ab1c-ecc1aa8e1d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:00.838139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0636be6-107b-42f3-ab1c-ecc1aa8e1d65 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.838489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0636be6-107b-42f3-ab1c-ecc1aa8e1d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.838835 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0636be6-107b-42f3-ab1c-ecc1aa8e1d65 None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.839686 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0636be6-107b-42f3-ab1c-ecc1aa8e1d65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:00.840214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0636be6-107b-42f3-ab1c-ecc1aa8e1d65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:00.842453 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0636be6-107b-42f3-ab1c-ecc1aa8e1d65 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:00.852026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:00.865413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 275/531] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:00.865413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bef551-fe9f-43f8-bd0a-4a69bf04d385 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.865413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bef551-fe9f-43f8-bd0a-4a69bf04d385 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.865413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bef551-fe9f-43f8-bd0a-4a69bf04d385 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.865413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 276/532] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:00.865413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bef551-fe9f-43f8-bd0a-4a69bf04d385 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:00.894856 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394867a1-1089-44cc-8706-cac3133e1543 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:00.928025 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:00.933496 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889cf66-e737-4de8-ab25-8a5988af02e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:00.934169 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889cf66-e737-4de8-ab25-8a5988af02e1 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:00.934459 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889cf66-e737-4de8-ab25-8a5988af02e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:00.934774 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889cf66-e737-4de8-ab25-8a5988af02e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:00.935495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889cf66-e737-4de8-ab25-8a5988af02e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:00.935830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889cf66-e737-4de8-ab25-8a5988af02e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:00.937244 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889cf66-e737-4de8-ab25-8a5988af02e1 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:00.953753 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 257/533] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:00.953753 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889cf66-e737-4de8-ab25-8a5988af02e1 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:00.979464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bef551-fe9f-43f8-bd0a-4a69bf04d385 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:01.019752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf1d67-c7fd-4f18-964a-b871bb9681ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:01.020551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf1d67-c7fd-4f18-964a-b871bb9681ef None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.020888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf1d67-c7fd-4f18-964a-b871bb9681ef None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.021209 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf1d67-c7fd-4f18-964a-b871bb9681ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.032656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf1d67-c7fd-4f18-964a-b871bb9681ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:01.034137 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf1d67-c7fd-4f18-964a-b871bb9681ef None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:01.052665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-c0cf1d67-c7fd-4f18-964a-b871bb9681ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:01.052665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:01.052665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:01.052665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:01.052665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:01.052665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:01.052665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:01.052665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:01.052665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:01.052665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:01.052665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:01.052665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:01.052665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:01.052665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:01.052665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:01.053527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:01.054376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:01.054376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:01.054376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:01.054376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:01.054376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 277/534] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:01.055200 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5db2c7-cf4b-4f13-8bca-8f34d4824f32 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.055495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5db2c7-cf4b-4f13-8bca-8f34d4824f32 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.055776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5db2c7-cf4b-4f13-8bca-8f34d4824f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.067488 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889cf66-e737-4de8-ab25-8a5988af02e1 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:01.071993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-0a5db2c7-cf4b-4f13-8bca-8f34d4824f32 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:01.073211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0a5db2c7-cf4b-4f13-8bca-8f34d4824f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:01.095332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:01.102976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263d987-10a4-4ced-8bff-1410199d8dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:01.103632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263d987-10a4-4ced-8bff-1410199d8dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.103923 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263d987-10a4-4ced-8bff-1410199d8dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.104196 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263d987-10a4-4ced-8bff-1410199d8dc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.107180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263d987-10a4-4ced-8bff-1410199d8dc7 None admin] RBAC: Adding query filter params (role.id=037df45eceeb4cb7aec314c290fa7820, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=30309e7760004bd795c22dcb55d4ff99) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:01.107180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263d987-10a4-4ced-8bff-1410199d8dc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:01.107180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263d987-10a4-4ced-8bff-1410199d8dc7 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:01.121181 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 258/535] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:00 2022] GET /identity/v3/role_assignments?user.id=30309e7760004bd795c22dcb55d4ff99&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=037df45eceeb4cb7aec314c290fa7820 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:01.121181 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263d987-10a4-4ced-8bff-1410199d8dc7 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:01.148657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 278/536] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:01.149737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5db2c7-cf4b-4f13-8bca-8f34d4824f32 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:01.211315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:01.259737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263d987-10a4-4ced-8bff-1410199d8dc7 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:01.265873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5db2c7-cf4b-4f13-8bca-8f34d4824f32 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:01.298487 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d4d55-b93e-457b-809c-d719feb5e96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:01.299280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d4d55-b93e-457b-809c-d719feb5e96f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.299568 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d4d55-b93e-457b-809c-d719feb5e96f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.299848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d4d55-b93e-457b-809c-d719feb5e96f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.304932 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1052a-d30e-488a-8f89-be331feeafd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:01.305743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1052a-d30e-488a-8f89-be331feeafd5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.306377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1052a-d30e-488a-8f89-be331feeafd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.306765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1052a-d30e-488a-8f89-be331feeafd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.307019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d4d55-b93e-457b-809c-d719feb5e96f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:01.307706 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1052a-d30e-488a-8f89-be331feeafd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:01.308106 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1052a-d30e-488a-8f89-be331feeafd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:01.308473 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d4d55-b93e-457b-809c-d719feb5e96f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:01.311077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1052a-d30e-488a-8f89-be331feeafd5 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:01.323732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-ec0d4d55-b93e-457b-809c-d719feb5e96f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:01.323732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:01.323732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:01.323732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:01.323732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:01.323732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:01.323732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:01.323732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:01.323732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:01.323732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:01.323732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:01.323732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:01.323732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:01.323732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:01.323732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:01.324771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:01.326424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:01.326424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:01.326424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:01.326424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:01.326424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:01.326424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:01.326424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:01.326424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:01.326924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 279/537] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:01.327684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1052a-d30e-488a-8f89-be331feeafd5 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:01.330292 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 259/538] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:01.331104 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d4d55-b93e-457b-809c-d719feb5e96f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:01.400878 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:01.433497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:01.441704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1052a-d30e-488a-8f89-be331feeafd5 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:01.464348 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d4d55-b93e-457b-809c-d719feb5e96f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:01.486167 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d26cd-51c3-4260-88bd-0ea7d11bb152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:01.487126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d26cd-51c3-4260-88bd-0ea7d11bb152 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.487518 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d26cd-51c3-4260-88bd-0ea7d11bb152 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.487902 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d26cd-51c3-4260-88bd-0ea7d11bb152 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.502495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d26cd-51c3-4260-88bd-0ea7d11bb152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:01.508981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ef0c3-a90e-43d4-94e3-0c3fcebb93ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:01.509957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ef0c3-a90e-43d4-94e3-0c3fcebb93ea None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.510347 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ef0c3-a90e-43d4-94e3-0c3fcebb93ea None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.510730 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ef0c3-a90e-43d4-94e3-0c3fcebb93ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.511203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-214d26cd-51c3-4260-88bd-0ea7d11bb152 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:01.511203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:01.511203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:01.511203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:01.511203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:01.511203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:01.511203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:01.511203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:01.511203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:01.511203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:01.511203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:01.511203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:01.511203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:01.511203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:01.511203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:01.511203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:01.512396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:01.512396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:01.512396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:01.512396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:01.512396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:01.512396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:01.512396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:01.512396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:01.512396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:01.512396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:01.512396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:01.512396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:01.512396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:01.512396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:01.512396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:01.512396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:01.513882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:01.513882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:01.513882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:01.513882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:01.513882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:01.513882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:01.513882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:01.513882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:01.513882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:01.513882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:01.513882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:01.513882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:01.516292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 280/539] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:01.517375 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d26cd-51c3-4260-88bd-0ea7d11bb152 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:01.521840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ef0c3-a90e-43d4-94e3-0c3fcebb93ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:01.523000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ef0c3-a90e-43d4-94e3-0c3fcebb93ea None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:01.538601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-332ef0c3-a90e-43d4-94e3-0c3fcebb93ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:01.538601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:01.538601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:01.538601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:01.538601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:01.538601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:01.538601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:01.538601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:01.538601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:01.538601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:01.538601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:01.538601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:01.538601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:01.538601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:01.538601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:01.539489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:01.540592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:01.540592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:01.540592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:01.540592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:01.540592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:01.540592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:01.540592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:01.540592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:01.540592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 260/540] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:01.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ef0c3-a90e-43d4-94e3-0c3fcebb93ea None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:01.631477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d26cd-51c3-4260-88bd-0ea7d11bb152 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:01.657871 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ef0c3-a90e-43d4-94e3-0c3fcebb93ea None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:01.670761 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76efd3-60b3-4e11-93c6-60ba02a9df8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:01.671933 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76efd3-60b3-4e11-93c6-60ba02a9df8a None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.672284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76efd3-60b3-4e11-93c6-60ba02a9df8a None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.672630 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76efd3-60b3-4e11-93c6-60ba02a9df8a None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.673556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76efd3-60b3-4e11-93c6-60ba02a9df8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:01.673937 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76efd3-60b3-4e11-93c6-60ba02a9df8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:01.675646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76efd3-60b3-4e11-93c6-60ba02a9df8a None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:01.677633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:01.692301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 281/541] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:01.697018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76efd3-60b3-4e11-93c6-60ba02a9df8a None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:01.705258 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a030ba7-88ac-4332-ab9e-e3803f8b51f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:01.706114 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a030ba7-88ac-4332-ab9e-e3803f8b51f7 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.706508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a030ba7-88ac-4332-ab9e-e3803f8b51f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.706895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a030ba7-88ac-4332-ab9e-e3803f8b51f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.708490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a030ba7-88ac-4332-ab9e-e3803f8b51f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:01.708910 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a030ba7-88ac-4332-ab9e-e3803f8b51f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:01.710945 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a030ba7-88ac-4332-ab9e-e3803f8b51f7 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:01.722681 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:01.726208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 261/542] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:01.726927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a030ba7-88ac-4332-ab9e-e3803f8b51f7 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:01.811364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76efd3-60b3-4e11-93c6-60ba02a9df8a None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:01.837770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a030ba7-88ac-4332-ab9e-e3803f8b51f7 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:01.848523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1ad67-23c5-4c39-a185-1f0c6cb16615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:01.849214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ad67-23c5-4c39-a185-1f0c6cb16615 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.849503 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ad67-23c5-4c39-a185-1f0c6cb16615 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.849782 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ad67-23c5-4c39-a185-1f0c6cb16615 None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.850599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1ad67-23c5-4c39-a185-1f0c6cb16615 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:01.850912 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1ad67-23c5-4c39-a185-1f0c6cb16615 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:01.852479 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1ad67-23c5-4c39-a185-1f0c6cb16615 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:01.865499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 282/543] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:01.866802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39064c-066c-4d1b-b4ce-270a5d2bd400 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.867096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39064c-066c-4d1b-b4ce-270a5d2bd400 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.867380 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39064c-066c-4d1b-b4ce-270a5d2bd400 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.868767 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 283/544] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:01.873792 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39064c-066c-4d1b-b4ce-270a5d2bd400 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:01.878824 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa7095-379f-4344-8b4d-53d63b5104b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:01.879492 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa7095-379f-4344-8b4d-53d63b5104b0 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:01.879781 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa7095-379f-4344-8b4d-53d63b5104b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:01.880063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa7095-379f-4344-8b4d-53d63b5104b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:01.880890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa7095-379f-4344-8b4d-53d63b5104b0 None admin] RBAC: Adding query filter params (role.id=037df45eceeb4cb7aec314c290fa7820, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=e8f268ca2cb34c06b188908495cdcd53) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:01.881235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa7095-379f-4344-8b4d-53d63b5104b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:01.882669 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa7095-379f-4344-8b4d-53d63b5104b0 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:01.888357 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 262/545] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:01 2022] GET /identity/v3/role_assignments?user.id=e8f268ca2cb34c06b188908495cdcd53&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=037df45eceeb4cb7aec314c290fa7820 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:01.889278 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa7095-379f-4344-8b4d-53d63b5104b0 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:01.940878 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:01.997538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:02.017536 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39064c-066c-4d1b-b4ce-270a5d2bd400 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:02.023119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa7095-379f-4344-8b4d-53d63b5104b0 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:02.056437 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70015b29-898b-48a7-8391-b257cd4d86fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:02.058328 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70015b29-898b-48a7-8391-b257cd4d86fd None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:02.059318 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70015b29-898b-48a7-8391-b257cd4d86fd None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:02.060105 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70015b29-898b-48a7-8391-b257cd4d86fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:02.071695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2008d-72ac-42db-87f6-52ca7cfaa491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:02.072439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2008d-72ac-42db-87f6-52ca7cfaa491 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:02.072704 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2008d-72ac-42db-87f6-52ca7cfaa491 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:02.072990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2008d-72ac-42db-87f6-52ca7cfaa491 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:02.075146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70015b29-898b-48a7-8391-b257cd4d86fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:02.076105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2008d-72ac-42db-87f6-52ca7cfaa491 None admin] RBAC: Adding query filter params (role.id=037df45eceeb4cb7aec314c290fa7820, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=db3b603ceffb43bc99684e0d2319e3ce) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:02.076432 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2008d-72ac-42db-87f6-52ca7cfaa491 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:02.077520 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70015b29-898b-48a7-8391-b257cd4d86fd None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:02.077894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2008d-72ac-42db-87f6-52ca7cfaa491 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:02.085007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 263/546] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:01 2022] GET /identity/v3/role_assignments?user.id=db3b603ceffb43bc99684e0d2319e3ce&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=037df45eceeb4cb7aec314c290fa7820 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:02.091481 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aa14a-4056-4bc2-aafa-2634f6503c82 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:02.092156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aa14a-4056-4bc2-aafa-2634f6503c82 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:02.092635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99aa14a-4056-4bc2-aafa-2634f6503c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:02.097729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-70015b29-898b-48a7-8391-b257cd4d86fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:02.097729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:02.097729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:02.097729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:02.097729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:02.097729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:02.097729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:02.097729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:02.097729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:02.097729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:02.097729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:02.097729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:02.097729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:02.097729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:02.097729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:02.098752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:02.099586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:02.099586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:02.099586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:02.099586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:02.099586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 284/547] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:02.104466 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70015b29-898b-48a7-8391-b257cd4d86fd None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:02.117221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-d99aa14a-4056-4bc2-aafa-2634f6503c82 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:02.119560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d99aa14a-4056-4bc2-aafa-2634f6503c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:02.249465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 264/548] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:02.275917 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99aa14a-4056-4bc2-aafa-2634f6503c82 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:02.304180 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70015b29-898b-48a7-8391-b257cd4d86fd None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:02.340805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:02.358794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:02.369321 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33da48-d37a-4a4f-9dcc-eab4551dd0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:02.370044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33da48-d37a-4a4f-9dcc-eab4551dd0cd None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:02.370333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33da48-d37a-4a4f-9dcc-eab4551dd0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:02.370611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33da48-d37a-4a4f-9dcc-eab4551dd0cd None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:02.371340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33da48-d37a-4a4f-9dcc-eab4551dd0cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:02.371649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33da48-d37a-4a4f-9dcc-eab4551dd0cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:02.373064 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33da48-d37a-4a4f-9dcc-eab4551dd0cd None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:02.398361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 285/549] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:02.408599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33da48-d37a-4a4f-9dcc-eab4551dd0cd None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:02.464513 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99aa14a-4056-4bc2-aafa-2634f6503c82 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:02.506721 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59778169-2339-46b7-861a-d8d79379c17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:02.507465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59778169-2339-46b7-861a-d8d79379c17e None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:02.507750 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59778169-2339-46b7-861a-d8d79379c17e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:02.508173 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59778169-2339-46b7-861a-d8d79379c17e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:02.524931 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59778169-2339-46b7-861a-d8d79379c17e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:02.540247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-59778169-2339-46b7-861a-d8d79379c17e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:02.540247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:02.540247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:02.540247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:02.540247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:02.540247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:02.540247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:02.540247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:02.540247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:02.540247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:02.540247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:02.540247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:02.540247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:02.540247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:02.540247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:02.540247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:02.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:02.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:02.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:02.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:02.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:02.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:02.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:02.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:02.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:02.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:02.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:02.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:02.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:02.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:02.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:02.541199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:02.542019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:02.542019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:02.542019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:02.542019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:02.542019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:02.542019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:02.542019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:02.542019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:02.542019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:02.542019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:02.542019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:02.542019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:02.542019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 265/550] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:02.551784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59778169-2339-46b7-861a-d8d79379c17e None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:02.643958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33da48-d37a-4a4f-9dcc-eab4551dd0cd None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:02.662091 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59778169-2339-46b7-861a-d8d79379c17e None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:02.677489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:02.699531 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871dd7d-865e-49ef-8838-49d9897a9b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:02.700210 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871dd7d-865e-49ef-8838-49d9897a9b7e None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:02.700559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871dd7d-865e-49ef-8838-49d9897a9b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:02.705165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871dd7d-865e-49ef-8838-49d9897a9b7e None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:02.705165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871dd7d-865e-49ef-8838-49d9897a9b7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:02.705165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871dd7d-865e-49ef-8838-49d9897a9b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:02.705165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871dd7d-865e-49ef-8838-49d9897a9b7e None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:02.708364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b46eac-1798-4cc9-901e-218317bd0ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:02.709206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b46eac-1798-4cc9-901e-218317bd0ecf None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:02.718217 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b46eac-1798-4cc9-901e-218317bd0ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:02.718217 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b46eac-1798-4cc9-901e-218317bd0ecf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:02.726422 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 266/551] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:02.727419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b46eac-1798-4cc9-901e-218317bd0ecf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:02.729019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b46eac-1798-4cc9-901e-218317bd0ecf None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:02.732874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871dd7d-865e-49ef-8838-49d9897a9b7e None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:02.754871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-73b46eac-1798-4cc9-901e-218317bd0ecf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:44:02.754871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:02.754871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:02.754871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:02.754871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:02.754871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:02.754871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:02.754871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:02.754871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:02.754871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:02.754871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:02.754871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:02.754871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:02.754871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:02.754871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:02.754871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:02.755838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:02.756779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:02.756779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:02.756779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:02.756779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:02.756779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:02.756779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:02.756779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:02.756779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:02.756779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:44:02.756779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:02.771907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 286/552] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:02.777793 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b46eac-1798-4cc9-901e-218317bd0ecf None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:02.881053 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:02.955089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871dd7d-865e-49ef-8838-49d9897a9b7e None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:02.961516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b46eac-1798-4cc9-901e-218317bd0ecf None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:02.999235 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed941cb5-7b0b-487a-aceb-bf505906ffd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:03.000052 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed941cb5-7b0b-487a-aceb-bf505906ffd7 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.000341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed941cb5-7b0b-487a-aceb-bf505906ffd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.000620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed941cb5-7b0b-487a-aceb-bf505906ffd7 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.001512 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed941cb5-7b0b-487a-aceb-bf505906ffd7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:03.001823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed941cb5-7b0b-487a-aceb-bf505906ffd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:03.003439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed941cb5-7b0b-487a-aceb-bf505906ffd7 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:03.023692 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 287/553] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jun 16 14:44:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:03.029791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed941cb5-7b0b-487a-aceb-bf505906ffd7 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:03.081910 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75594d-1f36-4f20-9b8e-1cda9746616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:03.082783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75594d-1f36-4f20-9b8e-1cda9746616c None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.083078 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75594d-1f36-4f20-9b8e-1cda9746616c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.083359 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75594d-1f36-4f20-9b8e-1cda9746616c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.115083 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75594d-1f36-4f20-9b8e-1cda9746616c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:03.116554 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75594d-1f36-4f20-9b8e-1cda9746616c None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:03.135435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed941cb5-7b0b-487a-aceb-bf505906ffd7 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:03.153238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-db75594d-1f36-4f20-9b8e-1cda9746616c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:03.153238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:03.153238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:03.153238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:03.153238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:03.153238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:03.153238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:03.153238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:03.153238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:03.153238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:03.153238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:03.153238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:03.153238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:03.153238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:03.153238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:03.155249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:03.157369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:03.157369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:03.157369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:03.157369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:03.161593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 267/554] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:03.166068 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:03.166784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75594d-1f36-4f20-9b8e-1cda9746616c None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:03.175391 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58941dc-07eb-4957-a239-af26b438bea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:03.176069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58941dc-07eb-4957-a239-af26b438bea9 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.176355 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58941dc-07eb-4957-a239-af26b438bea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.176618 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58941dc-07eb-4957-a239-af26b438bea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.189541 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:03.334547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58941dc-07eb-4957-a239-af26b438bea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:03.336428 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58941dc-07eb-4957-a239-af26b438bea9 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:03.357846 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75594d-1f36-4f20-9b8e-1cda9746616c None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:03.405228 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4d666-06cc-4c52-a93c-5253fd8067f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:03.405228 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4d666-06cc-4c52-a93c-5253fd8067f7 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.405228 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4d666-06cc-4c52-a93c-5253fd8067f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.405228 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4d666-06cc-4c52-a93c-5253fd8067f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.405638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4d666-06cc-4c52-a93c-5253fd8067f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:03.405638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4d666-06cc-4c52-a93c-5253fd8067f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:03.406391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4d666-06cc-4c52-a93c-5253fd8067f7 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:03.425848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 268/555] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:03.438183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4d666-06cc-4c52-a93c-5253fd8067f7 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:03.508397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 288/556] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 14:44:03.510178 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c0d10-6d8d-4cbf-99bc-f28fb773e5a7 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.510696 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c0d10-6d8d-4cbf-99bc-f28fb773e5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.511171 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c0d10-6d8d-4cbf-99bc-f28fb773e5a7 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.512916 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 289/557] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:03.514161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c0d10-6d8d-4cbf-99bc-f28fb773e5a7 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:03.524774 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:03.569637 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4d666-06cc-4c52-a93c-5253fd8067f7 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:03.577482 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:03.613791 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1643f-8db8-49ec-8488-a3475985a5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:03.614500 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1643f-8db8-49ec-8488-a3475985a5eb None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.614791 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1643f-8db8-49ec-8488-a3475985a5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.615075 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1643f-8db8-49ec-8488-a3475985a5eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.620690 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c0d10-6d8d-4cbf-99bc-f28fb773e5a7 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:03.622703 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1643f-8db8-49ec-8488-a3475985a5eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:03.624265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1643f-8db8-49ec-8488-a3475985a5eb None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:03.640334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-22b1643f-8db8-49ec-8488-a3475985a5eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:03.640334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:03.640334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:03.640334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:03.640334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:03.640334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:03.640334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:03.640334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:03.640334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:03.640334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:03.640334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:03.640334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:03.640334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:03.640334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:03.640334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:03.640334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:03.641783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:03.642693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:03.642693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:03.642693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:03.642693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:03.642693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:03.642693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:03.642693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:03.642693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:03.642693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:03.642693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:03.645671 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 269/558] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 16 14:44:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:03.646566 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fd555-6d18-46ce-9cbd-76dd857ce6c0 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.646863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fd555-6d18-46ce-9cbd-76dd857ce6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.647150 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fd555-6d18-46ce-9cbd-76dd857ce6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.661788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca32c8-71d5-4364-82ec-ff85973daac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:03.662935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca32c8-71d5-4364-82ec-ff85973daac5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.663465 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca32c8-71d5-4364-82ec-ff85973daac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.663964 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca32c8-71d5-4364-82ec-ff85973daac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.666360 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-026fd555-6d18-46ce-9cbd-76dd857ce6c0 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:03.667689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-026fd555-6d18-46ce-9cbd-76dd857ce6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:03.676048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca32c8-71d5-4364-82ec-ff85973daac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:03.677837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca32c8-71d5-4364-82ec-ff85973daac5 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:03.696081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-32ca32c8-71d5-4364-82ec-ff85973daac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:03.696081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:03.696081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:03.696081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:03.696081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:03.696081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:03.696081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:03.696081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:03.696081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:03.696081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:03.696081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:03.696081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:03.696081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:03.696081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:03.696081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:03.697022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:03.698197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:03.698197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:03.698197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:03.698197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:03.700241 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 290/559] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:03.701383 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca32c8-71d5-4364-82ec-ff85973daac5 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:03.755669 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 270/560] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:03.761319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fd555-6d18-46ce-9cbd-76dd857ce6c0 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:03.777180 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:03.820901 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:03.832492 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca32c8-71d5-4364-82ec-ff85973daac5 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:03.868825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b4e53-4b68-4a26-b0c2-f704b4c71c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:03.869049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fd555-6d18-46ce-9cbd-76dd857ce6c0 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:03.870080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b4e53-4b68-4a26-b0c2-f704b4c71c15 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.870565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b4e53-4b68-4a26-b0c2-f704b4c71c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.871011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b4e53-4b68-4a26-b0c2-f704b4c71c15 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.872021 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b4e53-4b68-4a26-b0c2-f704b4c71c15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:03.872552 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b4e53-4b68-4a26-b0c2-f704b4c71c15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:03.874253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b4e53-4b68-4a26-b0c2-f704b4c71c15 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:03.945305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 291/561] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 16 14:44:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:03.946900 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b4e53-4b68-4a26-b0c2-f704b4c71c15 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:03.982276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad747270-191f-4448-9f1b-9776951f2ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:03.983444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747270-191f-4448-9f1b-9776951f2ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:03.983882 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747270-191f-4448-9f1b-9776951f2ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:03.984311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747270-191f-4448-9f1b-9776951f2ef0 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:03.985344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad747270-191f-4448-9f1b-9776951f2ef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:03.985804 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad747270-191f-4448-9f1b-9776951f2ef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:03.987518 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad747270-191f-4448-9f1b-9776951f2ef0 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.001451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 271/562] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:04.003275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad747270-191f-4448-9f1b-9776951f2ef0 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.062674 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b4e53-4b68-4a26-b0c2-f704b4c71c15 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.081768 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:04.102455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05412c4c-0e7d-4c0e-bf5a-a1ddd5038188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.103442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05412c4c-0e7d-4c0e-bf5a-a1ddd5038188 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.103854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05412c4c-0e7d-4c0e-bf5a-a1ddd5038188 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.104235 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05412c4c-0e7d-4c0e-bf5a-a1ddd5038188 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.116938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05412c4c-0e7d-4c0e-bf5a-a1ddd5038188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:04.125243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-05412c4c-0e7d-4c0e-bf5a-a1ddd5038188 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:04.125243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:04.125243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:04.125243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:04.125243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:04.125243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:04.125243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:04.125243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:04.125243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:04.125243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:04.125243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:04.125243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:04.125243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:04.125243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:04.125243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:04.125243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:04.126370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:04.126370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:04.126370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:04.126370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:04.126370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:04.126370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:04.126370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:04.126370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:04.126370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:04.126370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:04.126370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:04.126370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:04.126370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:04.126370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:04.126370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:04.126370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:04.127413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:04.127413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:04.127413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:04.127413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:04.127413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:04.127413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:04.127413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:04.127413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:04.127413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:04.127413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:04.127413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:04.127413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:04.134147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 292/563] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:04.135128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05412c4c-0e7d-4c0e-bf5a-a1ddd5038188 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.137346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad747270-191f-4448-9f1b-9776951f2ef0 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.161609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:04.188425 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502a468-a221-410b-a82b-dfdba2f5a2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.189726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502a468-a221-410b-a82b-dfdba2f5a2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.190107 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502a468-a221-410b-a82b-dfdba2f5a2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.190448 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502a468-a221-410b-a82b-dfdba2f5a2c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.204750 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502a468-a221-410b-a82b-dfdba2f5a2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:04.207031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502a468-a221-410b-a82b-dfdba2f5a2c6 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.226479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-d502a468-a221-410b-a82b-dfdba2f5a2c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:04.226479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:04.226479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:04.226479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:04.226479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:04.226479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:04.226479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:04.226479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:04.226479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:04.226479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:04.226479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:04.226479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:04.226479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:04.226479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:04.226479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:04.230031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:04.230940 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:04.230940 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:04.230940 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:04.230940 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:04.230940 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 272/564] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:04.232164 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502a468-a221-410b-a82b-dfdba2f5a2c6 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.258203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05412c4c-0e7d-4c0e-bf5a-a1ddd5038188 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.304028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c7a1b-37ef-4ceb-8f1e-33c5f21dbfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.305399 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c7a1b-37ef-4ceb-8f1e-33c5f21dbfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.306123 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c7a1b-37ef-4ceb-8f1e-33c5f21dbfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.306575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c7a1b-37ef-4ceb-8f1e-33c5f21dbfa1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.315528 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c7a1b-37ef-4ceb-8f1e-33c5f21dbfa1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:04.316982 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c7a1b-37ef-4ceb-8f1e-33c5f21dbfa1 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.331779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-4d6c7a1b-37ef-4ceb-8f1e-33c5f21dbfa1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:04.331779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:04.331779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:04.331779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:04.331779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:04.331779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:04.331779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:04.331779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:04.331779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:04.331779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:04.331779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:04.331779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:04.331779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:04.331779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:04.331779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:04.332878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:04.339092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:04.339092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:04.339092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:04.339092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:04.339092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:04.339092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:04.339092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:04.339092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:04.339092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 293/565] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:04.339092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c7a1b-37ef-4ceb-8f1e-33c5f21dbfa1 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.363269 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502a468-a221-410b-a82b-dfdba2f5a2c6 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.375956 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:04.402373 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efff3cf-bca6-494f-a2a1-c799e24cefc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.403490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efff3cf-bca6-494f-a2a1-c799e24cefc5 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.404068 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efff3cf-bca6-494f-a2a1-c799e24cefc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.404376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efff3cf-bca6-494f-a2a1-c799e24cefc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.405360 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efff3cf-bca6-494f-a2a1-c799e24cefc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:04.405743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efff3cf-bca6-494f-a2a1-c799e24cefc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:04.407231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efff3cf-bca6-494f-a2a1-c799e24cefc5 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.416990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 273/566] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:04.423269 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9c05e-31cb-48ae-b36f-700a39160be5 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.423572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9c05e-31cb-48ae-b36f-700a39160be5 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.423867 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9c05e-31cb-48ae-b36f-700a39160be5 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.425207 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 274/567] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:04.425967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9c05e-31cb-48ae-b36f-700a39160be5 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.446692 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c7a1b-37ef-4ceb-8f1e-33c5f21dbfa1 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.457398 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:04.481600 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dbf5f-3e83-41f0-a8f8-f72d55027f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.482371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dbf5f-3e83-41f0-a8f8-f72d55027f09 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.482726 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dbf5f-3e83-41f0-a8f8-f72d55027f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.483078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dbf5f-3e83-41f0-a8f8-f72d55027f09 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.483868 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dbf5f-3e83-41f0-a8f8-f72d55027f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:04.484272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dbf5f-3e83-41f0-a8f8-f72d55027f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:04.485717 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dbf5f-3e83-41f0-a8f8-f72d55027f09 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.496722 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 294/568] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:04.498032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dbf5f-3e83-41f0-a8f8-f72d55027f09 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.529042 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9c05e-31cb-48ae-b36f-700a39160be5 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.562338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f4ae2-b349-4071-b27f-f53191c60968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.562999 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f4ae2-b349-4071-b27f-f53191c60968 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.563286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f4ae2-b349-4071-b27f-f53191c60968 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.563570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f4ae2-b349-4071-b27f-f53191c60968 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.564354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f4ae2-b349-4071-b27f-f53191c60968 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:04.564667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f4ae2-b349-4071-b27f-f53191c60968 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:04.566140 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f4ae2-b349-4071-b27f-f53191c60968 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.578899 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 275/569] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:04.580087 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bea150-d4eb-423c-85fc-bd034c9aa400 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.580389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bea150-d4eb-423c-85fc-bd034c9aa400 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.580672 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bea150-d4eb-423c-85fc-bd034c9aa400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.591895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:04.595290 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dbf5f-3e83-41f0-a8f8-f72d55027f09 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.595685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-85bea150-d4eb-423c-85fc-bd034c9aa400 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:04.596890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-85bea150-d4eb-423c-85fc-bd034c9aa400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:04.628137 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00530c61-a6e4-43c2-91b2-e38bbf5cbb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.628865 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00530c61-a6e4-43c2-91b2-e38bbf5cbb94 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.629172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00530c61-a6e4-43c2-91b2-e38bbf5cbb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.629457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00530c61-a6e4-43c2-91b2-e38bbf5cbb94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.640404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00530c61-a6e4-43c2-91b2-e38bbf5cbb94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:04.641928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00530c61-a6e4-43c2-91b2-e38bbf5cbb94 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.658961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-00530c61-a6e4-43c2-91b2-e38bbf5cbb94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:04.658961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:04.658961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:04.658961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:04.658961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:04.658961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:04.658961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:04.658961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:04.658961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:04.658961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:04.658961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:04.658961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:04.658961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:04.658961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:04.658961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:04.659834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:04.660717 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:04.660717 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:04.660717 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:04.660717 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:04.660717 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 295/570] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:04.661359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274680b3-17c6-4416-96d6-bbf38d3b8821 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.661616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274680b3-17c6-4416-96d6-bbf38d3b8821 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.661896 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274680b3-17c6-4416-96d6-bbf38d3b8821 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.663139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 296/571] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:04.663813 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274680b3-17c6-4416-96d6-bbf38d3b8821 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.665998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 276/572] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:04.667025 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bea150-d4eb-423c-85fc-bd034c9aa400 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.689776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:04.765224 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274680b3-17c6-4416-96d6-bbf38d3b8821 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.768483 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bea150-d4eb-423c-85fc-bd034c9aa400 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.802151 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8c10c-2c97-4920-88bf-a55886cdcc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.802954 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8c10c-2c97-4920-88bf-a55886cdcc9d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.803235 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8c10c-2c97-4920-88bf-a55886cdcc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.803511 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8c10c-2c97-4920-88bf-a55886cdcc9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.808547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244f71c-36c2-41a6-bc01-22afa73d4f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.809239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244f71c-36c2-41a6-bc01-22afa73d4f76 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.809530 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244f71c-36c2-41a6-bc01-22afa73d4f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.809813 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244f71c-36c2-41a6-bc01-22afa73d4f76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.810844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8c10c-2c97-4920-88bf-a55886cdcc9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:04.811304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244f71c-36c2-41a6-bc01-22afa73d4f76 None admin] RBAC: Adding query filter params (role.id=037df45eceeb4cb7aec314c290fa7820, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=a952ee6a39e1453b80a8a8b787d0fdf5) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:04.811675 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244f71c-36c2-41a6-bc01-22afa73d4f76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:04.812289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8c10c-2c97-4920-88bf-a55886cdcc9d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.813089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244f71c-36c2-41a6-bc01-22afa73d4f76 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:04.818986 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 277/573] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/role_assignments?user.id=a952ee6a39e1453b80a8a8b787d0fdf5&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=037df45eceeb4cb7aec314c290fa7820 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:04.819852 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244f71c-36c2-41a6-bc01-22afa73d4f76 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.827395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-3db8c10c-2c97-4920-88bf-a55886cdcc9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:04.827395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:04.827395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:04.827395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:04.827395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:04.827395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:04.827395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:04.827395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:04.827395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:04.827395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:04.827395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:04.827395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:04.827395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:04.827395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:04.827395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:04.828365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:04.829286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:04.829286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:04.829286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:04.829286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:04.829286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:04.829286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:04.829286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:04.829286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:04.829286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 297/574] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:04.830860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05a388-c54d-4c2a-85eb-3c5f90a25819 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.831072 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05a388-c54d-4c2a-85eb-3c5f90a25819 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.831342 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05a388-c54d-4c2a-85eb-3c5f90a25819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.851539 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-6e05a388-c54d-4c2a-85eb-3c5f90a25819 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:04.852789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6e05a388-c54d-4c2a-85eb-3c5f90a25819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:04.857720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:04.923577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:04.937248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 298/575] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:04.937248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05a388-c54d-4c2a-85eb-3c5f90a25819 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:04.947747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244f71c-36c2-41a6-bc01-22afa73d4f76 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:04.997531 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91a044-72bf-4be2-94dd-297c4a4f2084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:04.998266 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91a044-72bf-4be2-94dd-297c4a4f2084 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:04.998482 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91a044-72bf-4be2-94dd-297c4a4f2084 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:04.998785 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91a044-72bf-4be2-94dd-297c4a4f2084 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:04.999490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91a044-72bf-4be2-94dd-297c4a4f2084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:04.999803 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91a044-72bf-4be2-94dd-297c4a4f2084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:05.001209 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91a044-72bf-4be2-94dd-297c4a4f2084 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:05.013761 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 278/576] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:05.014612 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91a044-72bf-4be2-94dd-297c4a4f2084 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:05.064340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05a388-c54d-4c2a-85eb-3c5f90a25819 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:05.104652 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4bb84-2108-4d05-bfc8-aaac872a5725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:05.105932 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4bb84-2108-4d05-bfc8-aaac872a5725 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:05.106300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4bb84-2108-4d05-bfc8-aaac872a5725 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:05.106653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4bb84-2108-4d05-bfc8-aaac872a5725 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:05.115970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:05.119198 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4bb84-2108-4d05-bfc8-aaac872a5725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:05.127184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-dda4bb84-2108-4d05-bfc8-aaac872a5725 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:05.127184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:05.127184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:05.127184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:05.127184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:05.127184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:05.127184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:05.127184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:05.127184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:05.127184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:05.127184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:05.127184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:05.127184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:05.127184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:05.127184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:05.127184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:05.134306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:05.134306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:05.134306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:05.134306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:05.134306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:05.134306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:05.134306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:05.134306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:05.134306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:05.134306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:05.134306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:05.134306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:05.134306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:05.134306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:05.134306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:05.134306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:05.135327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:05.135327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:05.135327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:05.135327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:05.135327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:05.135327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:05.135327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:05.135327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:05.135327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:05.135327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:05.135327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:05.135327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:05.135327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 299/577] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:05.135327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4bb84-2108-4d05-bfc8-aaac872a5725 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:05.136238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91a044-72bf-4be2-94dd-297c4a4f2084 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:05.168354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1046b-12d4-4186-afaf-57601f432355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:05.169150 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1046b-12d4-4186-afaf-57601f432355 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:05.170117 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1046b-12d4-4186-afaf-57601f432355 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:05.170475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1046b-12d4-4186-afaf-57601f432355 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:05.171376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1046b-12d4-4186-afaf-57601f432355 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:05.171795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1046b-12d4-4186-afaf-57601f432355 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:05.173349 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1046b-12d4-4186-afaf-57601f432355 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:05.190043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 279/578] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:05.190043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1046b-12d4-4186-afaf-57601f432355 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:05.194762 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:05.244479 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4bb84-2108-4d05-bfc8-aaac872a5725 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:05.281312 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed002c8-e94d-43ab-aa52-8ab02469a930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:05.282120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed002c8-e94d-43ab-aa52-8ab02469a930 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:05.282415 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed002c8-e94d-43ab-aa52-8ab02469a930 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:05.282709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed002c8-e94d-43ab-aa52-8ab02469a930 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:05.294325 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed002c8-e94d-43ab-aa52-8ab02469a930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:05.298856 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1046b-12d4-4186-afaf-57601f432355 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:05.302734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-eed002c8-e94d-43ab-aa52-8ab02469a930 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:05.302734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:05.302734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:05.302734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:05.302734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:05.302734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:05.302734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:05.302734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:05.302734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:05.302734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:05.302734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:05.302734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:05.302734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:05.302734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:05.302734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:05.302734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:05.303632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:05.303632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:05.303632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:05.303632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:05.303632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:05.303632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:05.303632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:05.303632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:05.303632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:05.303632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:05.303632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:05.303632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:05.303632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:05.303632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:05.303632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:05.303632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:05.304462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:05.304462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:05.304462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:05.304462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:05.304462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:05.304462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:05.304462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:05.304462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:05.304462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:05.304462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:05.304462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:05.304462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:05.304462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 300/579] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:05.305166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed002c8-e94d-43ab-aa52-8ab02469a930 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:05.338643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d32fb5-827f-44af-8c6d-b10f2f4da5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:05.339550 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d32fb5-827f-44af-8c6d-b10f2f4da5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:05.339944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d32fb5-827f-44af-8c6d-b10f2f4da5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:05.340222 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d32fb5-827f-44af-8c6d-b10f2f4da5f4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:05.350629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d32fb5-827f-44af-8c6d-b10f2f4da5f4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:05.352088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d32fb5-827f-44af-8c6d-b10f2f4da5f4 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:05.370944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-d5d32fb5-827f-44af-8c6d-b10f2f4da5f4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:44:05.370944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:05.370944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:05.370944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:05.370944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:05.370944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:05.370944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:05.370944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:05.370944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:05.370944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:05.370944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:05.370944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:05.370944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:05.370944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:05.370944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:05.370944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:05.374578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:05.377616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:05.377616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:05.377616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:05.377616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:05.377616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:05.377616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:05.377616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:05.377616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:05.377616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:44:05.377616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:05.377616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 280/580] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:05.377616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d32fb5-827f-44af-8c6d-b10f2f4da5f4 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:05.384817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:05.428993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed002c8-e94d-43ab-aa52-8ab02469a930 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:05.442596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:05.464781 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bac37b-b199-4d3c-b978-c448496e226e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:05.465489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bac37b-b199-4d3c-b978-c448496e226e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:05.465773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bac37b-b199-4d3c-b978-c448496e226e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:05.466102 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bac37b-b199-4d3c-b978-c448496e226e None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:05.467420 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bac37b-b199-4d3c-b978-c448496e226e None admin] RBAC: Adding query filter params (name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:05.467737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bac37b-b199-4d3c-b978-c448496e226e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:05.469110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bac37b-b199-4d3c-b978-c448496e226e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:05.478098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 301/581] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:05.483051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bac37b-b199-4d3c-b978-c448496e226e None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:05.484337 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d32fb5-827f-44af-8c6d-b10f2f4da5f4 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:05.520734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c14ed-c3a1-47b7-a815-b3f9eaf1ead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:05.521812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c14ed-c3a1-47b7-a815-b3f9eaf1ead0 None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:05.522219 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c14ed-c3a1-47b7-a815-b3f9eaf1ead0 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:05.522594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c14ed-c3a1-47b7-a815-b3f9eaf1ead0 None admin] PATH_INFO: `/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/60c2f1c63a674e3195c490ab5ad1318f/roles/037df45eceeb4cb7aec314c290fa7820` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:05.539861 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c14ed-c3a1-47b7-a815-b3f9eaf1ead0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9e5996685142bb94c83c5403fbf17d, user_id=60c2f1c63a674e3195c490ab5ad1318f, role_id=037df45eceeb4cb7aec314c290fa7820)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:05.541489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c14ed-c3a1-47b7-a815-b3f9eaf1ead0 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:05.585025 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bac37b-b199-4d3c-b978-c448496e226e None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:05.601052 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 281/582] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:44:05 2022] PUT /identity/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/60c2f1c63a674e3195c490ab5ad1318f/roles/037df45eceeb4cb7aec314c290fa7820 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:44:05.602199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c14ed-c3a1-47b7-a815-b3f9eaf1ead0 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:05.609673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:05.627734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8848b-55da-4958-a403-cfee7ed57955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:05.628864 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8848b-55da-4958-a403-cfee7ed57955 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:05.629440 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8848b-55da-4958-a403-cfee7ed57955 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:05.629861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8848b-55da-4958-a403-cfee7ed57955 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:05.630807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8848b-55da-4958-a403-cfee7ed57955 None admin] RBAC: Adding query filter params (name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:05.631449 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8848b-55da-4958-a403-cfee7ed57955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:05.633175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8848b-55da-4958-a403-cfee7ed57955 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:05.652000 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 302/583] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:05.654051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8848b-55da-4958-a403-cfee7ed57955 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:05.751735 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c14ed-c3a1-47b7-a815-b3f9eaf1ead0 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:05.771307 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:05.784000 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8848b-55da-4958-a403-cfee7ed57955 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:05.796717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad08cbf-58d9-4331-af81-10348f9067bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:05.797552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad08cbf-58d9-4331-af81-10348f9067bb None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:05.800131 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad08cbf-58d9-4331-af81-10348f9067bb None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:05.800131 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad08cbf-58d9-4331-af81-10348f9067bb None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:05.800131 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad08cbf-58d9-4331-af81-10348f9067bb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:05.800476 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad08cbf-58d9-4331-af81-10348f9067bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:05.802449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad08cbf-58d9-4331-af81-10348f9067bb None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:05.822976 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941fdb7-d7ed-4677-91b0-08a28631cea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:05.824021 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941fdb7-d7ed-4677-91b0-08a28631cea5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:05.824308 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941fdb7-d7ed-4677-91b0-08a28631cea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:05.824586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941fdb7-d7ed-4677-91b0-08a28631cea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:05.828697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 282/584] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jun 16 14:44:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:05.829825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad08cbf-58d9-4331-af81-10348f9067bb None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:05.839093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941fdb7-d7ed-4677-91b0-08a28631cea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:05.840570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941fdb7-d7ed-4677-91b0-08a28631cea5 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:05.861562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-4941fdb7-d7ed-4677-91b0-08a28631cea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:05.861562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:05.861562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:05.861562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:05.861562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:05.861562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:05.861562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:05.861562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:05.861562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:05.861562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:05.861562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:05.861562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:05.861562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:05.861562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:05.861562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:05.862747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:05.863799 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:05.863799 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:05.863799 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:05.863799 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:05.863799 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 303/585] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:05.864173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941fdb7-d7ed-4677-91b0-08a28631cea5 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:05.910252 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:05.973616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad08cbf-58d9-4331-af81-10348f9067bb None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:05.997483 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941fdb7-d7ed-4677-91b0-08a28631cea5 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:06.025089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61956d4-7784-454a-9c2c-381e01ec1851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:06.025902 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61956d4-7784-454a-9c2c-381e01ec1851 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:06.026115 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61956d4-7784-454a-9c2c-381e01ec1851 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:06.026569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61956d4-7784-454a-9c2c-381e01ec1851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:06.039543 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61956d4-7784-454a-9c2c-381e01ec1851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:06.041012 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61956d4-7784-454a-9c2c-381e01ec1851 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:06.043954 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0299f1-410d-479e-a38e-01b1b70bd554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:06.045620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0299f1-410d-479e-a38e-01b1b70bd554 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:06.046073 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0299f1-410d-479e-a38e-01b1b70bd554 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:06.046623 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0299f1-410d-479e-a38e-01b1b70bd554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:06.061309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-e61956d4-7784-454a-9c2c-381e01ec1851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:06.061309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:06.061309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:06.061309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:06.061309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:06.061309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:06.061309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:06.061309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:06.061309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:06.061309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:06.061309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:06.061309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:06.061309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:06.061309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:06.061309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:06.062456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:06.063517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:06.063517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:06.063517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:06.063517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:06.063517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 283/586] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:06.063517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61956d4-7784-454a-9c2c-381e01ec1851 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:06.064179 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0299f1-410d-479e-a38e-01b1b70bd554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:06.066083 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0299f1-410d-479e-a38e-01b1b70bd554 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:06.085848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-3a0299f1-410d-479e-a38e-01b1b70bd554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:06.085848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:06.085848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:06.085848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:06.085848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:06.085848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:06.085848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:06.085848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:06.085848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:06.085848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:06.085848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:06.085848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:06.085848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:06.085848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:06.085848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:06.086765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:06.087638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:06.087638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:06.087638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:06.087638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:06.089178 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:06.095159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 304/587] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:06.096318 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0299f1-410d-479e-a38e-01b1b70bd554 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:06.175680 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61956d4-7784-454a-9c2c-381e01ec1851 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:06.196061 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:06.209862 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0299f1-410d-479e-a38e-01b1b70bd554 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:06.214012 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89250d2-b51b-4354-8301-fa190b39f6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:06.214914 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89250d2-b51b-4354-8301-fa190b39f6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:06.215434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89250d2-b51b-4354-8301-fa190b39f6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:06.215928 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89250d2-b51b-4354-8301-fa190b39f6c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:06.216883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89250d2-b51b-4354-8301-fa190b39f6c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:06.217927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89250d2-b51b-4354-8301-fa190b39f6c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:06.219964 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89250d2-b51b-4354-8301-fa190b39f6c7 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:06.235193 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 284/588] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:06.236988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89250d2-b51b-4354-8301-fa190b39f6c7 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:06.250766 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e839974-c058-4a5f-b8ca-92bec690e2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:06.251802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e839974-c058-4a5f-b8ca-92bec690e2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:06.252259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e839974-c058-4a5f-b8ca-92bec690e2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:06.252726 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e839974-c058-4a5f-b8ca-92bec690e2d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:06.253684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e839974-c058-4a5f-b8ca-92bec690e2d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:06.254274 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e839974-c058-4a5f-b8ca-92bec690e2d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:06.256037 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e839974-c058-4a5f-b8ca-92bec690e2d2 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:06.269661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 305/589] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:06.270892 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e839974-c058-4a5f-b8ca-92bec690e2d2 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:06.328419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:06.351491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89250d2-b51b-4354-8301-fa190b39f6c7 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:06.389663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e839974-c058-4a5f-b8ca-92bec690e2d2 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:06.409902 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e6a0f-fbfc-441d-9ef9-94e447dcf9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:06.411053 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e6a0f-fbfc-441d-9ef9-94e447dcf9cc None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:06.411414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e6a0f-fbfc-441d-9ef9-94e447dcf9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:06.411770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e6a0f-fbfc-441d-9ef9-94e447dcf9cc None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:06.412589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e6a0f-fbfc-441d-9ef9-94e447dcf9cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:06.412966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e6a0f-fbfc-441d-9ef9-94e447dcf9cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:06.414740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e6a0f-fbfc-441d-9ef9-94e447dcf9cc None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:06.430210 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 285/590] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:06.431429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e6a0f-fbfc-441d-9ef9-94e447dcf9cc None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:06.446410 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31bf66-05a4-4587-ae9c-45cc7c9f1be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:06.448078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31bf66-05a4-4587-ae9c-45cc7c9f1be9 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:06.449010 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31bf66-05a4-4587-ae9c-45cc7c9f1be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:06.449503 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31bf66-05a4-4587-ae9c-45cc7c9f1be9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:06.460195 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31bf66-05a4-4587-ae9c-45cc7c9f1be9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:06.462021 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31bf66-05a4-4587-ae9c-45cc7c9f1be9 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:06.478485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-ab31bf66-05a4-4587-ae9c-45cc7c9f1be9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:44:06.478485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:06.478485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:06.478485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:06.478485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:06.478485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:06.478485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:06.478485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:06.478485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:06.478485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:06.478485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:06.478485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:06.478485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:06.478485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:06.478485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:06.478485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:06.479477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:06.480406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:06.480406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:06.480406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:06.480406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:06.480406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:06.480406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:06.480406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:06.480406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:06.480406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:44:06.480406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:06.480406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 306/591] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:06.480989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31bf66-05a4-4587-ae9c-45cc7c9f1be9 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:06.493714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:06.568021 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e6a0f-fbfc-441d-9ef9-94e447dcf9cc None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:06.595908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31bf66-05a4-4587-ae9c-45cc7c9f1be9 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:06.612864 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61140ca-8bfa-47cf-b489-3bae75623566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:06.613690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61140ca-8bfa-47cf-b489-3bae75623566 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:06.613973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61140ca-8bfa-47cf-b489-3bae75623566 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:06.614247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61140ca-8bfa-47cf-b489-3bae75623566 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:06.622436 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61140ca-8bfa-47cf-b489-3bae75623566 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:06.623862 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61140ca-8bfa-47cf-b489-3bae75623566 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:06.637086 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db7dcf-b935-475f-bda8-fb7a8e40e8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:06.638202 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db7dcf-b935-475f-bda8-fb7a8e40e8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:06.638734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db7dcf-b935-475f-bda8-fb7a8e40e8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:06.639211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db7dcf-b935-475f-bda8-fb7a8e40e8d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:06.639991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-c61140ca-8bfa-47cf-b489-3bae75623566 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:44:06.639991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:06.639991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:06.639991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:06.639991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:06.639991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:06.639991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:06.639991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:06.639991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:06.639991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:06.639991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:06.639991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:06.639991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:06.639991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:06.639991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:06.639991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:06.640877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:06.641895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:06.641895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:06.641895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:06.641895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:06.641895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:06.641895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:06.641895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:06.641895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:06.641895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:44:06.641895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:06.641895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 286/592] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:06.642487 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61140ca-8bfa-47cf-b489-3bae75623566 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:06.647642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:06.652898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db7dcf-b935-475f-bda8-fb7a8e40e8d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:06.655817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db7dcf-b935-475f-bda8-fb7a8e40e8d1 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:06.676931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-62db7dcf-b935-475f-bda8-fb7a8e40e8d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:06.676931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:06.676931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:06.676931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:06.676931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:06.676931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:06.676931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:06.676931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:06.676931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:06.676931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:06.676931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:06.676931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:06.676931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:06.676931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:06.676931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:06.677889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:06.678817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:06.678817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:06.678817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:06.678817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:06.678817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:06.678817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:06.678817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:06.678817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:06.681269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 307/593] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:06.682354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db7dcf-b935-475f-bda8-fb7a8e40e8d1 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:06.766129 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61140ca-8bfa-47cf-b489-3bae75623566 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:06.766862 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:06.807240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4458c1-b45b-43c4-947d-954c90f82d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:06.808509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4458c1-b45b-43c4-947d-954c90f82d6b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:06.809233 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4458c1-b45b-43c4-947d-954c90f82d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:06.809664 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4458c1-b45b-43c4-947d-954c90f82d6b None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:06.810688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4458c1-b45b-43c4-947d-954c90f82d6b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:06.811164 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4458c1-b45b-43c4-947d-954c90f82d6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:06.811584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db7dcf-b935-475f-bda8-fb7a8e40e8d1 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:06.812926 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4458c1-b45b-43c4-947d-954c90f82d6b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:06.838561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 287/594] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jun 16 14:44:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:06.839893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4458c1-b45b-43c4-947d-954c90f82d6b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:06.851332 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ed1d8-7af7-4932-813d-ef8e2d8aac8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:06.851795 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ed1d8-7af7-4932-813d-ef8e2d8aac8d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:06.852144 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ed1d8-7af7-4932-813d-ef8e2d8aac8d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:06.852487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ed1d8-7af7-4932-813d-ef8e2d8aac8d None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:06.853443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ed1d8-7af7-4932-813d-ef8e2d8aac8d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:06.853821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ed1d8-7af7-4932-813d-ef8e2d8aac8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:06.855379 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ed1d8-7af7-4932-813d-ef8e2d8aac8d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:06.878626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 308/595] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Jun 16 14:44:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:06.879744 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ed1d8-7af7-4932-813d-ef8e2d8aac8d None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:06.928297 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:06.980140 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4458c1-b45b-43c4-947d-954c90f82d6b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:06.987260 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ed1d8-7af7-4932-813d-ef8e2d8aac8d None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:07.017067 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:07.026009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4f842-0f40-4d6c-8a72-9ad5c997e431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:07.026816 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4f842-0f40-4d6c-8a72-9ad5c997e431 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.027103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4f842-0f40-4d6c-8a72-9ad5c997e431 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.027853 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4f842-0f40-4d6c-8a72-9ad5c997e431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.030276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2cc61-1a9d-451f-97dc-913655a80932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:07.031729 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2cc61-1a9d-451f-97dc-913655a80932 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.032167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2cc61-1a9d-451f-97dc-913655a80932 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.032625 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2cc61-1a9d-451f-97dc-913655a80932 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.033594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2cc61-1a9d-451f-97dc-913655a80932 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:07.034049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2cc61-1a9d-451f-97dc-913655a80932 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:07.036063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2cc61-1a9d-451f-97dc-913655a80932 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:07.039737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4f842-0f40-4d6c-8a72-9ad5c997e431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:07.041472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4f842-0f40-4d6c-8a72-9ad5c997e431 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:07.051221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 288/596] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:07.052653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2cc61-1a9d-451f-97dc-913655a80932 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:07.062234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-a0b4f842-0f40-4d6c-8a72-9ad5c997e431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:07.062234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:07.062234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:07.062234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:07.062234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:07.062234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:07.062234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:07.062234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:07.062234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:07.062234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:07.062234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:07.062234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:07.062234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:07.062234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:07.062234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:07.063292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:07.064356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:07.064356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:07.064356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:07.064356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:07.067882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 309/597] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:07.069182 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f29521-5f98-48d9-b3dc-65d1b9b236a0 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.069478 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f29521-5f98-48d9-b3dc-65d1b9b236a0 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.069765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f29521-5f98-48d9-b3dc-65d1b9b236a0 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.071029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 310/598] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:07.071692 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f29521-5f98-48d9-b3dc-65d1b9b236a0 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:07.163741 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2cc61-1a9d-451f-97dc-913655a80932 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:07.178284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f29521-5f98-48d9-b3dc-65d1b9b236a0 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:07.188492 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:07.200456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d686514-818b-43f1-b24b-e602855448ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:07.201098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d686514-818b-43f1-b24b-e602855448ba None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.201449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d686514-818b-43f1-b24b-e602855448ba None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.201689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d686514-818b-43f1-b24b-e602855448ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.212863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d686514-818b-43f1-b24b-e602855448ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:07.214362 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d686514-818b-43f1-b24b-e602855448ba None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:07.215202 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae4fbc-3325-458e-98b1-5bd0ed68fe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:07.216144 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae4fbc-3325-458e-98b1-5bd0ed68fe68 None admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.216431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae4fbc-3325-458e-98b1-5bd0ed68fe68 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.217271 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae4fbc-3325-458e-98b1-5bd0ed68fe68 None admin] PATH_INFO: `/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/30309e7760004bd795c22dcb55d4ff99/roles/037df45eceeb4cb7aec314c290fa7820` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.233063 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae4fbc-3325-458e-98b1-5bd0ed68fe68 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9e5996685142bb94c83c5403fbf17d, user_id=30309e7760004bd795c22dcb55d4ff99, role_id=037df45eceeb4cb7aec314c290fa7820)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:07.233241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-8d686514-818b-43f1-b24b-e602855448ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:07.233241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:07.233241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:07.233241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:07.233241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:07.233241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:07.233241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:07.233241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:07.233241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:07.233241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:07.233241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:07.233241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:07.233241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:07.233241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:07.233241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:07.234041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:07.239876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:07.239876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:07.239876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:07.239876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:07.240097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae4fbc-3325-458e-98b1-5bd0ed68fe68 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:07.240169 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 289/599] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:07.240169 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d686514-818b-43f1-b24b-e602855448ba None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:07.333174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 311/600] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:44:07 2022] PUT /identity/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/30309e7760004bd795c22dcb55d4ff99/roles/037df45eceeb4cb7aec314c290fa7820 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:44:07.333174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a9adf-fba1-433f-9e9d-c5efc331ee96 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.333174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a9adf-fba1-433f-9e9d-c5efc331ee96 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.333174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a9adf-fba1-433f-9e9d-c5efc331ee96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.357172 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d686514-818b-43f1-b24b-e602855448ba None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:07.360626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-230a9adf-fba1-433f-9e9d-c5efc331ee96 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:07.363470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-230a9adf-fba1-433f-9e9d-c5efc331ee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:07.398158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:07.398701 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe45831-3d18-4c91-8940-a63f0b58d782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:07.400315 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe45831-3d18-4c91-8940-a63f0b58d782 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.400811 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe45831-3d18-4c91-8940-a63f0b58d782 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.401203 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe45831-3d18-4c91-8940-a63f0b58d782 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.402071 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe45831-3d18-4c91-8940-a63f0b58d782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:07.402493 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe45831-3d18-4c91-8940-a63f0b58d782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:07.404852 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe45831-3d18-4c91-8940-a63f0b58d782 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:07.421789 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 290/601] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:07.422840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe45831-3d18-4c91-8940-a63f0b58d782 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:07.462566 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 312/602] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:07.463813 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a9adf-fba1-433f-9e9d-c5efc331ee96 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:07.471700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:07.564683 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe45831-3d18-4c91-8940-a63f0b58d782 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:07.597435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a9adf-fba1-433f-9e9d-c5efc331ee96 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:07.608582 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f690c-c6bc-405f-bc12-6042694375f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:07.610179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f690c-c6bc-405f-bc12-6042694375f7 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.610620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f690c-c6bc-405f-bc12-6042694375f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.611070 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f690c-c6bc-405f-bc12-6042694375f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.612202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f690c-c6bc-405f-bc12-6042694375f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:07.613093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f690c-c6bc-405f-bc12-6042694375f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:07.615188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f690c-c6bc-405f-bc12-6042694375f7 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:07.631213 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 291/603] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:07.635780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f690c-c6bc-405f-bc12-6042694375f7 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:07.641405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e224c4-7788-497c-a35c-6e1711c2f7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:07.642494 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e224c4-7788-497c-a35c-6e1711c2f7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.642982 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e224c4-7788-497c-a35c-6e1711c2f7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.643457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e224c4-7788-497c-a35c-6e1711c2f7f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.654749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e224c4-7788-497c-a35c-6e1711c2f7f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:07.657114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e224c4-7788-497c-a35c-6e1711c2f7f4 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:07.676499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-24e224c4-7788-497c-a35c-6e1711c2f7f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:07.676499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:07.676499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:07.676499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:07.676499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:07.676499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:07.676499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:07.676499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:07.676499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:07.676499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:07.676499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:07.676499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:07.676499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:07.676499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:07.676499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:07.677462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:07.678346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:07.678346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:07.678346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:07.678346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:07.678346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:07.678346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:07.678346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:07.678346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:07.685374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 313/604] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:07.686248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e224c4-7788-497c-a35c-6e1711c2f7f4 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:07.712380 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:07.743415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:07.750541 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f690c-c6bc-405f-bc12-6042694375f7 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:07.786495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652031a-ebc9-416c-b02f-679c3fd733c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:07.787482 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652031a-ebc9-416c-b02f-679c3fd733c0 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.787969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652031a-ebc9-416c-b02f-679c3fd733c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.788314 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652031a-ebc9-416c-b02f-679c3fd733c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.800241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652031a-ebc9-416c-b02f-679c3fd733c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:07.808760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-3652031a-ebc9-416c-b02f-679c3fd733c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:07.808760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:07.808760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:07.808760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:07.808760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:07.808760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:07.808760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:07.808760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:07.808760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:07.808760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:07.808760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:07.808760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:07.808760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:07.808760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:07.808760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:07.808760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:07.810033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:07.810033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:07.810033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:07.810033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:07.810033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:07.810033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:07.810033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:07.810033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:07.810033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:07.810033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:07.810033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:07.810033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:07.810033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:07.810033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:07.810033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:07.810033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:07.811101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:07.811101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:07.811101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:07.811101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:07.811101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:07.811101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:07.811101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:07.811101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:07.811101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:07.811101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:07.811101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:07.811101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:07.817275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 292/605] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:07.818306 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652031a-ebc9-416c-b02f-679c3fd733c0 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:07.831709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e224c4-7788-497c-a35c-6e1711c2f7f4 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:07.869299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470864b7-ffd0-4a03-a267-5dec13b17c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:07.870334 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470864b7-ffd0-4a03-a267-5dec13b17c93 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:07.870746 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470864b7-ffd0-4a03-a267-5dec13b17c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:07.871177 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470864b7-ffd0-4a03-a267-5dec13b17c93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:07.879201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470864b7-ffd0-4a03-a267-5dec13b17c93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:07.880845 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470864b7-ffd0-4a03-a267-5dec13b17c93 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:07.896672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-470864b7-ffd0-4a03-a267-5dec13b17c93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:07.896672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:07.896672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:07.896672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:07.896672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:07.896672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:07.896672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:07.896672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:07.896672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:07.896672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:07.896672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:07.896672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:07.896672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:07.896672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:07.896672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:07.897844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:07.898943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:07.898943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:07.898943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:07.898943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:07.898943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:07.898943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:07.898943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:07.898943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:07.905742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 314/606] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:07.905742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470864b7-ffd0-4a03-a267-5dec13b17c93 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:07.967041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652031a-ebc9-416c-b02f-679c3fd733c0 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:07.997172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:08.002203 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb97779-fb4e-42ca-a0c4-7cfb9025cbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:08.002866 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb97779-fb4e-42ca-a0c4-7cfb9025cbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.003154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb97779-fb4e-42ca-a0c4-7cfb9025cbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.003434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb97779-fb4e-42ca-a0c4-7cfb9025cbd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.004216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb97779-fb4e-42ca-a0c4-7cfb9025cbd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:08.004526 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb97779-fb4e-42ca-a0c4-7cfb9025cbd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:08.006046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb97779-fb4e-42ca-a0c4-7cfb9025cbd2 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:08.018763 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 293/607] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:08.021714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470864b7-ffd0-4a03-a267-5dec13b17c93 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:08.024005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb97779-fb4e-42ca-a0c4-7cfb9025cbd2 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:08.040255 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:08.057675 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0544b88-620b-4552-899f-23d3c8031780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:08.058364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0544b88-620b-4552-899f-23d3c8031780 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.058653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0544b88-620b-4552-899f-23d3c8031780 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.058931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0544b88-620b-4552-899f-23d3c8031780 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.059725 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0544b88-620b-4552-899f-23d3c8031780 None admin] RBAC: Adding query filter params (name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:08.060173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0544b88-620b-4552-899f-23d3c8031780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:08.062223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0544b88-620b-4552-899f-23d3c8031780 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:08.075092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 315/608] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:08.075092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd380f2-c313-4950-adf9-d505c82b047d None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.075092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd380f2-c313-4950-adf9-d505c82b047d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.075092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd380f2-c313-4950-adf9-d505c82b047d None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.075092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 316/609] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:08.075092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd380f2-c313-4950-adf9-d505c82b047d None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:08.142173 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb97779-fb4e-42ca-a0c4-7cfb9025cbd2 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:08.178775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1564f4-cdd6-40cb-98b8-feeb638afa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:08.179442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1564f4-cdd6-40cb-98b8-feeb638afa0e None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.179729 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1564f4-cdd6-40cb-98b8-feeb638afa0e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.180019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1564f4-cdd6-40cb-98b8-feeb638afa0e None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.180799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1564f4-cdd6-40cb-98b8-feeb638afa0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:08.181115 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1564f4-cdd6-40cb-98b8-feeb638afa0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:08.182583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1564f4-cdd6-40cb-98b8-feeb638afa0e None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:08.187534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd380f2-c313-4950-adf9-d505c82b047d None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:08.200107 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 294/610] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:08.200107 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1564f4-cdd6-40cb-98b8-feeb638afa0e None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:08.227484 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19685773-0c5a-403b-a038-da22fc3a371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:08.228328 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19685773-0c5a-403b-a038-da22fc3a371e None admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.228618 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19685773-0c5a-403b-a038-da22fc3a371e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.228902 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19685773-0c5a-403b-a038-da22fc3a371e None admin] PATH_INFO: `/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/e8f268ca2cb34c06b188908495cdcd53/roles/037df45eceeb4cb7aec314c290fa7820` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.240530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:08.244600 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19685773-0c5a-403b-a038-da22fc3a371e None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9e5996685142bb94c83c5403fbf17d, user_id=e8f268ca2cb34c06b188908495cdcd53, role_id=037df45eceeb4cb7aec314c290fa7820)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:08.246246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19685773-0c5a-403b-a038-da22fc3a371e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:08.279083 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:08.303817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1564f4-cdd6-40cb-98b8-feeb638afa0e None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:08.336622 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebc54c-6798-4f3b-8178-926f03d2948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:08.337450 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebc54c-6798-4f3b-8178-926f03d2948b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.337736 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebc54c-6798-4f3b-8178-926f03d2948b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.338014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebc54c-6798-4f3b-8178-926f03d2948b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.348516 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebc54c-6798-4f3b-8178-926f03d2948b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:08.350178 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebc54c-6798-4f3b-8178-926f03d2948b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:08.354144 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 317/611] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:44:08 2022] PUT /identity/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/e8f268ca2cb34c06b188908495cdcd53/roles/037df45eceeb4cb7aec314c290fa7820 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:44:08.366477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5accb9-1caf-41c9-a7df-5259411a6c80 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.366770 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5accb9-1caf-41c9-a7df-5259411a6c80 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.367050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5accb9-1caf-41c9-a7df-5259411a6c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.369592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-deebc54c-6798-4f3b-8178-926f03d2948b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:08.369592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:08.369592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:08.369592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:08.369592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:08.369592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:08.369592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:08.369592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:08.369592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:08.369592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:08.369592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:08.369592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:08.369592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:08.369592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:08.369592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:08.370673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:08.371765 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:08.371765 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:08.371765 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:08.371765 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:08.378587 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 295/612] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:08.378587 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebc54c-6798-4f3b-8178-926f03d2948b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:08.400831 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-0f5accb9-1caf-41c9-a7df-5259411a6c80 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:08.402578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0f5accb9-1caf-41c9-a7df-5259411a6c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:08.483360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 318/613] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:08.484690 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5accb9-1caf-41c9-a7df-5259411a6c80 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:08.518731 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebc54c-6798-4f3b-8178-926f03d2948b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:08.550791 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:08.562035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b9ff3-f6b7-4044-812d-cd1b02ad536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:08.562943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b9ff3-f6b7-4044-812d-cd1b02ad536c None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.563280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b9ff3-f6b7-4044-812d-cd1b02ad536c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.564029 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b9ff3-f6b7-4044-812d-cd1b02ad536c None admin] PATH_INFO: `/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/db3b603ceffb43bc99684e0d2319e3ce/roles/037df45eceeb4cb7aec314c290fa7820` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.580969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b9ff3-f6b7-4044-812d-cd1b02ad536c None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9e5996685142bb94c83c5403fbf17d, user_id=db3b603ceffb43bc99684e0d2319e3ce, role_id=037df45eceeb4cb7aec314c290fa7820)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:08.582559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5b9ff3-f6b7-4044-812d-cd1b02ad536c None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:08.623675 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5accb9-1caf-41c9-a7df-5259411a6c80 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:08.645259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:08.660399 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 296/614] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:44:08 2022] PUT /identity/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/db3b603ceffb43bc99684e0d2319e3ce/roles/037df45eceeb4cb7aec314c290fa7820 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:44:08.661343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b9ff3-f6b7-4044-812d-cd1b02ad536c None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:08.664477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb7a17-3a81-4d77-a275-8269c681c734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:08.666694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb7a17-3a81-4d77-a275-8269c681c734 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.667441 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb7a17-3a81-4d77-a275-8269c681c734 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.667908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb7a17-3a81-4d77-a275-8269c681c734 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.668958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb7a17-3a81-4d77-a275-8269c681c734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:08.669514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb7a17-3a81-4d77-a275-8269c681c734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:08.671192 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb7a17-3a81-4d77-a275-8269c681c734 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:08.689616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 319/615] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:08.698832 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb7a17-3a81-4d77-a275-8269c681c734 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:08.859954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b9ff3-f6b7-4044-812d-cd1b02ad536c None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:08.904406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9fca1-723b-40b3-afca-a324b563f71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:08.905630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9fca1-723b-40b3-afca-a324b563f71c None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:08.906547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9fca1-723b-40b3-afca-a324b563f71c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:08.907278 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9fca1-723b-40b3-afca-a324b563f71c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:08.915827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb7a17-3a81-4d77-a275-8269c681c734 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:08.919727 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9fca1-723b-40b3-afca-a324b563f71c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:08.929462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-c4a9fca1-723b-40b3-afca-a324b563f71c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:08.929462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:08.929462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:08.929462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:08.929462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:08.929462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:08.929462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:08.929462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:08.929462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:08.929462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:08.929462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:08.929462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:08.929462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:08.929462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:08.929462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:08.929462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:08.930367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:08.930367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:08.930367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:08.930367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:08.930367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:08.930367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:08.930367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:08.930367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:08.930367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:08.930367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:08.930367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:08.930367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:08.930367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:08.930367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:08.930367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:08.930367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:08.931200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:08.931200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:08.931200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:08.931200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:08.931200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:08.931200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:08.931200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:08.931200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:08.931200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:08.931200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:08.931200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:08.931200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:08.933536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 297/616] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:08.939710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9fca1-723b-40b3-afca-a324b563f71c None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:08.984150 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:09.010014 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bbca4-64d4-44b4-9448-de0009f022c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:09.011293 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bbca4-64d4-44b4-9448-de0009f022c7 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:09.011728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bbca4-64d4-44b4-9448-de0009f022c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:09.012171 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bbca4-64d4-44b4-9448-de0009f022c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:09.022380 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bbca4-64d4-44b4-9448-de0009f022c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:09.025241 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bbca4-64d4-44b4-9448-de0009f022c7 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:09.042709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-a83bbca4-64d4-44b4-9448-de0009f022c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:44:09.042709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:09.042709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:09.042709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:09.042709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:09.042709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:09.042709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:09.042709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:09.042709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:09.042709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:09.042709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:09.042709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:09.042709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:09.042709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:09.042709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:09.042709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:09.043889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:09.045788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:09.045788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:09.045788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:09.045788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:09.045788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:09.045788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:09.045788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:09.045788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:09.045788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:44:09.045788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:09.048705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 320/617] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:09.054207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bbca4-64d4-44b4-9448-de0009f022c7 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:09.104729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:09.147336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9fca1-723b-40b3-afca-a324b563f71c None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:09.178032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bbca4-64d4-44b4-9448-de0009f022c7 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:09.216405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c6542-c3bd-4d28-b410-c42e62361ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:09.217683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c6542-c3bd-4d28-b410-c42e62361ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:09.218272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c6542-c3bd-4d28-b410-c42e62361ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:09.218750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c6542-c3bd-4d28-b410-c42e62361ca9 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:09.219785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c6542-c3bd-4d28-b410-c42e62361ca9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:09.220296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c6542-c3bd-4d28-b410-c42e62361ca9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:09.222011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c6542-c3bd-4d28-b410-c42e62361ca9 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:09.230732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e675a-656f-46e4-8ef9-7bad6bef8943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:09.231526 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e675a-656f-46e4-8ef9-7bad6bef8943 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:09.231819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e675a-656f-46e4-8ef9-7bad6bef8943 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:09.232096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e675a-656f-46e4-8ef9-7bad6bef8943 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:09.233437 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e675a-656f-46e4-8ef9-7bad6bef8943 None admin] RBAC: Adding query filter params (name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:09.234574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e675a-656f-46e4-8ef9-7bad6bef8943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:09.235214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e675a-656f-46e4-8ef9-7bad6bef8943 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:09.243229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 321/618] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jun 16 14:44:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:09.248897 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c6542-c3bd-4d28-b410-c42e62361ca9 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:09.253469 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 298/619] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:09.258884 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e675a-656f-46e4-8ef9-7bad6bef8943 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:09.353485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c6542-c3bd-4d28-b410-c42e62361ca9 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:09.355325 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:09.390751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e837d-5104-4fdc-9f10-06f79915cd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:09.392087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e837d-5104-4fdc-9f10-06f79915cd59 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:09.392632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e837d-5104-4fdc-9f10-06f79915cd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:09.393190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e837d-5104-4fdc-9f10-06f79915cd59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:09.404395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e837d-5104-4fdc-9f10-06f79915cd59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:09.406272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e837d-5104-4fdc-9f10-06f79915cd59 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:09.424882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-ae5e837d-5104-4fdc-9f10-06f79915cd59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:09.424882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:09.424882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:09.424882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:09.424882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:09.424882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:09.424882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:09.424882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:09.424882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:09.424882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:09.424882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:09.424882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:09.424882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:09.424882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:09.424882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:09.425804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:09.426688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:09.426688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:09.426688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:09.426688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:09.428904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 322/620] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:09.434498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e837d-5104-4fdc-9f10-06f79915cd59 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:09.447995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:09.451669 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e675a-656f-46e4-8ef9-7bad6bef8943 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:09.486535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d19b5-744e-40e8-ba66-d61d5574ae0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:09.487469 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d19b5-744e-40e8-ba66-d61d5574ae0b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:09.487779 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d19b5-744e-40e8-ba66-d61d5574ae0b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:09.488096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d19b5-744e-40e8-ba66-d61d5574ae0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:09.500030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d19b5-744e-40e8-ba66-d61d5574ae0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:09.501538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d19b5-744e-40e8-ba66-d61d5574ae0b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:09.532311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-045d19b5-744e-40e8-ba66-d61d5574ae0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:09.532311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:09.532311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:09.532311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:09.532311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:09.532311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:09.532311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:09.532311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:09.532311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:09.532311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:09.532311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:09.532311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:09.532311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:09.532311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:09.532311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:09.533310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:09.535293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:09.535293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:09.535293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:09.535293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:09.535293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 299/621] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:09.542177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d19b5-744e-40e8-ba66-d61d5574ae0b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:09.593421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e837d-5104-4fdc-9f10-06f79915cd59 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:09.645643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416df72-8b68-4038-a85d-9cbf4632484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:09.646333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416df72-8b68-4038-a85d-9cbf4632484c None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:09.646625 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416df72-8b68-4038-a85d-9cbf4632484c None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:09.646976 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416df72-8b68-4038-a85d-9cbf4632484c None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:09.647719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416df72-8b68-4038-a85d-9cbf4632484c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:09.648088 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416df72-8b68-4038-a85d-9cbf4632484c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:09.649635 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416df72-8b68-4038-a85d-9cbf4632484c None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:09.663087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 323/622] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:09.668647 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416df72-8b68-4038-a85d-9cbf4632484c None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:09.686499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:09.755992 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d19b5-744e-40e8-ba66-d61d5574ae0b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:09.785257 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416df72-8b68-4038-a85d-9cbf4632484c None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:09.790157 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041e2e4-9753-4c6a-9e58-f3714ba99890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:09.790829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041e2e4-9753-4c6a-9e58-f3714ba99890 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:09.791119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041e2e4-9753-4c6a-9e58-f3714ba99890 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:09.791402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041e2e4-9753-4c6a-9e58-f3714ba99890 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:09.792124 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041e2e4-9753-4c6a-9e58-f3714ba99890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:09.792432 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041e2e4-9753-4c6a-9e58-f3714ba99890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:09.793861 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041e2e4-9753-4c6a-9e58-f3714ba99890 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:09.806990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 300/623] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:09.808666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a059d4-fba3-4ebd-b319-15789626535c None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:09.809030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a059d4-fba3-4ebd-b319-15789626535c None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:09.809414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a059d4-fba3-4ebd-b319-15789626535c None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:09.814973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 301/624] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:09.815763 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a059d4-fba3-4ebd-b319-15789626535c None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:09.823852 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57772881-94be-491b-8654-23daba84f1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:09.824890 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57772881-94be-491b-8654-23daba84f1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:09.825389 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57772881-94be-491b-8654-23daba84f1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:09.825747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57772881-94be-491b-8654-23daba84f1e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:09.833333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57772881-94be-491b-8654-23daba84f1e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:09.833848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:09.834938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57772881-94be-491b-8654-23daba84f1e4 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:09.849985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-57772881-94be-491b-8654-23daba84f1e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:09.849985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:09.849985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:09.849985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:09.849985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:09.849985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:09.849985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:09.849985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:09.849985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:09.849985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:09.849985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:09.849985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:09.849985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:09.849985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:09.849985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:09.851103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:09.852060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:09.852060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:09.852060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:09.852060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:09.852060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:09.852060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:09.852060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:09.852060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:09.852787 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 324/625] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:09.857558 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c40a0a-c92a-4b81-9ebe-49c3ec497959 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:09.857858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c40a0a-c92a-4b81-9ebe-49c3ec497959 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:09.858147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c40a0a-c92a-4b81-9ebe-49c3ec497959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:09.875023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-b8c40a0a-c92a-4b81-9ebe-49c3ec497959 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:09.876255 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b8c40a0a-c92a-4b81-9ebe-49c3ec497959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:09.921072 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a059d4-fba3-4ebd-b319-15789626535c None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:09.945469 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 325/626] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:09.946416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c40a0a-c92a-4b81-9ebe-49c3ec497959 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:09.969187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b7e18-4abb-4779-b2d5-550899e40127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:09.969187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b7e18-4abb-4779-b2d5-550899e40127 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:09.969187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b7e18-4abb-4779-b2d5-550899e40127 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:09.969187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b7e18-4abb-4779-b2d5-550899e40127 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:09.980576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b7e18-4abb-4779-b2d5-550899e40127 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:09.982145 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b7e18-4abb-4779-b2d5-550899e40127 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:10.003616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-296b7e18-4abb-4779-b2d5-550899e40127 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:10.003616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:10.003616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:10.003616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:10.003616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:10.003616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:10.003616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:10.003616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:10.003616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:10.003616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:10.003616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:10.003616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:10.003616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:10.003616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:10.003616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:10.003616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:10.004613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:10.010548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:10.010548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:10.010548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:10.010548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:10.010548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:10.010548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:10.010548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:10.010548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:10.010548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:10.010548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:10.010548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 302/627] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 16 14:44:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:10.012275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b7e18-4abb-4779-b2d5-550899e40127 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:10.057691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c40a0a-c92a-4b81-9ebe-49c3ec497959 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:10.092748 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fa52d-cb52-4edb-a3cb-67f324599541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:10.093542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fa52d-cb52-4edb-a3cb-67f324599541 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:10.093834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fa52d-cb52-4edb-a3cb-67f324599541 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:10.094117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fa52d-cb52-4edb-a3cb-67f324599541 None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:10.094922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fa52d-cb52-4edb-a3cb-67f324599541 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:10.095240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fa52d-cb52-4edb-a3cb-67f324599541 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:10.096728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fa52d-cb52-4edb-a3cb-67f324599541 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:10.110357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 326/628] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:10.111201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fa52d-cb52-4edb-a3cb-67f324599541 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:10.121067 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b7e18-4abb-4779-b2d5-550899e40127 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:10.154716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:10.157773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd8f85-a227-402e-9e1b-947c9231bb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:10.159113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd8f85-a227-402e-9e1b-947c9231bb12 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:10.159553 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd8f85-a227-402e-9e1b-947c9231bb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:10.159974 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd8f85-a227-402e-9e1b-947c9231bb12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:10.175633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd8f85-a227-402e-9e1b-947c9231bb12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:10.180208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-07dd8f85-a227-402e-9e1b-947c9231bb12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:10.180208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:10.180208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:10.180208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:10.180208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:10.180208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:10.180208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:10.180208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:10.180208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:10.180208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:10.180208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:10.180208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:10.180208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:10.180208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:10.180208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:10.180208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:10.181354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:10.181354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:10.181354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:10.181354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:10.181354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:10.181354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:10.181354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:10.181354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:10.181354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:10.181354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:10.181354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:10.181354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:10.181354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:10.181354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:10.181354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:10.181354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:10.182286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:10.182286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:10.182286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:10.182286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:10.182286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:10.182286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:10.182286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:10.182286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:10.182286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:10.182286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:10.182286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:10.182286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:10.189543 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:10.189796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 303/629] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:10.190765 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd8f85-a227-402e-9e1b-947c9231bb12 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:10.223961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fa52d-cb52-4edb-a3cb-67f324599541 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:10.242367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:10.259658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c253c7b-1e0a-49cd-a775-7e71e9bae4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:10.260344 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c253c7b-1e0a-49cd-a775-7e71e9bae4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:10.260634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c253c7b-1e0a-49cd-a775-7e71e9bae4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:10.260918 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c253c7b-1e0a-49cd-a775-7e71e9bae4a2 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:10.261789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c253c7b-1e0a-49cd-a775-7e71e9bae4a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:10.262112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c253c7b-1e0a-49cd-a775-7e71e9bae4a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:10.263821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c253c7b-1e0a-49cd-a775-7e71e9bae4a2 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:10.286734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 327/630] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 16 14:44:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:10.286734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c253c7b-1e0a-49cd-a775-7e71e9bae4a2 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:10.302643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd8f85-a227-402e-9e1b-947c9231bb12 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:10.337527 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:10.341795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb51e71-36f0-40fb-854c-8beaed94f7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:10.343737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb51e71-36f0-40fb-854c-8beaed94f7bf None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:10.344393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb51e71-36f0-40fb-854c-8beaed94f7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:10.345319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb51e71-36f0-40fb-854c-8beaed94f7bf None admin] PATH_INFO: `/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/a952ee6a39e1453b80a8a8b787d0fdf5/roles/037df45eceeb4cb7aec314c290fa7820` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:10.366758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb51e71-36f0-40fb-854c-8beaed94f7bf None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9e5996685142bb94c83c5403fbf17d, user_id=a952ee6a39e1453b80a8a8b787d0fdf5, role_id=037df45eceeb4cb7aec314c290fa7820)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:10.369435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb51e71-36f0-40fb-854c-8beaed94f7bf None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:10.387834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c253c7b-1e0a-49cd-a775-7e71e9bae4a2 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:10.406966 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:10.423321 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bdb9b0-1d39-4293-9386-6d9f0830e187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:10.423999 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdb9b0-1d39-4293-9386-6d9f0830e187 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:10.424286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdb9b0-1d39-4293-9386-6d9f0830e187 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:10.424566 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdb9b0-1d39-4293-9386-6d9f0830e187 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:10.425340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bdb9b0-1d39-4293-9386-6d9f0830e187 None admin] RBAC: Adding query filter params (name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:10.425702 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bdb9b0-1d39-4293-9386-6d9f0830e187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:10.427056 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bdb9b0-1d39-4293-9386-6d9f0830e187 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:10.441169 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 328/631] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:10.441169 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bdb9b0-1d39-4293-9386-6d9f0830e187 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:10.452034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 304/632] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:44:10 2022] PUT /identity/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/a952ee6a39e1453b80a8a8b787d0fdf5/roles/037df45eceeb4cb7aec314c290fa7820 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:44:10.452034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb51e71-36f0-40fb-854c-8beaed94f7bf None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:10.611320 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb51e71-36f0-40fb-854c-8beaed94f7bf None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:10.662251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4faac-4d4c-486d-adbd-88722e4ecdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:10.663388 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4faac-4d4c-486d-adbd-88722e4ecdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:10.663866 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4faac-4d4c-486d-adbd-88722e4ecdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:10.664145 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4faac-4d4c-486d-adbd-88722e4ecdd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:10.669092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bdb9b0-1d39-4293-9386-6d9f0830e187 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:10.677928 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4faac-4d4c-486d-adbd-88722e4ecdd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:10.679084 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4faac-4d4c-486d-adbd-88722e4ecdd6 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:10.700723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-b5c4faac-4d4c-486d-adbd-88722e4ecdd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:10.700723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:10.700723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:10.700723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:10.700723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:10.700723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:10.700723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:10.700723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:10.700723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:10.700723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:10.700723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:10.700723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:10.700723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:10.700723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:10.700723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:10.702262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:10.703146 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:10.703146 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:10.703146 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:10.703146 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:10.703146 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 305/633] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:10.709039 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4faac-4d4c-486d-adbd-88722e4ecdd6 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:10.715842 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8424f4d-e973-452d-a3ba-352c2936efc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:10.716950 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8424f4d-e973-452d-a3ba-352c2936efc4 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:10.718154 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8424f4d-e973-452d-a3ba-352c2936efc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:10.718649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8424f4d-e973-452d-a3ba-352c2936efc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:10.744331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:10.787774 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:10.821467 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8424f4d-e973-452d-a3ba-352c2936efc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:10.822933 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8424f4d-e973-452d-a3ba-352c2936efc4 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:10.828635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4faac-4d4c-486d-adbd-88722e4ecdd6 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:10.878569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50be02-5b16-46c6-9283-c51363d54ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:10.879787 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50be02-5b16-46c6-9283-c51363d54ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:10.880286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50be02-5b16-46c6-9283-c51363d54ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:10.880676 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50be02-5b16-46c6-9283-c51363d54ba3 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:10.881798 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50be02-5b16-46c6-9283-c51363d54ba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:10.882116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50be02-5b16-46c6-9283-c51363d54ba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:10.884195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50be02-5b16-46c6-9283-c51363d54ba3 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:10.898197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 306/634] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:10.899679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdd272-c570-4773-a3ce-57eec9a08229 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:10.900160 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdd272-c570-4773-a3ce-57eec9a08229 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:10.900542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdd272-c570-4773-a3ce-57eec9a08229 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:10.902303 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 307/635] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:10.908210 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdd272-c570-4773-a3ce-57eec9a08229 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:10.942191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 329/636] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:10.943768 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac7889-2baf-4e5e-94ca-bbc2d05d7ec1 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:10.944176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac7889-2baf-4e5e-94ca-bbc2d05d7ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:10.944558 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac7889-2baf-4e5e-94ca-bbc2d05d7ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:10.961467 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-c7ac7889-2baf-4e5e-94ca-bbc2d05d7ec1 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:10.965872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c7ac7889-2baf-4e5e-94ca-bbc2d05d7ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:11.035664 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:11.045258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 330/637] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:11.046250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac7889-2baf-4e5e-94ca-bbc2d05d7ec1 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:11.052611 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdd272-c570-4773-a3ce-57eec9a08229 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.068076 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:11.093728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2d54e-8aaf-4be3-9e2a-a8a775c2ca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:11.095452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2d54e-8aaf-4be3-9e2a-a8a775c2ca02 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.095882 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2d54e-8aaf-4be3-9e2a-a8a775c2ca02 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.096470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2d54e-8aaf-4be3-9e2a-a8a775c2ca02 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.108746 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2d54e-8aaf-4be3-9e2a-a8a775c2ca02 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:11.111203 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2d54e-8aaf-4be3-9e2a-a8a775c2ca02 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:11.131540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-81e2d54e-8aaf-4be3-9e2a-a8a775c2ca02 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:44:11.131540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:11.131540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:11.131540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:11.131540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:11.131540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:11.131540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:11.131540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:11.131540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:11.131540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:11.131540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:11.131540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:11.131540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:11.131540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:11.131540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:11.131540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:11.132713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:11.133840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:11.133840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:11.133840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:11.133840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:11.133840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:11.133840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:11.133840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:11.133840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:11.133840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:44:11.133840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:11.135029 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 308/638] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:11.135758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2d54e-8aaf-4be3-9e2a-a8a775c2ca02 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:11.177250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac7889-2baf-4e5e-94ca-bbc2d05d7ec1 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.213858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a304ff-f7d3-48b8-a474-4b14f416912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:11.214569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a304ff-f7d3-48b8-a474-4b14f416912e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.214865 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a304ff-f7d3-48b8-a474-4b14f416912e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.215117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a304ff-f7d3-48b8-a474-4b14f416912e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.226050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a304ff-f7d3-48b8-a474-4b14f416912e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:11.227621 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a304ff-f7d3-48b8-a474-4b14f416912e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:11.245300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-13a304ff-f7d3-48b8-a474-4b14f416912e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:11.245300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:11.245300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:11.245300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:11.245300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:11.245300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:11.245300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:11.245300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:11.245300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:11.245300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:11.245300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:11.245300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:11.245300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:11.245300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:11.245300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:11.246203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:11.247082 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:11.247082 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:11.247082 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:11.247082 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:11.247299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2d54e-8aaf-4be3-9e2a-a8a775c2ca02 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.251645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 331/639] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:11.252968 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe54abc-2615-4037-be22-9820bef97122 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.253284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe54abc-2615-4037-be22-9820bef97122 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.253559 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe54abc-2615-4037-be22-9820bef97122 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.254973 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 332/640] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:11.255506 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe54abc-2615-4037-be22-9820bef97122 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:11.291570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda8358-c1f8-4bdb-8d71-4f12da387984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:11.292597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda8358-c1f8-4bdb-8d71-4f12da387984 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.292708 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda8358-c1f8-4bdb-8d71-4f12da387984 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.292899 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda8358-c1f8-4bdb-8d71-4f12da387984 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.303546 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda8358-c1f8-4bdb-8d71-4f12da387984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:11.311966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-5cda8358-c1f8-4bdb-8d71-4f12da387984 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:11.311966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:11.311966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:11.311966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:11.311966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:11.311966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:11.311966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:11.311966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:11.311966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:11.311966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:11.311966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:11.311966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:11.311966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:11.311966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:11.311966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:11.311966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:11.312988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:11.312988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:11.312988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:11.312988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:11.312988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:11.312988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:11.312988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:11.312988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:11.312988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:11.312988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:11.312988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:11.312988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:11.312988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:11.312988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:11.312988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:11.312988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:11.313905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:11.313905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:11.313905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:11.313905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:11.313905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:11.313905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:11.313905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:11.313905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:11.313905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:11.313905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:11.313905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:11.313905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:11.313905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 309/641] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:11.314602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda8358-c1f8-4bdb-8d71-4f12da387984 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:11.326660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:11.330679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:11.366346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe54abc-2615-4037-be22-9820bef97122 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.402530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42db509-bf7e-43c7-8f27-e1d400fbae59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:11.403204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42db509-bf7e-43c7-8f27-e1d400fbae59 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.403636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42db509-bf7e-43c7-8f27-e1d400fbae59 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.403748 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42db509-bf7e-43c7-8f27-e1d400fbae59 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.404876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42db509-bf7e-43c7-8f27-e1d400fbae59 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:11.405214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42db509-bf7e-43c7-8f27-e1d400fbae59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:11.406658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42db509-bf7e-43c7-8f27-e1d400fbae59 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:11.418903 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda8358-c1f8-4bdb-8d71-4f12da387984 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.429043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 333/642] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jun 16 14:44:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:11.429043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28ee88-6264-431c-916c-ae7ad940f9c6 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.429043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28ee88-6264-431c-916c-ae7ad940f9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.429043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28ee88-6264-431c-916c-ae7ad940f9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.443675 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-fd28ee88-6264-431c-916c-ae7ad940f9c6 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:11.444841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fd28ee88-6264-431c-916c-ae7ad940f9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:11.458887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47632789-efa3-4db2-bbc8-4e24219da2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:11.459582 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47632789-efa3-4db2-bbc8-4e24219da2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.459872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47632789-efa3-4db2-bbc8-4e24219da2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.460158 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47632789-efa3-4db2-bbc8-4e24219da2f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.460869 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47632789-efa3-4db2-bbc8-4e24219da2f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:11.461205 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47632789-efa3-4db2-bbc8-4e24219da2f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:11.462578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47632789-efa3-4db2-bbc8-4e24219da2f9 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:11.474600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 310/643] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:11.475324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47632789-efa3-4db2-bbc8-4e24219da2f9 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:11.521173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 334/644] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:11.521173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28ee88-6264-431c-916c-ae7ad940f9c6 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:11.559213 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:11.575964 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:11.591369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47632789-efa3-4db2-bbc8-4e24219da2f9 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.626620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28ee88-6264-431c-916c-ae7ad940f9c6 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.628828 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d8005-c9e6-4433-87e9-a541bb83e308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:11.629536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d8005-c9e6-4433-87e9-a541bb83e308 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.629825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d8005-c9e6-4433-87e9-a541bb83e308 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.630104 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d8005-c9e6-4433-87e9-a541bb83e308 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.630845 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d8005-c9e6-4433-87e9-a541bb83e308 None admin] RBAC: Adding query filter params (name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:11.631153 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d8005-c9e6-4433-87e9-a541bb83e308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:11.632519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d8005-c9e6-4433-87e9-a541bb83e308 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:11.645238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 311/645] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:11.645238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d8005-c9e6-4433-87e9-a541bb83e308 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:11.668585 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018125b-70d5-44c3-9366-643a636e990f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:11.669369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018125b-70d5-44c3-9366-643a636e990f None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.669731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018125b-70d5-44c3-9366-643a636e990f None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.670611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018125b-70d5-44c3-9366-643a636e990f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.745365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018125b-70d5-44c3-9366-643a636e990f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:11.746769 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018125b-70d5-44c3-9366-643a636e990f None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:11.750197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d8005-c9e6-4433-87e9-a541bb83e308 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.785931 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f07375-9501-4721-98e2-f964ef26662b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:11.786737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f07375-9501-4721-98e2-f964ef26662b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.787029 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f07375-9501-4721-98e2-f964ef26662b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.787927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f07375-9501-4721-98e2-f964ef26662b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.789501 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:11.796731 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f07375-9501-4721-98e2-f964ef26662b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:11.797457 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f07375-9501-4721-98e2-f964ef26662b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:11.804332 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:11.812230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-b5f07375-9501-4721-98e2-f964ef26662b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:11.812230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:11.812230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:11.812230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:11.812230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:11.812230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:11.812230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:11.812230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:11.812230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:11.812230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:11.812230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:11.812230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:11.812230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:11.812230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:11.812230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:11.819093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:11.820329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:11.820329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:11.820329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:11.820329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:11.820329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:11.820329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:11.820329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:11.820329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:11.820329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 312/646] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:11.820329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f07375-9501-4721-98e2-f964ef26662b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:11.866924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 335/647] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:11.867764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018125b-70d5-44c3-9366-643a636e990f None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:11.930332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f07375-9501-4721-98e2-f964ef26662b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.966951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3354d00-6aab-4e24-a45c-bca03ac83b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:11.968391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3354d00-6aab-4e24-a45c-bca03ac83b73 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:11.968751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3354d00-6aab-4e24-a45c-bca03ac83b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:11.969041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3354d00-6aab-4e24-a45c-bca03ac83b73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:11.974437 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018125b-70d5-44c3-9366-643a636e990f None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:11.983436 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3354d00-6aab-4e24-a45c-bca03ac83b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:11.991408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-d3354d00-6aab-4e24-a45c-bca03ac83b73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:11.991408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:11.991408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:11.991408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:11.991408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:11.991408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:11.991408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:11.991408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:11.991408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:11.991408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:11.991408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:11.991408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:11.991408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:11.991408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:11.991408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:11.991408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:11.992570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:11.992570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:11.992570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:11.992570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:11.992570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:11.992570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:11.992570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:11.992570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:11.992570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:11.992570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:11.992570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:11.992570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:11.992570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:11.992570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:11.992570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:11.992570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:11.993633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:11.993633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:11.993633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:11.993633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:11.993633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:11.993633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:11.993633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:11.993633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:11.993633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:11.993633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:11.993633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:11.993633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:11.994968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 313/648] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:11.995623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3354d00-6aab-4e24-a45c-bca03ac83b73 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:12.018410 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db620-d6ed-4cec-bc6a-857f30b80c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:12.019217 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db620-d6ed-4cec-bc6a-857f30b80c77 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.019508 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db620-d6ed-4cec-bc6a-857f30b80c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.019785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944db620-d6ed-4cec-bc6a-857f30b80c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.030906 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944db620-d6ed-4cec-bc6a-857f30b80c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:12.032366 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944db620-d6ed-4cec-bc6a-857f30b80c77 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:12.050586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-944db620-d6ed-4cec-bc6a-857f30b80c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:12.050586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:12.050586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:12.050586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:12.050586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:12.050586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:12.050586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:12.050586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:12.050586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:12.050586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:12.050586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:12.050586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:12.050586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:12.050586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:12.050586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:12.051640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:12.052697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:12.052697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:12.052697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:12.052697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:12.052697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 336/649] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:12.053976 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db620-d6ed-4cec-bc6a-857f30b80c77 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:12.055942 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:12.059067 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:12.102952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3354d00-6aab-4e24-a45c-bca03ac83b73 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:12.138389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a7215-a8aa-45f8-a549-ce86a71c0b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:12.139701 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a7215-a8aa-45f8-a549-ce86a71c0b17 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.139984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a7215-a8aa-45f8-a549-ce86a71c0b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.140270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a7215-a8aa-45f8-a549-ce86a71c0b17 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.141058 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a7215-a8aa-45f8-a549-ce86a71c0b17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:12.141423 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a7215-a8aa-45f8-a549-ce86a71c0b17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:12.142858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a7215-a8aa-45f8-a549-ce86a71c0b17 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:12.156203 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 314/650] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:12.157002 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a7215-a8aa-45f8-a549-ce86a71c0b17 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:12.164544 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944db620-d6ed-4cec-bc6a-857f30b80c77 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:12.198240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a52ae-c160-4d9c-8cc1-6e8f05eab012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:12.199036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a52ae-c160-4d9c-8cc1-6e8f05eab012 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.199324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a52ae-c160-4d9c-8cc1-6e8f05eab012 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.199607 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a52ae-c160-4d9c-8cc1-6e8f05eab012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.210533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a52ae-c160-4d9c-8cc1-6e8f05eab012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:12.212001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a52ae-c160-4d9c-8cc1-6e8f05eab012 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:12.230967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-182a52ae-c160-4d9c-8cc1-6e8f05eab012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:12.230967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:12.230967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:12.230967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:12.230967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:12.230967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:12.230967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:12.230967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:12.230967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:12.230967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:12.230967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:12.230967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:12.230967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:12.230967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:12.230967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:12.231903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:12.232803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:12.232803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:12.232803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:12.232803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:12.234588 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 337/651] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:12.235510 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a52ae-c160-4d9c-8cc1-6e8f05eab012 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:12.267993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a7215-a8aa-45f8-a549-ce86a71c0b17 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:12.285277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:12.293643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:12.308133 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ba279-ab7c-4c1e-92a0-3e3bf8893fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:12.308133 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ba279-ab7c-4c1e-92a0-3e3bf8893fec None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.308468 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ba279-ab7c-4c1e-92a0-3e3bf8893fec None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.308702 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ba279-ab7c-4c1e-92a0-3e3bf8893fec None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.309470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ba279-ab7c-4c1e-92a0-3e3bf8893fec None admin] RBAC: Adding query filter params (name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:12.309777 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ba279-ab7c-4c1e-92a0-3e3bf8893fec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:12.311149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ba279-ab7c-4c1e-92a0-3e3bf8893fec None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:12.324400 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 315/652] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:12.324400 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ba279-ab7c-4c1e-92a0-3e3bf8893fec None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:12.346642 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a52ae-c160-4d9c-8cc1-6e8f05eab012 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:12.382763 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac979385-48bb-438b-ab87-8213af6313d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:12.383428 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac979385-48bb-438b-ab87-8213af6313d7 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.383715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac979385-48bb-438b-ab87-8213af6313d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.383991 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac979385-48bb-438b-ab87-8213af6313d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.384709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac979385-48bb-438b-ab87-8213af6313d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:12.385028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac979385-48bb-438b-ab87-8213af6313d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:12.386443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac979385-48bb-438b-ab87-8213af6313d7 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:12.400538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 338/653] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:12.401819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac979385-48bb-438b-ab87-8213af6313d7 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:12.430466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ba279-ab7c-4c1e-92a0-3e3bf8893fec None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:12.466930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78fb91-d793-4d99-b36e-2ab2e6aeb034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:12.467617 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78fb91-d793-4d99-b36e-2ab2e6aeb034 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.467909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78fb91-d793-4d99-b36e-2ab2e6aeb034 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.468197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78fb91-d793-4d99-b36e-2ab2e6aeb034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.469033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78fb91-d793-4d99-b36e-2ab2e6aeb034 None admin] RBAC: Adding query filter params (role.id=037df45eceeb4cb7aec314c290fa7820, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=60c2f1c63a674e3195c490ab5ad1318f) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:12.469385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78fb91-d793-4d99-b36e-2ab2e6aeb034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:12.470821 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78fb91-d793-4d99-b36e-2ab2e6aeb034 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:12.476774 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 316/654] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:12 2022] GET /identity/v3/role_assignments?user.id=60c2f1c63a674e3195c490ab5ad1318f&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=037df45eceeb4cb7aec314c290fa7820 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:12.477586 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78fb91-d793-4d99-b36e-2ab2e6aeb034 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:12.526633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:12.530602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac979385-48bb-438b-ab87-8213af6313d7 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:12.550345 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:12.590623 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71023996-2803-421c-89c2-0cbae8371a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:12.591610 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71023996-2803-421c-89c2-0cbae8371a1c None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.592154 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71023996-2803-421c-89c2-0cbae8371a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.592540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71023996-2803-421c-89c2-0cbae8371a1c None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.593712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71023996-2803-421c-89c2-0cbae8371a1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:12.594137 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71023996-2803-421c-89c2-0cbae8371a1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:12.596484 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71023996-2803-421c-89c2-0cbae8371a1c None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:12.601187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78fb91-d793-4d99-b36e-2ab2e6aeb034 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:12.619733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 339/655] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:12.621012 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71023996-2803-421c-89c2-0cbae8371a1c None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:12.645238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ea8e9-2d62-4475-978b-ae500bbb26f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:12.646409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ea8e9-2d62-4475-978b-ae500bbb26f3 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.646874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ea8e9-2d62-4475-978b-ae500bbb26f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.647324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ea8e9-2d62-4475-978b-ae500bbb26f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.659787 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ea8e9-2d62-4475-978b-ae500bbb26f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:12.661849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ea8e9-2d62-4475-978b-ae500bbb26f3 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:12.679908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-c59ea8e9-2d62-4475-978b-ae500bbb26f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:12.679908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:12.679908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:12.679908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:12.679908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:12.679908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:12.679908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:12.679908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:12.679908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:12.679908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:12.679908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:12.679908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:12.679908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:12.679908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:12.679908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:12.680990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:12.681996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:12.681996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:12.681996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:12.681996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:12.682605 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 317/656] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:12.684572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ea8e9-2d62-4475-978b-ae500bbb26f3 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:12.768259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71023996-2803-421c-89c2-0cbae8371a1c None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:12.802313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:12.805832 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4a41b-4261-4c76-8246-6694bde95939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:12.806637 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4a41b-4261-4c76-8246-6694bde95939 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.806921 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4a41b-4261-4c76-8246-6694bde95939 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.807200 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4a41b-4261-4c76-8246-6694bde95939 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.811603 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ea8e9-2d62-4475-978b-ae500bbb26f3 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:12.815441 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4a41b-4261-4c76-8246-6694bde95939 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:12.816958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4a41b-4261-4c76-8246-6694bde95939 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:12.832384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-b2a4a41b-4261-4c76-8246-6694bde95939 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:44:12.832384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:12.832384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:12.832384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:12.832384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:12.832384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:12.832384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:12.832384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:12.832384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:12.832384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:12.832384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:12.832384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:12.832384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:12.832384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:12.832384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:12.832384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:12.833641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:12.834606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:12.834606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:12.834606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:12.834606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:12.834606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:12.834606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:12.834606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:12.834606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:12.834606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 14:44:12.834606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:12.834606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 340/657] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:12.835210 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4a41b-4261-4c76-8246-6694bde95939 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:12.853613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a695e8c-5b63-4873-9e56-f749ecc42340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:12.854416 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a695e8c-5b63-4873-9e56-f749ecc42340 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.854703 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a695e8c-5b63-4873-9e56-f749ecc42340 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.855149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a695e8c-5b63-4873-9e56-f749ecc42340 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.862741 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a695e8c-5b63-4873-9e56-f749ecc42340 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:12.864174 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a695e8c-5b63-4873-9e56-f749ecc42340 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:12.871307 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:12.879061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-9a695e8c-5b63-4873-9e56-f749ecc42340 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:12.879061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:12.879061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:12.879061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:12.879061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:12.879061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:12.879061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:12.879061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:12.879061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:12.879061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:12.879061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:12.879061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:12.879061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:12.879061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:12.879061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:12.880017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:12.880987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:12.880987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:12.880987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:12.880987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:12.880987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:12.880987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:12.880987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:12.880987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:12.880987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 318/658] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:12.882218 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852e076-b4f7-4790-a0b6-0ae36f855065 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.882218 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852e076-b4f7-4790-a0b6-0ae36f855065 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.882218 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852e076-b4f7-4790-a0b6-0ae36f855065 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.888301 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 319/659] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:12.888301 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852e076-b4f7-4790-a0b6-0ae36f855065 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:12.947673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4a41b-4261-4c76-8246-6694bde95939 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:12.992463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2945b-cff6-40c4-8069-a0a486de2844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:12.993290 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2945b-cff6-40c4-8069-a0a486de2844 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:12.993670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2945b-cff6-40c4-8069-a0a486de2844 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:12.994044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2945b-cff6-40c4-8069-a0a486de2844 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:12.994835 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2945b-cff6-40c4-8069-a0a486de2844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:12.995240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2945b-cff6-40c4-8069-a0a486de2844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:12.996670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2945b-cff6-40c4-8069-a0a486de2844 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:13.000943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852e076-b4f7-4790-a0b6-0ae36f855065 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:13.009229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 341/660] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:13.010174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2945b-cff6-40c4-8069-a0a486de2844 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:13.042156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c38d0-0074-4882-ae35-494a7e0df516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:13.043059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c38d0-0074-4882-ae35-494a7e0df516 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:13.043350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c38d0-0074-4882-ae35-494a7e0df516 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:13.043631 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c38d0-0074-4882-ae35-494a7e0df516 None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:13.044461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c38d0-0074-4882-ae35-494a7e0df516 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:13.044795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c38d0-0074-4882-ae35-494a7e0df516 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:13.046298 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c38d0-0074-4882-ae35-494a7e0df516 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:13.068969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 320/661] 10.222.0.23 () {56 vars in 1137 bytes} [Thu Jun 16 14:44:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:13.068969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a7bc6-69d6-4cb1-9e29-e6b09c07a520 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:13.068969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a7bc6-69d6-4cb1-9e29-e6b09c07a520 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:13.068969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a7bc6-69d6-4cb1-9e29-e6b09c07a520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:13.084500 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-649a7bc6-69d6-4cb1-9e29-e6b09c07a520 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:13.085816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-649a7bc6-69d6-4cb1-9e29-e6b09c07a520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:13.088595 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:13.115654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:13.122353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2945b-cff6-40c4-8069-a0a486de2844 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:13.153635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 321/662] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:13.155467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a7bc6-69d6-4cb1-9e29-e6b09c07a520 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:13.166777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054178d-d02f-4e0c-9679-bc5546478842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:13.167454 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054178d-d02f-4e0c-9679-bc5546478842 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:13.167743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054178d-d02f-4e0c-9679-bc5546478842 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:13.168023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054178d-d02f-4e0c-9679-bc5546478842 None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:13.169375 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054178d-d02f-4e0c-9679-bc5546478842 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:13.169750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054178d-d02f-4e0c-9679-bc5546478842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:13.171239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054178d-d02f-4e0c-9679-bc5546478842 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:13.187433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 342/663] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:13.188453 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054178d-d02f-4e0c-9679-bc5546478842 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:13.271240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a7bc6-69d6-4cb1-9e29-e6b09c07a520 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:13.293343 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054178d-d02f-4e0c-9679-bc5546478842 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:13.307937 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f4acd-218c-4706-b1a8-43e82ba2b211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:13.309083 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f4acd-218c-4706-b1a8-43e82ba2b211 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:13.309426 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f4acd-218c-4706-b1a8-43e82ba2b211 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:13.309864 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f4acd-218c-4706-b1a8-43e82ba2b211 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:13.318773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f4acd-218c-4706-b1a8-43e82ba2b211 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:13.320275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f4acd-218c-4706-b1a8-43e82ba2b211 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:13.323551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:13.328857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02302849-ece0-4b41-a611-786308aa219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:13.329721 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02302849-ece0-4b41-a611-786308aa219c None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:13.330167 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02302849-ece0-4b41-a611-786308aa219c None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:13.330600 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02302849-ece0-4b41-a611-786308aa219c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:13.335832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-909f4acd-218c-4706-b1a8-43e82ba2b211 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:44:13.335832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:13.335832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:13.335832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:13.335832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:13.335832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:13.335832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:13.335832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:13.335832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:13.335832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:13.335832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:13.335832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:13.335832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:13.335832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:13.335832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:13.335832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:13.339465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:13.340629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:13.340629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:13.340629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:13.340629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:13.340629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:13.340629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:13.340629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:13.340629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:13.340629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 14:44:13.340629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:13.340629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 322/664] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:13.340629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f4acd-218c-4706-b1a8-43e82ba2b211 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:13.362246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:13.411510 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02302849-ece0-4b41-a611-786308aa219c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:13.412967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02302849-ece0-4b41-a611-786308aa219c None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:13.448967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f4acd-218c-4706-b1a8-43e82ba2b211 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:13.485159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6086d-0c8e-4ee8-b4d4-7758828faaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:13.486078 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6086d-0c8e-4ee8-b4d4-7758828faaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:13.486268 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6086d-0c8e-4ee8-b4d4-7758828faaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:13.486548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6086d-0c8e-4ee8-b4d4-7758828faaa9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:13.497267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6086d-0c8e-4ee8-b4d4-7758828faaa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:13.505610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-84e6086d-0c8e-4ee8-b4d4-7758828faaa9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:13.505610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:13.505610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:13.505610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:13.505610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:13.505610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:13.505610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:13.505610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:13.505610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:13.505610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:13.505610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:13.505610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:13.505610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:13.505610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:13.505610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:13.505610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:13.506593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:13.506593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:13.506593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:13.506593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:13.506593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:13.506593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:13.506593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:13.506593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:13.506593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:13.506593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:13.506593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:13.506593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:13.506593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:13.506593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:13.506593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:13.506593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:13.507449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:13.507449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:13.507449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:13.507449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:13.507449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:13.507449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:13.507449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:13.507449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:13.507449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:13.507449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:13.507449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:13.507449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:13.507449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 323/665] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:13.508196 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6086d-0c8e-4ee8-b4d4-7758828faaa9 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:13.523560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 343/666] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:13.524662 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02302849-ece0-4b41-a611-786308aa219c None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:13.575888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:13.584131 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:13.625964 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6086d-0c8e-4ee8-b4d4-7758828faaa9 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:13.635387 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02302849-ece0-4b41-a611-786308aa219c None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:13.658899 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f89c7-d6fb-43d8-9217-fac5dc144ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:13.659556 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f89c7-d6fb-43d8-9217-fac5dc144ecf None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:13.659842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f89c7-d6fb-43d8-9217-fac5dc144ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:13.660123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f89c7-d6fb-43d8-9217-fac5dc144ecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:13.660952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f89c7-d6fb-43d8-9217-fac5dc144ecf None admin] RBAC: Adding query filter params (role.id=037df45eceeb4cb7aec314c290fa7820, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=30309e7760004bd795c22dcb55d4ff99) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:13.661304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f89c7-d6fb-43d8-9217-fac5dc144ecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:13.662734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f89c7-d6fb-43d8-9217-fac5dc144ecf None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:13.668504 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 324/667] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:13 2022] GET /identity/v3/role_assignments?user.id=30309e7760004bd795c22dcb55d4ff99&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=037df45eceeb4cb7aec314c290fa7820 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:13.669366 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f89c7-d6fb-43d8-9217-fac5dc144ecf None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:13.689488 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e289f-dad1-461f-9e33-a99761620bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:13.691252 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e289f-dad1-461f-9e33-a99761620bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:13.691747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e289f-dad1-461f-9e33-a99761620bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:13.692206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e289f-dad1-461f-9e33-a99761620bf4 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:13.693307 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e289f-dad1-461f-9e33-a99761620bf4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:13.693832 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e289f-dad1-461f-9e33-a99761620bf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:13.696753 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e289f-dad1-461f-9e33-a99761620bf4 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:13.722311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 344/668] 10.222.0.23 () {56 vars in 1139 bytes} [Thu Jun 16 14:44:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:13.723698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e289f-dad1-461f-9e33-a99761620bf4 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:13.794088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f89c7-d6fb-43d8-9217-fac5dc144ecf None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:13.822410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:13.835747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf780dd-2b7a-4279-a67a-4908c6bcba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:13.836734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf780dd-2b7a-4279-a67a-4908c6bcba93 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:13.837310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf780dd-2b7a-4279-a67a-4908c6bcba93 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:13.837803 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf780dd-2b7a-4279-a67a-4908c6bcba93 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:13.838798 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf780dd-2b7a-4279-a67a-4908c6bcba93 None admin] RBAC: Adding query filter params (name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:13.839391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf780dd-2b7a-4279-a67a-4908c6bcba93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:13.841212 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf780dd-2b7a-4279-a67a-4908c6bcba93 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:13.844405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e289f-dad1-461f-9e33-a99761620bf4 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:13.857461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 325/669] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:13.857461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf780dd-2b7a-4279-a67a-4908c6bcba93 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:13.862741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:13.887123 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a73428-247b-4694-bb43-6c2ba6d8c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:13.887938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a73428-247b-4694-bb43-6c2ba6d8c675 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:13.888228 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a73428-247b-4694-bb43-6c2ba6d8c675 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:13.888506 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a73428-247b-4694-bb43-6c2ba6d8c675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:13.903261 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a73428-247b-4694-bb43-6c2ba6d8c675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:13.907337 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a73428-247b-4694-bb43-6c2ba6d8c675 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:13.930661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-f7a73428-247b-4694-bb43-6c2ba6d8c675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:13.930661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:13.930661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:13.930661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:13.930661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:13.930661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:13.930661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:13.930661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:13.930661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:13.930661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:13.930661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:13.930661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:13.930661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:13.930661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:13.930661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:13.931611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:13.932492 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:13.932492 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:13.932492 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:13.932492 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:13.932492 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 345/670] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:13.932779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a73428-247b-4694-bb43-6c2ba6d8c675 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:13.992834 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf780dd-2b7a-4279-a67a-4908c6bcba93 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:14.037013 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabef1ac-70e7-44ae-9101-66fcb2974fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:14.038121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabef1ac-70e7-44ae-9101-66fcb2974fcf None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.038413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabef1ac-70e7-44ae-9101-66fcb2974fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.038979 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabef1ac-70e7-44ae-9101-66fcb2974fcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.049693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a73428-247b-4694-bb43-6c2ba6d8c675 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:14.085921 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a6898-ef5c-4910-9788-a1a23855a5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:14.086647 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a6898-ef5c-4910-9788-a1a23855a5ef None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.086933 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a6898-ef5c-4910-9788-a1a23855a5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.087312 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a6898-ef5c-4910-9788-a1a23855a5ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.099627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a6898-ef5c-4910-9788-a1a23855a5ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:14.101194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a6898-ef5c-4910-9788-a1a23855a5ef None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:14.108463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:14.121288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-f72a6898-ef5c-4910-9788-a1a23855a5ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:14.121288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:14.121288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:14.121288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:14.121288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:14.121288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:14.121288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:14.121288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:14.121288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:14.121288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:14.121288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:14.121288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:14.121288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:14.121288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:14.121288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:14.122201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:14.123089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:14.123089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:14.123089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:14.123089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:14.123306 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabef1ac-70e7-44ae-9101-66fcb2974fcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:14.124877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabef1ac-70e7-44ae-9101-66fcb2974fcf None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:14.130557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 346/671] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:14.131643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a6898-ef5c-4910-9788-a1a23855a5ef None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:14.153158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:14.244788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a6898-ef5c-4910-9788-a1a23855a5ef None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:14.257301 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 326/672] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:14.258545 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabef1ac-70e7-44ae-9101-66fcb2974fcf None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:14.304613 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838faa8c-91a1-49fa-afd4-009f6c83e30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:14.305468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838faa8c-91a1-49fa-afd4-009f6c83e30d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.305759 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838faa8c-91a1-49fa-afd4-009f6c83e30d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.306034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838faa8c-91a1-49fa-afd4-009f6c83e30d None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.307387 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838faa8c-91a1-49fa-afd4-009f6c83e30d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:14.307720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838faa8c-91a1-49fa-afd4-009f6c83e30d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:14.310693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838faa8c-91a1-49fa-afd4-009f6c83e30d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:14.330532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 347/673] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:14.332371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838faa8c-91a1-49fa-afd4-009f6c83e30d None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:14.376260 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:14.397929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabef1ac-70e7-44ae-9101-66fcb2974fcf None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:14.424109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:14.445113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa04bdc-9955-4488-b12f-46e667baa064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:14.446116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa04bdc-9955-4488-b12f-46e667baa064 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.446409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa04bdc-9955-4488-b12f-46e667baa064 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.446687 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa04bdc-9955-4488-b12f-46e667baa064 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.447677 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa04bdc-9955-4488-b12f-46e667baa064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:14.447989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa04bdc-9955-4488-b12f-46e667baa064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:14.449378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa04bdc-9955-4488-b12f-46e667baa064 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:14.450326 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838faa8c-91a1-49fa-afd4-009f6c83e30d None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:14.465167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 327/674] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:14.469166 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa04bdc-9955-4488-b12f-46e667baa064 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:14.492451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f5c9e-b0d9-4890-8f92-0248df2818c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:14.493646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f5c9e-b0d9-4890-8f92-0248df2818c3 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.494187 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f5c9e-b0d9-4890-8f92-0248df2818c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.494685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f5c9e-b0d9-4890-8f92-0248df2818c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.506220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f5c9e-b0d9-4890-8f92-0248df2818c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:14.508271 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f5c9e-b0d9-4890-8f92-0248df2818c3 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:14.526791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-f58f5c9e-b0d9-4890-8f92-0248df2818c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:14.526791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:14.526791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:14.526791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:14.526791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:14.526791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:14.526791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:14.526791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:14.526791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:14.526791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:14.526791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:14.526791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:14.526791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:14.526791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:14.526791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:14.527712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:14.528581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:14.528581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:14.528581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:14.528581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:14.531763 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 348/675] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:14.532820 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f5c9e-b0d9-4890-8f92-0248df2818c3 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:14.593783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa04bdc-9955-4488-b12f-46e667baa064 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:14.635903 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a9bec-b3fb-4bee-9be0-d1f4e5a2fa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:14.636630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a9bec-b3fb-4bee-9be0-d1f4e5a2fa9b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.636915 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a9bec-b3fb-4bee-9be0-d1f4e5a2fa9b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.637217 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a9bec-b3fb-4bee-9be0-d1f4e5a2fa9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.637694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f5c9e-b0d9-4890-8f92-0248df2818c3 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:14.646381 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a9bec-b3fb-4bee-9be0-d1f4e5a2fa9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:14.647821 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a9bec-b3fb-4bee-9be0-d1f4e5a2fa9b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:14.666849 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:14.668397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-086a9bec-b3fb-4bee-9be0-d1f4e5a2fa9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:14.668397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:14.668397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:14.668397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:14.668397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:14.668397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:14.668397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:14.668397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:14.668397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:14.668397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:14.668397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:14.668397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:14.668397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:14.668397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:14.668397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:14.669290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:14.670201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:14.670201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:14.670201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:14.670201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:14.670201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:14.670201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:14.670201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:14.670201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:14.673263 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 328/676] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:14.674372 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a9bec-b3fb-4bee-9be0-d1f4e5a2fa9b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:14.686015 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:14.689551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f77be-311b-4138-a488-f29e3a97c188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:14.690359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f77be-311b-4138-a488-f29e3a97c188 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.690649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f77be-311b-4138-a488-f29e3a97c188 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.690929 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f77be-311b-4138-a488-f29e3a97c188 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.707574 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f77be-311b-4138-a488-f29e3a97c188 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:14.709635 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f77be-311b-4138-a488-f29e3a97c188 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:14.729646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-a72f77be-311b-4138-a488-f29e3a97c188 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:44:14.729646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:14.729646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:14.729646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:14.729646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:14.729646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:14.729646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:14.729646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:14.729646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:14.729646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:14.729646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:14.729646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:14.729646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:14.729646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:14.729646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:14.729646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:14.730801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:14.731728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:14.731728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:14.731728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:14.731728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:14.731728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:14.731728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:14.731728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:14.731728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:14.731728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:44:14.731728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:14.738848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 349/677] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:14.740082 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f77be-311b-4138-a488-f29e3a97c188 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:14.797719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a9bec-b3fb-4bee-9be0-d1f4e5a2fa9b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:14.843989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a097e0f-555d-4484-a596-e033e0a1bc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:14.844667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a097e0f-555d-4484-a596-e033e0a1bc4d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.845418 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a097e0f-555d-4484-a596-e033e0a1bc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.845707 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a097e0f-555d-4484-a596-e033e0a1bc4d None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.846589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a097e0f-555d-4484-a596-e033e0a1bc4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:14.847039 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a097e0f-555d-4484-a596-e033e0a1bc4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:14.848586 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a097e0f-555d-4484-a596-e033e0a1bc4d None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:14.860897 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f77be-311b-4138-a488-f29e3a97c188 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:14.866745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 329/678] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:14.866745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a097e0f-555d-4484-a596-e033e0a1bc4d None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:14.901060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0c20d-ef40-4a09-9770-d8d506ad9ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:14.901678 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0c20d-ef40-4a09-9770-d8d506ad9ecb None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.901968 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0c20d-ef40-4a09-9770-d8d506ad9ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.902253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0c20d-ef40-4a09-9770-d8d506ad9ecb None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.903038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0c20d-ef40-4a09-9770-d8d506ad9ecb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:14.903357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0c20d-ef40-4a09-9770-d8d506ad9ecb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:14.905077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0c20d-ef40-4a09-9770-d8d506ad9ecb None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:14.918166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 350/679] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:14.919985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0e67b-9527-449b-85aa-3c0822208e70 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:14.920401 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0e67b-9527-449b-85aa-3c0822208e70 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:14.921150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0e67b-9527-449b-85aa-3c0822208e70 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:14.923116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 351/680] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:14.924092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0e67b-9527-449b-85aa-3c0822208e70 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:14.947004 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:14.979206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:14.990739 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a097e0f-555d-4484-a596-e033e0a1bc4d None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:15.029697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a714c1-7ed8-4a30-b124-a769642e1b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:15.030389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a714c1-7ed8-4a30-b124-a769642e1b22 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:15.030674 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a714c1-7ed8-4a30-b124-a769642e1b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:15.030950 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a714c1-7ed8-4a30-b124-a769642e1b22 None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:15.031824 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a714c1-7ed8-4a30-b124-a769642e1b22 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:15.032135 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a714c1-7ed8-4a30-b124-a769642e1b22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:15.033582 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a714c1-7ed8-4a30-b124-a769642e1b22 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:15.036229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0e67b-9527-449b-85aa-3c0822208e70 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:15.056155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 330/681] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jun 16 14:44:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:15.056155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a714c1-7ed8-4a30-b124-a769642e1b22 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:15.071517 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ecbc5-6082-4ad5-8845-0f38748ece86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:15.072321 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ecbc5-6082-4ad5-8845-0f38748ece86 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:15.072618 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ecbc5-6082-4ad5-8845-0f38748ece86 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:15.072900 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ecbc5-6082-4ad5-8845-0f38748ece86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:15.080864 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ecbc5-6082-4ad5-8845-0f38748ece86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:15.082453 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ecbc5-6082-4ad5-8845-0f38748ece86 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:15.097269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-426ecbc5-6082-4ad5-8845-0f38748ece86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:15.097269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:15.097269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:15.097269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:15.097269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:15.097269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:15.097269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:15.097269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:15.097269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:15.097269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:15.097269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:15.097269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:15.097269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:15.097269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:15.097269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:15.098226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:15.099138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:15.099138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:15.099138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:15.099138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:15.099138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:15.099138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:15.099138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:15.099138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:15.104658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 352/682] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:15.104658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2ff8f-8613-4352-a225-0d1936082dab None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:15.104658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2ff8f-8613-4352-a225-0d1936082dab None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:15.104658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2ff8f-8613-4352-a225-0d1936082dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:15.124451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-35c2ff8f-8613-4352-a225-0d1936082dab None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:15.126254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-35c2ff8f-8613-4352-a225-0d1936082dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:15.166712 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a714c1-7ed8-4a30-b124-a769642e1b22 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:15.193102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:15.198513 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 353/683] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:15.199407 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2ff8f-8613-4352-a225-0d1936082dab None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:15.208636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8a5c2-0ad6-42f1-bfc7-869421088e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:15.209980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8a5c2-0ad6-42f1-bfc7-869421088e6a None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:15.210489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8a5c2-0ad6-42f1-bfc7-869421088e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:15.211289 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8a5c2-0ad6-42f1-bfc7-869421088e6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:15.212636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8a5c2-0ad6-42f1-bfc7-869421088e6a None admin] RBAC: Adding query filter params (role.id=037df45eceeb4cb7aec314c290fa7820, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=e8f268ca2cb34c06b188908495cdcd53) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:15.213176 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8a5c2-0ad6-42f1-bfc7-869421088e6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:15.215611 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8a5c2-0ad6-42f1-bfc7-869421088e6a None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:15.224143 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 331/684] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:15 2022] GET /identity/v3/role_assignments?user.id=e8f268ca2cb34c06b188908495cdcd53&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=037df45eceeb4cb7aec314c290fa7820 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:15.225495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8a5c2-0ad6-42f1-bfc7-869421088e6a None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:15.257526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:15.328669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2ff8f-8613-4352-a225-0d1936082dab None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:15.359763 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8a5c2-0ad6-42f1-bfc7-869421088e6a None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:15.367864 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706a500-d841-4b9c-b137-7d648ea87e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:15.368670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706a500-d841-4b9c-b137-7d648ea87e1a None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:15.369030 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706a500-d841-4b9c-b137-7d648ea87e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:15.369425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706a500-d841-4b9c-b137-7d648ea87e1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:15.408602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d24c40-e8c8-43cf-8df1-819e73dbb309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:15.409324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d24c40-e8c8-43cf-8df1-819e73dbb309 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:15.409615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d24c40-e8c8-43cf-8df1-819e73dbb309 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:15.409899 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d24c40-e8c8-43cf-8df1-819e73dbb309 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:15.411312 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d24c40-e8c8-43cf-8df1-819e73dbb309 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:15.411312 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d24c40-e8c8-43cf-8df1-819e73dbb309 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:15.416538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d24c40-e8c8-43cf-8df1-819e73dbb309 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:15.428029 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 332/685] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:15.428592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d24c40-e8c8-43cf-8df1-819e73dbb309 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:15.462109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706a500-d841-4b9c-b137-7d648ea87e1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:15.463585 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706a500-d841-4b9c-b137-7d648ea87e1a None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:15.491325 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:15.508435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:15.564393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d24c40-e8c8-43cf-8df1-819e73dbb309 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:15.586706 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 354/686] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:15.587561 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706a500-d841-4b9c-b137-7d648ea87e1a None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:15.611200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b4857-05b6-4973-af9a-e7780912f14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:15.612345 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b4857-05b6-4973-af9a-e7780912f14d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:15.612831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b4857-05b6-4973-af9a-e7780912f14d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:15.614366 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b4857-05b6-4973-af9a-e7780912f14d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:15.631000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b4857-05b6-4973-af9a-e7780912f14d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:15.641839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-d27b4857-05b6-4973-af9a-e7780912f14d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:15.641839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:15.641839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:15.641839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:15.641839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:15.641839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:15.641839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:15.641839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:15.641839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:15.641839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:15.641839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:15.641839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:15.641839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:15.641839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:15.641839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:15.641839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:15.642775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:15.642775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:15.642775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:15.642775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:15.642775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:15.642775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:15.642775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:15.642775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:15.642775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:15.642775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:15.642775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:15.642775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:15.642775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:15.642775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:15.642775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:15.642775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:15.643610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:15.643610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:15.643610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:15.643610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:15.643610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:15.643610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:15.643610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:15.643610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:15.643610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:15.643610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:15.643610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:15.643610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:15.648556 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 333/687] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:15.649900 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b4857-05b6-4973-af9a-e7780912f14d None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:15.704744 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706a500-d841-4b9c-b137-7d648ea87e1a None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:15.741538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2938bee-363d-4c54-9c2e-5815810fe317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:15.742502 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2938bee-363d-4c54-9c2e-5815810fe317 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:15.742959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2938bee-363d-4c54-9c2e-5815810fe317 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:15.743409 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2938bee-363d-4c54-9c2e-5815810fe317 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:15.744427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2938bee-363d-4c54-9c2e-5815810fe317 None admin] RBAC: Adding query filter params (role.id=037df45eceeb4cb7aec314c290fa7820, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=db3b603ceffb43bc99684e0d2319e3ce) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:15.744939 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2938bee-363d-4c54-9c2e-5815810fe317 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:15.746613 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2938bee-363d-4c54-9c2e-5815810fe317 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:15.753283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 355/688] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:15 2022] GET /identity/v3/role_assignments?user.id=db3b603ceffb43bc99684e0d2319e3ce&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=037df45eceeb4cb7aec314c290fa7820 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:15.754471 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2938bee-363d-4c54-9c2e-5815810fe317 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:15.757803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:15.803020 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b4857-05b6-4973-af9a-e7780912f14d None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:15.810080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:15.854989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f73a0-33a2-48c2-9f3e-fe046a734150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:15.856186 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f73a0-33a2-48c2-9f3e-fe046a734150 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:15.856483 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f73a0-33a2-48c2-9f3e-fe046a734150 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:15.856769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f73a0-33a2-48c2-9f3e-fe046a734150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:15.885962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f73a0-33a2-48c2-9f3e-fe046a734150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:15.887747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f73a0-33a2-48c2-9f3e-fe046a734150 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:15.911996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-fc0f73a0-33a2-48c2-9f3e-fe046a734150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:15.911996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:15.911996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:15.911996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:15.911996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:15.911996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:15.911996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:15.911996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:15.911996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:15.911996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:15.911996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:15.911996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:15.911996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:15.911996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:15.911996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:15.912956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:15.913877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:15.913877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:15.913877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:15.913877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:15.915086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 334/689] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:15.920347 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f73a0-33a2-48c2-9f3e-fe046a734150 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:15.946504 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2938bee-363d-4c54-9c2e-5815810fe317 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:15.993496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8816b6-a22c-4c17-856d-9cdb242a0e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:15.994177 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8816b6-a22c-4c17-856d-9cdb242a0e13 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:15.994462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8816b6-a22c-4c17-856d-9cdb242a0e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:15.994743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8816b6-a22c-4c17-856d-9cdb242a0e13 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:15.995592 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8816b6-a22c-4c17-856d-9cdb242a0e13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:15.995801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8816b6-a22c-4c17-856d-9cdb242a0e13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:15.997232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8816b6-a22c-4c17-856d-9cdb242a0e13 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:16.006651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 356/690] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:16.008000 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4db5fd-5c91-45eb-965c-a767aa23a26c None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:16.008380 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4db5fd-5c91-45eb-965c-a767aa23a26c None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:16.008881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4db5fd-5c91-45eb-965c-a767aa23a26c None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:16.010752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 357/691] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:16.016151 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413e65c-e1bc-4638-8008-88e2acf0a0e5 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:16.016442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413e65c-e1bc-4638-8008-88e2acf0a0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:16.016728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413e65c-e1bc-4638-8008-88e2acf0a0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:16.034481 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-e413e65c-e1bc-4638-8008-88e2acf0a0e5 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:16.036123 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e413e65c-e1bc-4638-8008-88e2acf0a0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:16.056270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f73a0-33a2-48c2-9f3e-fe046a734150 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:16.096240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b87ca-bec2-4424-bded-18c5f4e2d8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:16.097074 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b87ca-bec2-4424-bded-18c5f4e2d8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:16.097278 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b87ca-bec2-4424-bded-18c5f4e2d8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:16.097523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b87ca-bec2-4424-bded-18c5f4e2d8b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:16.098301 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b87ca-bec2-4424-bded-18c5f4e2d8b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:16.098652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b87ca-bec2-4424-bded-18c5f4e2d8b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:16.100061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b87ca-bec2-4424-bded-18c5f4e2d8b4 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:16.113605 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 335/692] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:16.114500 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b87ca-bec2-4424-bded-18c5f4e2d8b4 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:16.117794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:16.129572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 358/693] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:16.130982 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413e65c-e1bc-4638-8008-88e2acf0a0e5 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:16.138559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:16.246049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b87ca-bec2-4424-bded-18c5f4e2d8b4 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:16.253230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413e65c-e1bc-4638-8008-88e2acf0a0e5 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:16.290909 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beb639-216a-4668-990d-bb07ca51361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:16.291713 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb639-216a-4668-990d-bb07ca51361e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:16.291999 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb639-216a-4668-990d-bb07ca51361e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:16.292276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beb639-216a-4668-990d-bb07ca51361e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:16.294586 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8eac7a-f420-46d6-a2ff-4b16225eea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:16.296065 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8eac7a-f420-46d6-a2ff-4b16225eea72 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:16.296559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8eac7a-f420-46d6-a2ff-4b16225eea72 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:16.297038 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8eac7a-f420-46d6-a2ff-4b16225eea72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:16.299639 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beb639-216a-4668-990d-bb07ca51361e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:16.301236 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beb639-216a-4668-990d-bb07ca51361e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:16.309554 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8eac7a-f420-46d6-a2ff-4b16225eea72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:16.311764 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8eac7a-f420-46d6-a2ff-4b16225eea72 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:16.316532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-64beb639-216a-4668-990d-bb07ca51361e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:16.316532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:16.316532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:16.316532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:16.316532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:16.316532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:16.316532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:16.316532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:16.316532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:16.316532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:16.316532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:16.316532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:16.316532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:16.316532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:16.316532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:16.317501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:16.318400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:16.318400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:16.318400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:16.318400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:16.318400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:16.318400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:16.318400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:16.318400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:16.318400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 359/694] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:16.319328 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beb639-216a-4668-990d-bb07ca51361e None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:16.337046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-bc8eac7a-f420-46d6-a2ff-4b16225eea72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:16.337046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:16.337046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:16.337046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:16.337046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:16.337046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:16.337046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:16.337046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:16.337046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:16.337046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:16.337046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:16.337046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:16.337046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:16.337046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:16.337046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:16.337996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:16.338890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:16.338890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:16.338890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:16.338890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:16.346653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 336/695] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:16.346653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8eac7a-f420-46d6-a2ff-4b16225eea72 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:16.398617 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:16.423012 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:16.453730 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8eac7a-f420-46d6-a2ff-4b16225eea72 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:16.457580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beb639-216a-4668-990d-bb07ca51361e None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:16.490391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e3a38-2bf4-47f3-afc7-574a0abe1092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:16.491134 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e3a38-2bf4-47f3-afc7-574a0abe1092 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:16.491491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e3a38-2bf4-47f3-afc7-574a0abe1092 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:16.491840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e3a38-2bf4-47f3-afc7-574a0abe1092 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:16.492696 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e3a38-2bf4-47f3-afc7-574a0abe1092 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:16.493097 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e3a38-2bf4-47f3-afc7-574a0abe1092 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:16.494621 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e3a38-2bf4-47f3-afc7-574a0abe1092 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:16.501397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5285a-13ec-40d6-9a0e-cd3593f4cd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:16.502931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5285a-13ec-40d6-9a0e-cd3593f4cd82 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:16.503404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5285a-13ec-40d6-9a0e-cd3593f4cd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:16.503867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5285a-13ec-40d6-9a0e-cd3593f4cd82 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:16.505162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5285a-13ec-40d6-9a0e-cd3593f4cd82 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:16.506982 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5285a-13ec-40d6-9a0e-cd3593f4cd82 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:16.512181 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 337/696] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:16.512181 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e3a38-2bf4-47f3-afc7-574a0abe1092 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:16.531603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-74d5285a-13ec-40d6-9a0e-cd3593f4cd82 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:44:16.531603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:16.531603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:16.531603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:16.531603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:16.531603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:16.531603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:16.531603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:16.531603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:44:16.531603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:16.531603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:16.531603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:16.531603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:16.531603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:16.531603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:16.531603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:16.532602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:16.532602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:16.532602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:16.532602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:16.532602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:16.532602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:16.532602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:16.532602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:16.532602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:16.532602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:16.532602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:16.532602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:16.532602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:16.532602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:16.532602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:16.532602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:16.533473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:16.533473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:16.533473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:16.533473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:16.533473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:16.533473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:16.533473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:16.533473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:16.533473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:16.533473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:16.533473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:16.533473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:16.533473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:16.533473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:44:16.533473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:16.536747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 360/697] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Jun 16 14:44:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:16.537784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5285a-13ec-40d6-9a0e-cd3593f4cd82 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:16.623524 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e3a38-2bf4-47f3-afc7-574a0abe1092 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:16.654835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:16.661277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613473c-a2dc-4024-96ca-843642b24ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:16.662201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613473c-a2dc-4024-96ca-843642b24ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:16.662600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613473c-a2dc-4024-96ca-843642b24ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:16.662978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6613473c-a2dc-4024-96ca-843642b24ee8 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:16.663775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613473c-a2dc-4024-96ca-843642b24ee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:16.664150 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613473c-a2dc-4024-96ca-843642b24ee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:16.665634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6613473c-a2dc-4024-96ca-843642b24ee8 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:16.670527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5285a-13ec-40d6-9a0e-cd3593f4cd82 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:16.683172 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 338/698] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:16.683172 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613473c-a2dc-4024-96ca-843642b24ee8 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:16.697428 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:16.716691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea090c-06ba-4f45-aa7e-fb7b22398102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:16.717443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea090c-06ba-4f45-aa7e-fb7b22398102 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:16.718246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea090c-06ba-4f45-aa7e-fb7b22398102 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:16.718600 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea090c-06ba-4f45-aa7e-fb7b22398102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:16.719452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea090c-06ba-4f45-aa7e-fb7b22398102 None admin] RBAC: Adding query filter params (role.id=037df45eceeb4cb7aec314c290fa7820, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=a952ee6a39e1453b80a8a8b787d0fdf5) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:16.719765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea090c-06ba-4f45-aa7e-fb7b22398102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:16.721499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea090c-06ba-4f45-aa7e-fb7b22398102 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:16.733787 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 361/699] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:16 2022] GET /identity/v3/role_assignments?user.id=a952ee6a39e1453b80a8a8b787d0fdf5&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=037df45eceeb4cb7aec314c290fa7820 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:16.734761 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea090c-06ba-4f45-aa7e-fb7b22398102 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:16.807229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6613473c-a2dc-4024-96ca-843642b24ee8 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:16.856365 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c289e-d387-4f75-b67d-cd1c0ab1fdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:16.857736 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c289e-d387-4f75-b67d-cd1c0ab1fdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:16.858322 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c289e-d387-4f75-b67d-cd1c0ab1fdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:16.858801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c289e-d387-4f75-b67d-cd1c0ab1fdf4 None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:16.859801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c289e-d387-4f75-b67d-cd1c0ab1fdf4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:16.860366 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c289e-d387-4f75-b67d-cd1c0ab1fdf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:16.862691 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c289e-d387-4f75-b67d-cd1c0ab1fdf4 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:16.869424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 339/700] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jun 16 14:44:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:16.878168 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c289e-d387-4f75-b67d-cd1c0ab1fdf4 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:16.948854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea090c-06ba-4f45-aa7e-fb7b22398102 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:16.994971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:17.014191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f871c5-0aea-47c4-98df-b2630bfe57c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:17.015364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f871c5-0aea-47c4-98df-b2630bfe57c4 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.015852 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f871c5-0aea-47c4-98df-b2630bfe57c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.017064 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f871c5-0aea-47c4-98df-b2630bfe57c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.027896 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f871c5-0aea-47c4-98df-b2630bfe57c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:17.030010 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f871c5-0aea-47c4-98df-b2630bfe57c4 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:17.049364 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c289e-d387-4f75-b67d-cd1c0ab1fdf4 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:17.051264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-10f871c5-0aea-47c4-98df-b2630bfe57c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:17.051264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:17.051264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:17.051264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:17.051264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:17.051264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:17.051264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:17.051264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:17.051264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:17.051264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:17.051264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:17.051264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:17.051264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:17.051264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:17.051264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:17.051264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:17.052181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:17.053101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:17.053101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:17.053101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:17.053101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:17.053101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:17.053101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:17.053101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:17.053101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:17.053101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:17.053101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:17.056334 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 362/701] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 16 14:44:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:17.064889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f871c5-0aea-47c4-98df-b2630bfe57c4 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:17.095219 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45da4e8-6078-41fb-a892-1e785741af9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:17.096392 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45da4e8-6078-41fb-a892-1e785741af9d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.096880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45da4e8-6078-41fb-a892-1e785741af9d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.097423 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45da4e8-6078-41fb-a892-1e785741af9d None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.098349 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45da4e8-6078-41fb-a892-1e785741af9d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:17.099242 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45da4e8-6078-41fb-a892-1e785741af9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:17.101324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45da4e8-6078-41fb-a892-1e785741af9d None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:17.110133 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 340/702] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jun 16 14:44:16 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:17.145558 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:17.192546 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f871c5-0aea-47c4-98df-b2630bfe57c4 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:17.231690 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47c89f-6cb8-40da-8203-b9296696a178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:17.232395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47c89f-6cb8-40da-8203-b9296696a178 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.232685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47c89f-6cb8-40da-8203-b9296696a178 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.232969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47c89f-6cb8-40da-8203-b9296696a178 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.233903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47c89f-6cb8-40da-8203-b9296696a178 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:17.234223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47c89f-6cb8-40da-8203-b9296696a178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:17.235693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47c89f-6cb8-40da-8203-b9296696a178 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:17.257156 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 363/703] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 16 14:44:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:17.263200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45da4e8-6078-41fb-a892-1e785741af9d None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:17.380490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45da4e8-6078-41fb-a892-1e785741af9d None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:17.401183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:17.420637 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b3b59-95d9-48dd-bd8e-f9aff8f55969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:17.424132 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b3b59-95d9-48dd-bd8e-f9aff8f55969 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.424132 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b3b59-95d9-48dd-bd8e-f9aff8f55969 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.424132 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b3b59-95d9-48dd-bd8e-f9aff8f55969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.505082 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b3b59-95d9-48dd-bd8e-f9aff8f55969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:17.506563 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b3b59-95d9-48dd-bd8e-f9aff8f55969 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:17.618734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 341/704] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:17.625105 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47c89f-6cb8-40da-8203-b9296696a178 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:17.774734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:17.777715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47c89f-6cb8-40da-8203-b9296696a178 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:17.785447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b30769-25a3-4b6e-ade8-dded2e58c772 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.785747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b30769-25a3-4b6e-ade8-dded2e58c772 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.786037 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b30769-25a3-4b6e-ade8-dded2e58c772 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.787678 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 342/705] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:17.798528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4fcff-9311-4a00-8b5c-ea7a7bf4c7ef None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.798824 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4fcff-9311-4a00-8b5c-ea7a7bf4c7ef None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.799822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4fcff-9311-4a00-8b5c-ea7a7bf4c7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.818446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f44ed6-9326-4ec1-8de6-3644a3200aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:17.819606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f44ed6-9326-4ec1-8de6-3644a3200aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:17.820093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f44ed6-9326-4ec1-8de6-3644a3200aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:17.820570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f44ed6-9326-4ec1-8de6-3644a3200aa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:17.832223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f44ed6-9326-4ec1-8de6-3644a3200aa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:17.834073 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f44ed6-9326-4ec1-8de6-3644a3200aa0 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:17.838692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-88f4fcff-9311-4a00-8b5c-ea7a7bf4c7ef None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:17.839442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-88f4fcff-9311-4a00-8b5c-ea7a7bf4c7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:17.852855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-14f44ed6-9326-4ec1-8de6-3644a3200aa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:17.852855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:17.852855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:17.852855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:17.852855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:17.852855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:17.852855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:17.852855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:17.852855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:17.852855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:17.852855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:17.852855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:17.852855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:17.852855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:17.852855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:17.853789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:17.854664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:17.854664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:17.854664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:17.854664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:17.856985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 364/706] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:17.863725 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f44ed6-9326-4ec1-8de6-3644a3200aa0 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:17.868855 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:17.975454 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 343/707] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:18.013503 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4fcff-9311-4a00-8b5c-ea7a7bf4c7ef None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:18.048839 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f44ed6-9326-4ec1-8de6-3644a3200aa0 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:18.106421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319854d2-d250-4793-9c5c-6331c8e55c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:18.109366 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319854d2-d250-4793-9c5c-6331c8e55c2c None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.111981 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319854d2-d250-4793-9c5c-6331c8e55c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.112528 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319854d2-d250-4793-9c5c-6331c8e55c2c None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.113680 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319854d2-d250-4793-9c5c-6331c8e55c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:18.114399 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319854d2-d250-4793-9c5c-6331c8e55c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:18.116059 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319854d2-d250-4793-9c5c-6331c8e55c2c None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:18.147101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 365/708] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:18.149916 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319854d2-d250-4793-9c5c-6331c8e55c2c None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:18.177775 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:18.212075 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4fcff-9311-4a00-8b5c-ea7a7bf4c7ef None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:18.255704 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e5ca5-d10b-48ac-a998-ac9d0eab1254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:18.256858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5ca5-d10b-48ac-a998-ac9d0eab1254 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.257161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5ca5-d10b-48ac-a998-ac9d0eab1254 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.257610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5ca5-d10b-48ac-a998-ac9d0eab1254 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.270408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e5ca5-d10b-48ac-a998-ac9d0eab1254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:18.272284 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e5ca5-d10b-48ac-a998-ac9d0eab1254 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:18.283964 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319854d2-d250-4793-9c5c-6331c8e55c2c None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:18.294424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-537e5ca5-d10b-48ac-a998-ac9d0eab1254 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:18.294424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:18.294424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:18.294424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:18.294424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:18.294424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:18.294424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:18.294424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:18.294424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:18.294424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:18.294424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:18.294424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:18.294424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:18.294424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:18.294424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:18.295510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:18.297121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:18.297121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:18.297121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:18.297121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:18.299421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 344/709] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:18.300404 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5049e1-3cf4-4f24-b424-9a25ba5ef342 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.300694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5049e1-3cf4-4f24-b424-9a25ba5ef342 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.300973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5049e1-3cf4-4f24-b424-9a25ba5ef342 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.305172 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 345/710] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:18.305172 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5049e1-3cf4-4f24-b424-9a25ba5ef342 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:18.310166 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:18.334554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fa199-9b6c-4546-99b0-e1c7f33cc9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:18.335651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fa199-9b6c-4546-99b0-e1c7f33cc9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.336012 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fa199-9b6c-4546-99b0-e1c7f33cc9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.336297 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fa199-9b6c-4546-99b0-e1c7f33cc9e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.346890 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fa199-9b6c-4546-99b0-e1c7f33cc9e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:18.348461 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fa199-9b6c-4546-99b0-e1c7f33cc9e3 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:18.369003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-6a2fa199-9b6c-4546-99b0-e1c7f33cc9e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:18.369003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:18.369003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:18.369003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:18.369003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:18.369003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:18.369003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:18.369003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:18.369003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:18.369003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:18.369003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:18.369003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:18.369003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:18.369003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:18.369003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:18.370032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:18.370935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:18.370935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:18.370935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:18.370935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:18.370935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:18.370935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:18.370935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:18.370935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:18.370935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 366/711] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:18.372669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6cead-73ee-42e6-b62d-826a5c964cdf None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.373216 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6cead-73ee-42e6-b62d-826a5c964cdf None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.377153 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6cead-73ee-42e6-b62d-826a5c964cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.398992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-76b6cead-73ee-42e6-b62d-826a5c964cdf None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:18.401057 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-76b6cead-73ee-42e6-b62d-826a5c964cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:18.436060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5049e1-3cf4-4f24-b424-9a25ba5ef342 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:18.482407 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d3157-b827-4382-bfd4-1803cda5b4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:18.484067 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d3157-b827-4382-bfd4-1803cda5b4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.484629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d3157-b827-4382-bfd4-1803cda5b4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.484918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d3157-b827-4382-bfd4-1803cda5b4b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.490424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d3157-b827-4382-bfd4-1803cda5b4b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:18.490424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d3157-b827-4382-bfd4-1803cda5b4b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:18.490424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d3157-b827-4382-bfd4-1803cda5b4b8 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:18.492584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 367/712] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:18.493554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6cead-73ee-42e6-b62d-826a5c964cdf None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:18.495894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:18.515414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 346/713] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:18.519032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d3157-b827-4382-bfd4-1803cda5b4b8 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:18.598991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:18.631136 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6cead-73ee-42e6-b62d-826a5c964cdf None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:18.646382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d3157-b827-4382-bfd4-1803cda5b4b8 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:18.677732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafdf47-d988-4aa1-996b-abd70730221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:18.678855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafdf47-d988-4aa1-996b-abd70730221b None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.679838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafdf47-d988-4aa1-996b-abd70730221b None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.680541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafdf47-d988-4aa1-996b-abd70730221b None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.681760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafdf47-d988-4aa1-996b-abd70730221b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:18.682642 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafdf47-d988-4aa1-996b-abd70730221b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:18.684544 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafdf47-d988-4aa1-996b-abd70730221b None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:18.687993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e46ea-a44e-4e5e-9e7c-1f3586db1e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:18.688808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e46ea-a44e-4e5e-9e7c-1f3586db1e71 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.689096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e46ea-a44e-4e5e-9e7c-1f3586db1e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.689413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e46ea-a44e-4e5e-9e7c-1f3586db1e71 None admin] PATH_INFO: `/v3/services/network` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.690075 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e46ea-a44e-4e5e-9e7c-1f3586db1e71 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:18.691544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e46ea-a44e-4e5e-9e7c-1f3586db1e71 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:18.699237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 368/714] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:18.700184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafdf47-d988-4aa1-996b-abd70730221b None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-d12e46ea-a44e-4e5e-9e7c-1f3586db1e71 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:18.708384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:18.709632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:18.709632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:18.709632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:18.709632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:18.709632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:18.709632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:18.709632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:18.709632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:18.709632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:18.709632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:18.709632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:18.709632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:18.709632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:18.709632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:18.709632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:18.709632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:18.710633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:18.710633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:18.710633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:18.710633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:18.710633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:18.710633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:18.710633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:18.710633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:18.710633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:18.710633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:18.710633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:18.710633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:18.710633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:44:18.710633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:18.713203 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 347/715] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:18 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:18.714143 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e46ea-a44e-4e5e-9e7c-1f3586db1e71 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:18.769753 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:18.814551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafdf47-d988-4aa1-996b-abd70730221b None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:18.829313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e46ea-a44e-4e5e-9e7c-1f3586db1e71 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:18.850477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f76b3a-3937-40df-9568-fb57c019f1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:18.851181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f76b3a-3937-40df-9568-fb57c019f1c2 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.851470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f76b3a-3937-40df-9568-fb57c019f1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.851752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f76b3a-3937-40df-9568-fb57c019f1c2 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.852456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f76b3a-3937-40df-9568-fb57c019f1c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:18.853928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f76b3a-3937-40df-9568-fb57c019f1c2 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:18.860545 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:18.870694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc7a83-54ac-4fbf-a608-141042c72f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:18.871358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc7a83-54ac-4fbf-a608-141042c72f4b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:18.871657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc7a83-54ac-4fbf-a608-141042c72f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:18.871942 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc7a83-54ac-4fbf-a608-141042c72f4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:18.877711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc7a83-54ac-4fbf-a608-141042c72f4b None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=60c2f1c63a674e3195c490ab5ad1318f) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:18.877711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc7a83-54ac-4fbf-a608-141042c72f4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:18.877711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc7a83-54ac-4fbf-a608-141042c72f4b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:18.880830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 348/716] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:18 2022] GET /identity/v3/role_assignments?user.id=60c2f1c63a674e3195c490ab5ad1318f&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=c865040abd6c4b099381557da21c471d => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:18.881876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc7a83-54ac-4fbf-a608-141042c72f4b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:18.971527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 369/717] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:44:18 2022] POST /identity/v3/users => generated 254 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:19.015635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc7a83-54ac-4fbf-a608-141042c72f4b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:19.056560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0a5de-3ffa-4887-972e-25104c763a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:19.057806 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0a5de-3ffa-4887-972e-25104c763a40 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:19.058336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0a5de-3ffa-4887-972e-25104c763a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:19.058877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0a5de-3ffa-4887-972e-25104c763a40 None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:19.059813 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0a5de-3ffa-4887-972e-25104c763a40 None admin] RBAC: Adding query filter params (name=network) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:19.060408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0a5de-3ffa-4887-972e-25104c763a40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:19.062178 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0a5de-3ffa-4887-972e-25104c763a40 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:19.070048 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 349/718] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:19.079473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f76b3a-3937-40df-9568-fb57c019f1c2 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:19.222718 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f76b3a-3937-40df-9568-fb57c019f1c2 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:19.241191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:19.262298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115121f-f906-4a6e-bf76-e0d94fe59592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:19.263342 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115121f-f906-4a6e-bf76-e0d94fe59592 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:19.263832 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115121f-f906-4a6e-bf76-e0d94fe59592 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:19.264329 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115121f-f906-4a6e-bf76-e0d94fe59592 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:19.265861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115121f-f906-4a6e-bf76-e0d94fe59592 None admin] RBAC: Adding query filter params (type=network) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:19.266378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115121f-f906-4a6e-bf76-e0d94fe59592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:19.268037 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115121f-f906-4a6e-bf76-e0d94fe59592 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:19.274815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 370/719] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:19.503538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c56803-df77-429e-b230-20e3fc039ea7 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:19.504065 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c56803-df77-429e-b230-20e3fc039ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:19.504065 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c56803-df77-429e-b230-20e3fc039ea7 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:19.505681 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 350/720] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:19.510821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10753252-b9fc-440b-bcd0-297b370b861b None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:19.511118 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10753252-b9fc-440b-bcd0-297b370b861b None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:19.511404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10753252-b9fc-440b-bcd0-297b370b861b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:19.531750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-10753252-b9fc-440b-bcd0-297b370b861b None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:19.532977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-10753252-b9fc-440b-bcd0-297b370b861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:19.604798 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 371/721] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 14:44:19.640880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c56803-df77-429e-b230-20e3fc039ea7 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:19.708567 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6fc1c-de7a-464b-9721-bc83cc0fd624 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:19.709081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6fc1c-de7a-464b-9721-bc83cc0fd624 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:19.709400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6fc1c-de7a-464b-9721-bc83cc0fd624 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:19.711039 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 372/722] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:19.717004 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e02322-0745-4884-a024-fae84c90c4d5 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:19.717324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e02322-0745-4884-a024-fae84c90c4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:19.717598 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e02322-0745-4884-a024-fae84c90c4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:19.720540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:19.749857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-86e02322-0745-4884-a024-fae84c90c4d5 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:19.751065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-86e02322-0745-4884-a024-fae84c90c4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:19.780534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c56803-df77-429e-b230-20e3fc039ea7 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:19.849544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efedb8c-f280-4240-b86f-3e45e39c4e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:19.850844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efedb8c-f280-4240-b86f-3e45e39c4e84 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:19.852211 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efedb8c-f280-4240-b86f-3e45e39c4e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:19.855272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efedb8c-f280-4240-b86f-3e45e39c4e84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:19.876774 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efedb8c-f280-4240-b86f-3e45e39c4e84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:19.886272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-6efedb8c-f280-4240-b86f-3e45e39c4e84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:19.886272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:19.886272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:19.886272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:19.886272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:19.886272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:19.886272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:19.886272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:19.886272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:19.886272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:19.886272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:19.886272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:19.886272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:19.886272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:19.886272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:19.886272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:19.887191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:19.887191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:19.887191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:19.887191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:19.887191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:19.887191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:19.887191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:19.887191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:19.887191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:19.887191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:19.887191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:19.887191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:19.887191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:19.887191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:19.887191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:19.887191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:19.888005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:19.888005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:19.888005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:19.888005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:19.888005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:19.888005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:19.888005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:19.888005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:19.888005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:19.888005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:19.888005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:19.888005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:19.890856 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 351/723] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:19.892910 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 373/724] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 16 14:44:19.896726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efedb8c-f280-4240-b86f-3e45e39c4e84 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:19.915300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e02322-0745-4884-a024-fae84c90c4d5 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:19.975008 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:20.069633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efedb8c-f280-4240-b86f-3e45e39c4e84 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:20.080525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e02322-0745-4884-a024-fae84c90c4d5 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:20.085882 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:20.126355 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ac77d-5b81-4484-8d6e-64a9225859b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:20.127088 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac77d-5b81-4484-8d6e-64a9225859b4 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:20.127386 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac77d-5b81-4484-8d6e-64a9225859b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:20.127666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ac77d-5b81-4484-8d6e-64a9225859b4 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:20.128400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ac77d-5b81-4484-8d6e-64a9225859b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:20.133165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ac77d-5b81-4484-8d6e-64a9225859b4 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:20.134026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f4b3f-659c-4fc1-96b4-c26ddf015711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:20.134963 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f4b3f-659c-4fc1-96b4-c26ddf015711 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:20.135410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f4b3f-659c-4fc1-96b4-c26ddf015711 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:20.135691 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f4b3f-659c-4fc1-96b4-c26ddf015711 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:20.136446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f4b3f-659c-4fc1-96b4-c26ddf015711 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:20.136758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f4b3f-659c-4fc1-96b4-c26ddf015711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:20.140510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f4b3f-659c-4fc1-96b4-c26ddf015711 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:20.148170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 352/725] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:20.153494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f4b3f-659c-4fc1-96b4-c26ddf015711 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:20.242979 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 374/726] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 16 14:44:19 2022] POST /identity/v3/services => generated 251 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:44:20.261412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f4b3f-659c-4fc1-96b4-c26ddf015711 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:20.317118 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f70255-efa9-44a8-9f8c-28854412c337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:20.317998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f70255-efa9-44a8-9f8c-28854412c337 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:20.318355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f70255-efa9-44a8-9f8c-28854412c337 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:20.318639 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f70255-efa9-44a8-9f8c-28854412c337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:20.331640 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f70255-efa9-44a8-9f8c-28854412c337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:20.333036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f70255-efa9-44a8-9f8c-28854412c337 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:20.352421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-31f70255-efa9-44a8-9f8c-28854412c337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:20.352421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:20.352421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:20.352421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:20.352421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:20.352421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:20.352421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:20.352421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:20.352421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:20.352421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:20.352421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:20.352421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:20.352421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:20.352421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:20.352421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:20.353410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:20.354305 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:20.354305 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:20.354305 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:20.354305 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:20.354305 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 353/727] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:20.360474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ac77d-5b81-4484-8d6e-64a9225859b4 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:20.471433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ac77d-5b81-4484-8d6e-64a9225859b4 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:20.472935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:20.512095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a38cd-d419-4f23-b91a-fd7d13801d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:20.512773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a38cd-d419-4f23-b91a-fd7d13801d56 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:20.513059 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a38cd-d419-4f23-b91a-fd7d13801d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:20.513370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a38cd-d419-4f23-b91a-fd7d13801d56 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:20.514098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a38cd-d419-4f23-b91a-fd7d13801d56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:20.514406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a38cd-d419-4f23-b91a-fd7d13801d56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:20.515848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a38cd-d419-4f23-b91a-fd7d13801d56 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:20.528285 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 375/728] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:20.534035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f70255-efa9-44a8-9f8c-28854412c337 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:20.563024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:20.650256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f70255-efa9-44a8-9f8c-28854412c337 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:20.686554 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117e4c3-3b8a-4a37-9252-f841735e9430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:20.687904 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117e4c3-3b8a-4a37-9252-f841735e9430 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:20.688190 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117e4c3-3b8a-4a37-9252-f841735e9430 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:20.688523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117e4c3-3b8a-4a37-9252-f841735e9430 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:20.696363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117e4c3-3b8a-4a37-9252-f841735e9430 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:20.697851 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117e4c3-3b8a-4a37-9252-f841735e9430 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:20.720413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-a117e4c3-3b8a-4a37-9252-f841735e9430 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:44:20.720413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:20.720413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:20.720413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:20.720413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:20.720413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:20.720413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:20.720413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:20.720413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:20.720413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:20.720413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:20.720413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:20.720413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:20.720413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:20.720413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:20.720413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:20.721417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:20.722382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:20.722382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:20.722382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:20.722382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:20.722382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:20.722382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:20.722382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:20.722382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:20.722382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:44:20.722382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:20.722382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 354/729] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:20.727533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a38cd-d419-4f23-b91a-fd7d13801d56 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:20.893080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a38cd-d419-4f23-b91a-fd7d13801d56 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:20.951066 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5671a-06af-4403-b684-77c6d966a848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:20.951748 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5671a-06af-4403-b684-77c6d966a848 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:20.952031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5671a-06af-4403-b684-77c6d966a848 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:20.952310 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5671a-06af-4403-b684-77c6d966a848 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:20.953786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5671a-06af-4403-b684-77c6d966a848 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:20.954128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5671a-06af-4403-b684-77c6d966a848 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:20.955749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5671a-06af-4403-b684-77c6d966a848 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:20.987727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 376/730] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jun 16 14:44:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:20.993222 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117e4c3-3b8a-4a37-9252-f841735e9430 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:21.103024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:21.125649 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117e4c3-3b8a-4a37-9252-f841735e9430 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:21.180532 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bcc01-b554-4e87-b4bb-0f0af7066b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:21.181201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bcc01-b554-4e87-b4bb-0f0af7066b71 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:21.181489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bcc01-b554-4e87-b4bb-0f0af7066b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:21.181766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bcc01-b554-4e87-b4bb-0f0af7066b71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:21.268833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bcc01-b554-4e87-b4bb-0f0af7066b71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:21.270232 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bcc01-b554-4e87-b4bb-0f0af7066b71 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:21.383164 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:21.402428 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 355/731] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:20 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 14:44:21.407921 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5671a-06af-4403-b684-77c6d966a848 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:21.455763 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:21.562866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5671a-06af-4403-b684-77c6d966a848 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:21.599815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4738a-a740-445d-a57e-74294822dfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:21.600627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4738a-a740-445d-a57e-74294822dfb0 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:21.600924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4738a-a740-445d-a57e-74294822dfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:21.601237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4738a-a740-445d-a57e-74294822dfb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:21.612144 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4738a-a740-445d-a57e-74294822dfb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:21.613685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4738a-a740-445d-a57e-74294822dfb0 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:21.618445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90450da7-f62d-4a5d-8828-dbede6592cfc None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:21.619290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90450da7-f62d-4a5d-8828-dbede6592cfc None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:21.619767 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90450da7-f62d-4a5d-8828-dbede6592cfc None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:21.625241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 356/732] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:21.627214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe47b-3e39-44ff-ad1a-26ce2e51ab6a None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:21.627699 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe47b-3e39-44ff-ad1a-26ce2e51ab6a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:21.628170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe47b-3e39-44ff-ad1a-26ce2e51ab6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:21.632287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-e1c4738a-a740-445d-a57e-74294822dfb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:21.632287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:21.632287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:21.632287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:21.632287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:21.632287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:21.632287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:21.632287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:21.632287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:21.632287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:21.632287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:21.632287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:21.632287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:21.632287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:21.632287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:21.633208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:21.634086 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:21.634086 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:21.634086 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:21.634086 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:21.635858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 377/733] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:21.641197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4738a-a740-445d-a57e-74294822dfb0 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:21.668184 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-a17fe47b-3e39-44ff-ad1a-26ce2e51ab6a None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:21.669426 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a17fe47b-3e39-44ff-ad1a-26ce2e51ab6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:21.763687 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:21.791594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 357/734] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:21.793035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3827d-1cfd-4f0b-82cf-47adf737462a None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:21.793367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3827d-1cfd-4f0b-82cf-47adf737462a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:21.793652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3827d-1cfd-4f0b-82cf-47adf737462a None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:21.795605 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4738a-a740-445d-a57e-74294822dfb0 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:21.799737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 358/735] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:21.806597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade11288-0f03-4273-995f-4b1e22fc4e7d None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:21.806955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade11288-0f03-4273-995f-4b1e22fc4e7d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:21.807192 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade11288-0f03-4273-995f-4b1e22fc4e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:21.828656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-ade11288-0f03-4273-995f-4b1e22fc4e7d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:21.829805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ade11288-0f03-4273-995f-4b1e22fc4e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:21.833116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715307a-9684-48af-9277-adb3a6edd124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:21.833850 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715307a-9684-48af-9277-adb3a6edd124 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:21.834138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715307a-9684-48af-9277-adb3a6edd124 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:21.834420 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715307a-9684-48af-9277-adb3a6edd124 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:21.835641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715307a-9684-48af-9277-adb3a6edd124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:21.835641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715307a-9684-48af-9277-adb3a6edd124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:21.836811 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715307a-9684-48af-9277-adb3a6edd124 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:21.850022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 378/736] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:21.853331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715307a-9684-48af-9277-adb3a6edd124 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:21.955656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 359/737] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 14:44:21.955656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade11288-0f03-4273-995f-4b1e22fc4e7d None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:22.005689 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715307a-9684-48af-9277-adb3a6edd124 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:22.011602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:22.039479 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:22.045234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8053fdf-1f08-4251-a58a-1392380a9456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:22.046159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8053fdf-1f08-4251-a58a-1392380a9456 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.046591 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8053fdf-1f08-4251-a58a-1392380a9456 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.046966 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8053fdf-1f08-4251-a58a-1392380a9456 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.058214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8053fdf-1f08-4251-a58a-1392380a9456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:22.066253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-e8053fdf-1f08-4251-a58a-1392380a9456 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:22.066253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:22.066253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:22.066253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:22.066253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:22.066253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:22.066253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:22.066253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:22.066253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:22.066253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:22.066253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:22.066253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:22.066253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:22.066253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:22.066253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:22.066253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:22.067444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:22.067444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:22.067444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:22.067444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:22.067444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:22.067444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:22.067444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:22.067444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:22.067444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:22.067444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:22.067444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:22.067444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:22.067444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:22.067444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:22.067444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:22.067444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:22.068463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:22.068463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:22.068463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:22.068463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:22.068463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:22.068463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:22.068463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:22.068463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:22.068463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:22.068463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:22.068463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:22.068463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:22.075370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 379/738] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:22.075370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8053fdf-1f08-4251-a58a-1392380a9456 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:22.092060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade11288-0f03-4273-995f-4b1e22fc4e7d None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:22.137279 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e0f9d-3756-4c97-b62c-40e276ad8d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:22.138587 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e0f9d-3756-4c97-b62c-40e276ad8d24 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.139557 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e0f9d-3756-4c97-b62c-40e276ad8d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.140488 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e0f9d-3756-4c97-b62c-40e276ad8d24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.150164 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e0f9d-3756-4c97-b62c-40e276ad8d24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:22.151799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e0f9d-3756-4c97-b62c-40e276ad8d24 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:22.171577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-b15e0f9d-3756-4c97-b62c-40e276ad8d24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:22.171577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:22.171577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:22.171577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:22.171577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:22.171577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:22.171577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:22.171577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:22.171577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:22.171577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:22.171577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:22.171577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:22.171577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:22.171577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:22.171577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:22.172623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:22.173825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:22.173825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:22.173825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:22.173825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:22.173825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:22.173825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:22.173825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:22.173825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:22.176963 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 360/739] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:22.178020 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e0f9d-3756-4c97-b62c-40e276ad8d24 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:22.194790 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8053fdf-1f08-4251-a58a-1392380a9456 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:22.236444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e79624-1ee3-4381-a5b6-639503d57aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:22.237319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e79624-1ee3-4381-a5b6-639503d57aa8 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.237710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e79624-1ee3-4381-a5b6-639503d57aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.238091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e79624-1ee3-4381-a5b6-639503d57aa8 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.238948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e79624-1ee3-4381-a5b6-639503d57aa8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:22.240543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e79624-1ee3-4381-a5b6-639503d57aa8 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:22.310690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e0f9d-3756-4c97-b62c-40e276ad8d24 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:22.314570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:22.344636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a4155-aee6-4bf3-93bc-ff3da146564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:22.345259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a4155-aee6-4bf3-93bc-ff3da146564b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.345545 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a4155-aee6-4bf3-93bc-ff3da146564b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.346101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a4155-aee6-4bf3-93bc-ff3da146564b None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.346559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a4155-aee6-4bf3-93bc-ff3da146564b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:22.346866 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a4155-aee6-4bf3-93bc-ff3da146564b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:22.348235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a4155-aee6-4bf3-93bc-ff3da146564b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:22.351665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 380/740] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 16 14:44:22 2022] POST /identity/v3/services => generated 240 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:22.356325 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e79624-1ee3-4381-a5b6-639503d57aa8 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:22.362204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 361/741] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:22.362204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77499e5-9514-491e-91df-66c63ca1898e None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.362204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77499e5-9514-491e-91df-66c63ca1898e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.362204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77499e5-9514-491e-91df-66c63ca1898e None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.362204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 362/742] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:22.363464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77499e5-9514-491e-91df-66c63ca1898e None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:22.451471 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:22.510344 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e79624-1ee3-4381-a5b6-639503d57aa8 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:22.511623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77499e5-9514-491e-91df-66c63ca1898e None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:22.559182 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2597f47-9987-4507-a407-4566721a5584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:22.560018 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2597f47-9987-4507-a407-4566721a5584 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.560288 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2597f47-9987-4507-a407-4566721a5584 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.560574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2597f47-9987-4507-a407-4566721a5584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.563656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5782bd-e584-42f0-a460-7acbba6690fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:22.564529 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5782bd-e584-42f0-a460-7acbba6690fd None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.564970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5782bd-e584-42f0-a460-7acbba6690fd None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.565426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5782bd-e584-42f0-a460-7acbba6690fd None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.566531 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5782bd-e584-42f0-a460-7acbba6690fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:22.567036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5782bd-e584-42f0-a460-7acbba6690fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:22.568744 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5782bd-e584-42f0-a460-7acbba6690fd None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:22.573098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2597f47-9987-4507-a407-4566721a5584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:22.574826 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2597f47-9987-4507-a407-4566721a5584 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:22.586642 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 381/743] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:22.588164 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ddd64-687a-499a-9242-6ce2cf3d7b75 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.592636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ddd64-687a-499a-9242-6ce2cf3d7b75 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.592636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ddd64-687a-499a-9242-6ce2cf3d7b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.595231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-b2597f47-9987-4507-a407-4566721a5584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:22.595231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:22.595231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:22.595231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:22.595231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:22.595231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:22.595231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:22.595231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:22.595231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:22.595231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:22.595231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:22.595231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:22.595231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:22.595231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:22.595231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:22.596088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:22.596981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:22.596981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:22.596981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:22.596981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:22.596981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 363/744] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:22.597737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2597f47-9987-4507-a407-4566721a5584 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:22.613230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-187ddd64-687a-499a-9242-6ce2cf3d7b75 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:22.614756 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-187ddd64-687a-499a-9242-6ce2cf3d7b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:22.625187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:22.688240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 382/745] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:22.689165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ddd64-687a-499a-9242-6ce2cf3d7b75 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:22.738189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2597f47-9987-4507-a407-4566721a5584 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:22.752122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:22.776592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c6e62-b69f-495d-ae65-a86e3a28044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:22.777721 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c6e62-b69f-495d-ae65-a86e3a28044b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.778155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c6e62-b69f-495d-ae65-a86e3a28044b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.778600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c6e62-b69f-495d-ae65-a86e3a28044b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.779587 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c6e62-b69f-495d-ae65-a86e3a28044b None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=a952ee6a39e1453b80a8a8b787d0fdf5) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:22.780046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c6e62-b69f-495d-ae65-a86e3a28044b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:22.781932 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c6e62-b69f-495d-ae65-a86e3a28044b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:22.793350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 364/746] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:22 2022] GET /identity/v3/role_assignments?user.id=a952ee6a39e1453b80a8a8b787d0fdf5&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=c865040abd6c4b099381557da21c471d => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:22.797361 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c6e62-b69f-495d-ae65-a86e3a28044b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:22.826442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ddd64-687a-499a-9242-6ce2cf3d7b75 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:22.936465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:22.937714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2024f43-23fc-48f8-b918-102db56d3587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:22.938323 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2024f43-23fc-48f8-b918-102db56d3587 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.938604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2024f43-23fc-48f8-b918-102db56d3587 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.938879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2024f43-23fc-48f8-b918-102db56d3587 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.939615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2024f43-23fc-48f8-b918-102db56d3587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:22.939921 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2024f43-23fc-48f8-b918-102db56d3587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:22.945438 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2024f43-23fc-48f8-b918-102db56d3587 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:22.957734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c6e62-b69f-495d-ae65-a86e3a28044b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:22.982649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 383/747] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:22.985594 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbce738-f37b-486e-9572-bf5def4c612a None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:22.986398 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbce738-f37b-486e-9572-bf5def4c612a None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:22.986398 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbce738-f37b-486e-9572-bf5def4c612a None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:22.989087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 384/748] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:22.989087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbce738-f37b-486e-9572-bf5def4c612a None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.018498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ba226-2046-4b4d-a273-b57166592b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:23.019702 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ba226-2046-4b4d-a273-b57166592b50 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.019987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ba226-2046-4b4d-a273-b57166592b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.020268 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ba226-2046-4b4d-a273-b57166592b50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.032224 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ba226-2046-4b4d-a273-b57166592b50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:23.040463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-963ba226-2046-4b4d-a273-b57166592b50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:23.040463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:23.040463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:23.040463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:23.040463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:23.040463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:23.040463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:23.040463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:23.040463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:23.040463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:23.040463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:23.040463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:23.040463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:23.040463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:23.040463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:23.040463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:23.041452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:23.041452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:23.041452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:23.041452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:23.041452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:23.041452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:23.041452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:23.041452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:23.041452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:23.041452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:23.041452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:23.041452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:23.041452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:23.041452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:23.041452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:23.041452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:23.042376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:23.042376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:23.042376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:23.042376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:23.042376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:23.042376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:23.042376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:23.042376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:23.042376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:23.042376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:23.042376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:23.042376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:23.042376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 365/749] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:23.043547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163d9df-23ca-471d-8118-e45f9de314bf None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.043652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163d9df-23ca-471d-8118-e45f9de314bf None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.043912 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163d9df-23ca-471d-8118-e45f9de314bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.060765 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-8163d9df-23ca-471d-8118-e45f9de314bf None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:23.062850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-8163d9df-23ca-471d-8118-e45f9de314bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:23.113700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:23.121595 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbce738-f37b-486e-9572-bf5def4c612a None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:23.153157 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 366/750] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:23.153157 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163d9df-23ca-471d-8118-e45f9de314bf None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.178696 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786be10-b98a-4b18-b256-4742b44fb712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:23.179983 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786be10-b98a-4b18-b256-4742b44fb712 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.180469 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786be10-b98a-4b18-b256-4742b44fb712 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.180989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786be10-b98a-4b18-b256-4742b44fb712 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.193508 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786be10-b98a-4b18-b256-4742b44fb712 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:23.195405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786be10-b98a-4b18-b256-4742b44fb712 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:23.215838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-a786be10-b98a-4b18-b256-4742b44fb712 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:23.215838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:23.215838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:23.215838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:23.215838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:23.215838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:23.215838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:23.215838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:23.215838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:23.215838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:23.215838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:23.215838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:23.215838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:23.215838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:23.215838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:23.215838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:23.216817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:23.217773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:23.217773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:23.217773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:23.217773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:23.217773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:23.217773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:23.217773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:23.217773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:23.217773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:23.217773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:23.219581 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:23.220688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 385/751] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 16 14:44:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:23.221853 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786be10-b98a-4b18-b256-4742b44fb712 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.250843 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163d9df-23ca-471d-8118-e45f9de314bf None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:23.288077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64c99f-c775-4a1e-85dc-d63a7ac1541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:23.288751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64c99f-c775-4a1e-85dc-d63a7ac1541e None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.289036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64c99f-c775-4a1e-85dc-d63a7ac1541e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.289357 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64c99f-c775-4a1e-85dc-d63a7ac1541e None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.290329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64c99f-c775-4a1e-85dc-d63a7ac1541e None admin] RBAC: Adding query filter params (name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:23.290439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64c99f-c775-4a1e-85dc-d63a7ac1541e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:23.291771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64c99f-c775-4a1e-85dc-d63a7ac1541e None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:23.301529 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 367/752] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:23.302452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64c99f-c775-4a1e-85dc-d63a7ac1541e None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.332950 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786be10-b98a-4b18-b256-4742b44fb712 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:23.382899 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731e37d-743b-438c-b614-5a1f13b58d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:23.383717 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731e37d-743b-438c-b614-5a1f13b58d5b None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.384001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731e37d-743b-438c-b614-5a1f13b58d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.384280 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731e37d-743b-438c-b614-5a1f13b58d5b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.385882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731e37d-743b-438c-b614-5a1f13b58d5b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:23.387467 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731e37d-743b-438c-b614-5a1f13b58d5b None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:23.404356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-e731e37d-743b-438c-b614-5a1f13b58d5b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:44:23.404356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:23.404356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:23.404356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:23.404356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:23.404356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:23.404356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:23.404356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:23.404356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:44:23.404356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:23.404356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:23.404356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:23.404356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:23.404356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:23.404356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:23.404356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:23.405728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:23.405728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:23.405728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:23.405728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:23.405728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:23.405728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:23.405728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:23.405728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:23.405728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:23.405728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:23.405728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:23.405728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:23.405728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:23.405728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:23.405728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:23.405728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:23.406575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:23.406575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:23.406575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:23.406575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:23.406575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:23.406575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:23.406575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:23.406575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:23.406575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:23.406575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:23.406575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:23.406575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:23.406575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:23.406575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:44:23.406575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:23.409224 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 386/753] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Jun 16 14:44:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:23.410204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731e37d-743b-438c-b614-5a1f13b58d5b None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.422577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64c99f-c775-4a1e-85dc-d63a7ac1541e None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:23.445384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:23.458997 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083afdd4-8196-40d6-8a5e-f34260974277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:23.460112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083afdd4-8196-40d6-8a5e-f34260974277 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.460112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083afdd4-8196-40d6-8a5e-f34260974277 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.460272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083afdd4-8196-40d6-8a5e-f34260974277 None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.461270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083afdd4-8196-40d6-8a5e-f34260974277 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:23.461379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083afdd4-8196-40d6-8a5e-f34260974277 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:23.462869 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083afdd4-8196-40d6-8a5e-f34260974277 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:23.464669 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:23.483310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 368/754] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 16 14:44:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:23.484885 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083afdd4-8196-40d6-8a5e-f34260974277 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.552189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731e37d-743b-438c-b614-5a1f13b58d5b None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:23.596075 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083afdd4-8196-40d6-8a5e-f34260974277 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:23.606957 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247f577-08ed-40c7-941b-b6fad339489a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:23.608603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247f577-08ed-40c7-941b-b6fad339489a None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.609856 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247f577-08ed-40c7-941b-b6fad339489a None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.610310 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247f577-08ed-40c7-941b-b6fad339489a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.623884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247f577-08ed-40c7-941b-b6fad339489a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:23.626524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247f577-08ed-40c7-941b-b6fad339489a None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:23.634862 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cba95e-223b-4237-a905-c404c3dc5bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:23.635634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cba95e-223b-4237-a905-c404c3dc5bdb None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.635999 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cba95e-223b-4237-a905-c404c3dc5bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.636351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cba95e-223b-4237-a905-c404c3dc5bdb None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.637572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cba95e-223b-4237-a905-c404c3dc5bdb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:23.637954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cba95e-223b-4237-a905-c404c3dc5bdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:23.639679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cba95e-223b-4237-a905-c404c3dc5bdb None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:23.647677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-2247f577-08ed-40c7-941b-b6fad339489a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:23.647677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:23.647677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:23.647677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:23.647677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:23.647677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:23.647677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:23.647677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:23.647677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:23.647677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:23.647677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:23.647677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:23.647677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:23.647677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:23.647677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:23.648903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:23.650159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:23.650159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:23.650159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:23.650159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:23.650407 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 369/755] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jun 16 14:44:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:23.650407 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cba95e-223b-4237-a905-c404c3dc5bdb None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.652134 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 387/756] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:23.653452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247f577-08ed-40c7-941b-b6fad339489a None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.723904 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:23.738848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:23.765552 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247f577-08ed-40c7-941b-b6fad339489a None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:23.779372 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cba95e-223b-4237-a905-c404c3dc5bdb None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:23.802906 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db2f4a-1317-4fe5-8efe-1b61ada5cbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:23.803990 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db2f4a-1317-4fe5-8efe-1b61ada5cbdb None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.804458 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db2f4a-1317-4fe5-8efe-1b61ada5cbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.804906 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db2f4a-1317-4fe5-8efe-1b61ada5cbdb None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.805989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db2f4a-1317-4fe5-8efe-1b61ada5cbdb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:23.806568 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db2f4a-1317-4fe5-8efe-1b61ada5cbdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:23.808152 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db2f4a-1317-4fe5-8efe-1b61ada5cbdb None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:23.814114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 388/757] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jun 16 14:44:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:23.815229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db2f4a-1317-4fe5-8efe-1b61ada5cbdb None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.828549 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e02e66-60a1-4007-af19-a0985d2351c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:23.829402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e02e66-60a1-4007-af19-a0985d2351c9 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:23.829688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e02e66-60a1-4007-af19-a0985d2351c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:23.829964 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e02e66-60a1-4007-af19-a0985d2351c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:23.840206 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e02e66-60a1-4007-af19-a0985d2351c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:23.841665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e02e66-60a1-4007-af19-a0985d2351c9 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:23.867835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-c7e02e66-60a1-4007-af19-a0985d2351c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:23.867835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:23.867835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:23.867835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:23.867835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:23.867835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:23.867835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:23.867835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:23.867835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:23.867835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:23.867835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:23.867835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:23.867835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:23.867835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:23.867835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:23.868822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:23.870418 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:23.870418 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:23.870418 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:23.870418 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:23.870652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 370/758] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:23.875810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e02e66-60a1-4007-af19-a0985d2351c9 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:23.982843 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db2f4a-1317-4fe5-8efe-1b61ada5cbdb None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:23.993062 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e02e66-60a1-4007-af19-a0985d2351c9 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:24.003876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:24.028089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ed618-7172-43ff-82ab-27dc7eb44ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:24.028826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ed618-7172-43ff-82ab-27dc7eb44ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.029161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ed618-7172-43ff-82ab-27dc7eb44ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.029466 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ed618-7172-43ff-82ab-27dc7eb44ab8 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.030252 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ed618-7172-43ff-82ab-27dc7eb44ab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:24.031359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ed618-7172-43ff-82ab-27dc7eb44ab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:24.032750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ed618-7172-43ff-82ab-27dc7eb44ab8 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:24.037736 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92672d-3337-47b7-80e2-f54840e9715b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:24.038648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92672d-3337-47b7-80e2-f54840e9715b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.039113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92672d-3337-47b7-80e2-f54840e9715b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.039569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92672d-3337-47b7-80e2-f54840e9715b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.040149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:24.041555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92672d-3337-47b7-80e2-f54840e9715b None admin] RBAC: Adding query filter params (interface=public, service_id=063620fc12e6436888651e26a07e756b, region_id=RegionOne) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:24.042080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92672d-3337-47b7-80e2-f54840e9715b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:24.044431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92672d-3337-47b7-80e2-f54840e9715b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:24.046210 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 389/759] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:24.047691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ed618-7172-43ff-82ab-27dc7eb44ab8 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:24.059150 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 371/760] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jun 16 14:44:23 2022] GET /identity/v3/endpoints?service_id=063620fc12e6436888651e26a07e756b&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:24.059150 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92672d-3337-47b7-80e2-f54840e9715b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:24.173923 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ed618-7172-43ff-82ab-27dc7eb44ab8 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:24.177761 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92672d-3337-47b7-80e2-f54840e9715b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:24.214475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ec6d3-0a21-476e-bf7e-5c260ab572ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:24.215395 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ec6d3-0a21-476e-bf7e-5c260ab572ef None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.215755 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ec6d3-0a21-476e-bf7e-5c260ab572ef None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.216109 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ec6d3-0a21-476e-bf7e-5c260ab572ef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.220060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721d9c1-8552-4066-a814-eac54d812056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:24.220959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721d9c1-8552-4066-a814-eac54d812056 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.221413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721d9c1-8552-4066-a814-eac54d812056 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.221852 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721d9c1-8552-4066-a814-eac54d812056 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.222717 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721d9c1-8552-4066-a814-eac54d812056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:24.223171 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721d9c1-8552-4066-a814-eac54d812056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:24.225062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721d9c1-8552-4066-a814-eac54d812056 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:24.225317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ec6d3-0a21-476e-bf7e-5c260ab572ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:24.227000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ec6d3-0a21-476e-bf7e-5c260ab572ef None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:24.242870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-486ec6d3-0a21-476e-bf7e-5c260ab572ef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:44:24.242870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:24.242870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:24.242870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:24.242870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:24.242870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:24.242870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:24.242870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:24.242870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:24.242870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:24.242870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:24.242870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:24.242870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:24.242870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:24.242870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:24.242870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:24.244022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:24.245202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:24.245202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:24.245202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:24.245202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:24.245202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:24.245202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:24.245202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:24.245202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:24.245202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:44:24.245202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:24.245910 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 390/761] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:24.246443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 372/762] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 16 14:44:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:24.247048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721d9c1-8552-4066-a814-eac54d812056 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:24.247455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ec6d3-0a21-476e-bf7e-5c260ab572ef None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:24.284506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:24.328661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:24.370295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ec6d3-0a21-476e-bf7e-5c260ab572ef None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:24.374507 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721d9c1-8552-4066-a814-eac54d812056 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:24.409538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89803bb3-28b5-47af-9310-c676ae2495fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:24.410644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89803bb3-28b5-47af-9310-c676ae2495fc None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.411130 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89803bb3-28b5-47af-9310-c676ae2495fc None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.411591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89803bb3-28b5-47af-9310-c676ae2495fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.412455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69836b0-0a96-4706-9f4c-81473fbd1b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:24.413318 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69836b0-0a96-4706-9f4c-81473fbd1b62 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.413681 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69836b0-0a96-4706-9f4c-81473fbd1b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.414039 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69836b0-0a96-4706-9f4c-81473fbd1b62 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.414999 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69836b0-0a96-4706-9f4c-81473fbd1b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:24.416589 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69836b0-0a96-4706-9f4c-81473fbd1b62 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:24.421365 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89803bb3-28b5-47af-9310-c676ae2495fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:24.422733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 391/763] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 16 14:44:24 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:24.423253 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89803bb3-28b5-47af-9310-c676ae2495fc None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:24.423669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69836b0-0a96-4706-9f4c-81473fbd1b62 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:24.444346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-89803bb3-28b5-47af-9310-c676ae2495fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:24.444346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:24.444346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:24.444346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:24.444346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:24.444346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:24.444346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:24.444346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:24.444346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:24.444346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:24.444346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:24.444346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:24.444346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:24.444346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:24.444346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:24.445350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:24.446252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:24.446252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:24.446252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:24.446252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:24.446252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:24.446252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:24.446252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:24.446252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:24.447408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 373/764] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:24.452588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89803bb3-28b5-47af-9310-c676ae2495fc None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:24.542977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69836b0-0a96-4706-9f4c-81473fbd1b62 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:24.569751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:24.583523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c1fe8-2bd3-46f1-b2bd-706550e5b48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:24.584194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c1fe8-2bd3-46f1-b2bd-706550e5b48a None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.584484 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c1fe8-2bd3-46f1-b2bd-706550e5b48a None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.584768 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c1fe8-2bd3-46f1-b2bd-706550e5b48a None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.585738 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c1fe8-2bd3-46f1-b2bd-706550e5b48a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:24.586061 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c1fe8-2bd3-46f1-b2bd-706550e5b48a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:24.587499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:24.588673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c1fe8-2bd3-46f1-b2bd-706550e5b48a None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:24.598147 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89803bb3-28b5-47af-9310-c676ae2495fc None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:24.612409 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 392/765] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jun 16 14:44:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:24.621382 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c1fe8-2bd3-46f1-b2bd-706550e5b48a None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:24.643802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e8579-ee53-4f08-b3b0-7c8a70ad85ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:24.644668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e8579-ee53-4f08-b3b0-7c8a70ad85ef None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.645061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e8579-ee53-4f08-b3b0-7c8a70ad85ef None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.645470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e8579-ee53-4f08-b3b0-7c8a70ad85ef None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.646703 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e8579-ee53-4f08-b3b0-7c8a70ad85ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:24.647123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e8579-ee53-4f08-b3b0-7c8a70ad85ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:24.649189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e8579-ee53-4f08-b3b0-7c8a70ad85ef None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:24.666647 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 374/766] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:24.678643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e8579-ee53-4f08-b3b0-7c8a70ad85ef None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:24.759538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c1fe8-2bd3-46f1-b2bd-706550e5b48a None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:24.804243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c7213-466a-4a79-804b-1a94d08d4ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:24.805214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c7213-466a-4a79-804b-1a94d08d4ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.805779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c7213-466a-4a79-804b-1a94d08d4ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.806221 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c7213-466a-4a79-804b-1a94d08d4ea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.813986 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e8579-ee53-4f08-b3b0-7c8a70ad85ef None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:24.856300 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb6106-fd6e-45c5-8365-482686c4d8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:24.858923 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb6106-fd6e-45c5-8365-482686c4d8d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.859256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb6106-fd6e-45c5-8365-482686c4d8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.859551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb6106-fd6e-45c5-8365-482686c4d8d4 None admin] PATH_INFO: `/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/60c2f1c63a674e3195c490ab5ad1318f/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.862406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb6106-fd6e-45c5-8365-482686c4d8d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9e5996685142bb94c83c5403fbf17d, user_id=60c2f1c63a674e3195c490ab5ad1318f, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:24.865688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb6106-fd6e-45c5-8365-482686c4d8d4 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:24.870324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:24.889640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c7213-466a-4a79-804b-1a94d08d4ea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:24.891683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c7213-466a-4a79-804b-1a94d08d4ea4 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:24.940020 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 375/767] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:44:24 2022] PUT /identity/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/60c2f1c63a674e3195c490ab5ad1318f/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:44:24.951455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba890e-fc42-4000-84fb-7aabf300925a None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.951778 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba890e-fc42-4000-84fb-7aabf300925a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.952045 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba890e-fc42-4000-84fb-7aabf300925a None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.955524 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 376/768] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:24 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:24.967095 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783c652-e25d-4d2f-8a3b-2372892139a3 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:24.967400 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783c652-e25d-4d2f-8a3b-2372892139a3 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:24.967667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783c652-e25d-4d2f-8a3b-2372892139a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:24.989451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-d783c652-e25d-4d2f-8a3b-2372892139a3 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:24.991530 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d783c652-e25d-4d2f-8a3b-2372892139a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:25.001709 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:25.091416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 393/769] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:44:25.092780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710b9c9-89a3-4dae-842b-c3743b826bf9 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:25.093076 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710b9c9-89a3-4dae-842b-c3743b826bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:25.093396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710b9c9-89a3-4dae-842b-c3743b826bf9 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:25.095639 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 394/770] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:25.096870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710b9c9-89a3-4dae-842b-c3743b826bf9 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:25.125362 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 377/771] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:25.128200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af970412-b369-494e-807a-74b48baa960f None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:25.128497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af970412-b369-494e-807a-74b48baa960f None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:25.128783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af970412-b369-494e-807a-74b48baa960f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:25.154043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-af970412-b369-494e-807a-74b48baa960f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:25.155255 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-af970412-b369-494e-807a-74b48baa960f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:25.213251 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:25.240190 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 378/772] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:25.240190 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af970412-b369-494e-807a-74b48baa960f None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:25.260312 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710b9c9-89a3-4dae-842b-c3743b826bf9 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:25.303208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99d9e7-eaf9-4d2a-b9db-9437bdf29eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:25.305095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99d9e7-eaf9-4d2a-b9db-9437bdf29eac None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:25.305746 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99d9e7-eaf9-4d2a-b9db-9437bdf29eac None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:25.306326 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99d9e7-eaf9-4d2a-b9db-9437bdf29eac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:25.320775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:25.322914 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99d9e7-eaf9-4d2a-b9db-9437bdf29eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:25.324635 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99d9e7-eaf9-4d2a-b9db-9437bdf29eac None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:25.350267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-9b99d9e7-eaf9-4d2a-b9db-9437bdf29eac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:25.350267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:25.350267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:25.350267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:25.350267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:25.350267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:25.350267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:25.350267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:25.350267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:25.350267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:25.350267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:25.350267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:25.350267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:25.350267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:25.350267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:25.351194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:25.352089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:25.352089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:25.352089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:25.352089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:25.352306 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af970412-b369-494e-807a-74b48baa960f None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:25.356129 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 395/773] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:25.357180 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99d9e7-eaf9-4d2a-b9db-9437bdf29eac None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:25.391574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbe743-9672-4441-a9f9-f110883009da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:25.392538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbe743-9672-4441-a9f9-f110883009da None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:25.393094 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbe743-9672-4441-a9f9-f110883009da None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:25.393505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbe743-9672-4441-a9f9-f110883009da None admin] PATH_INFO: `/v3/services/network` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:25.394614 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbe743-9672-4441-a9f9-f110883009da None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:25.396583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbe743-9672-4441-a9f9-f110883009da None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-74cbe743-9672-4441-a9f9-f110883009da None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:25.412776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:25.413988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:25.413988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:25.413988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:25.413988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:25.413988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:25.413988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:25.413988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:25.413988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:25.413988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:25.413988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:25.413988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:25.413988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:25.413988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:25.413988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:25.413988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:25.413988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:25.414841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:25.414841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:25.414841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:25.414841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:25.414841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:25.414841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:25.414841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:25.414841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:25.414841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:25.414841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:25.414841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:25.414841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:25.414841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:44:25.414841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:25.417216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 379/774] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:25 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:25.418351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbe743-9672-4441-a9f9-f110883009da None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:25.492536 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99d9e7-eaf9-4d2a-b9db-9437bdf29eac None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:25.522542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:25.527561 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72938f30-4f07-4188-a2dc-2ee3e02d9800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:25.528415 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72938f30-4f07-4188-a2dc-2ee3e02d9800 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:25.528704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72938f30-4f07-4188-a2dc-2ee3e02d9800 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:25.528977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72938f30-4f07-4188-a2dc-2ee3e02d9800 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:25.539957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbe743-9672-4441-a9f9-f110883009da None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:25.541249 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72938f30-4f07-4188-a2dc-2ee3e02d9800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:25.559237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-72938f30-4f07-4188-a2dc-2ee3e02d9800 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:25.559237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:25.559237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:25.559237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:25.559237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:25.559237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:25.559237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:25.559237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:25.559237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:25.559237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:25.559237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:25.559237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:25.559237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:25.559237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:25.559237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:25.559237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:25.560125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:25.560125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:25.560125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:25.560125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:25.560125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:25.560125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:25.560125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:25.560125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:25.560125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:25.560125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:25.560125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:25.560125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:25.560125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:25.560125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:25.560125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:25.560125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:25.560965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:25.560965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:25.560965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:25.560965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:25.560965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:25.560965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:25.560965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:25.560965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:25.560965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:25.560965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:25.560965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:25.560965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:25.560965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 396/775] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:25.560965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72938f30-4f07-4188-a2dc-2ee3e02d9800 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:25.583514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e171341-dd82-43e0-b1b4-0d37aa0eb777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:25.584536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e171341-dd82-43e0-b1b4-0d37aa0eb777 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:25.585054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e171341-dd82-43e0-b1b4-0d37aa0eb777 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:25.585552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e171341-dd82-43e0-b1b4-0d37aa0eb777 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:25.587062 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e171341-dd82-43e0-b1b4-0d37aa0eb777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:25.587856 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e171341-dd82-43e0-b1b4-0d37aa0eb777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:25.590171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e171341-dd82-43e0-b1b4-0d37aa0eb777 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:25.594590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:25.612201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 380/776] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:25.612201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e171341-dd82-43e0-b1b4-0d37aa0eb777 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:25.670733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72938f30-4f07-4188-a2dc-2ee3e02d9800 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:25.708479 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd58ccd-1620-4a57-834e-bc93c4447250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:25.709159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58ccd-1620-4a57-834e-bc93c4447250 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:25.709487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58ccd-1620-4a57-834e-bc93c4447250 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:25.709771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58ccd-1620-4a57-834e-bc93c4447250 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:25.710530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd58ccd-1620-4a57-834e-bc93c4447250 None admin] RBAC: Adding query filter params (name=network) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:25.710842 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd58ccd-1620-4a57-834e-bc93c4447250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:25.712226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd58ccd-1620-4a57-834e-bc93c4447250 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:25.722931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 397/777] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:25.723771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd58ccd-1620-4a57-834e-bc93c4447250 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:25.746569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e171341-dd82-43e0-b1b4-0d37aa0eb777 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:25.783439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:25.795412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab373222-ff10-4253-8381-7bb8ad877f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:25.796300 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab373222-ff10-4253-8381-7bb8ad877f1f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:25.802524 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab373222-ff10-4253-8381-7bb8ad877f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:25.802524 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab373222-ff10-4253-8381-7bb8ad877f1f None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:25.802524 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab373222-ff10-4253-8381-7bb8ad877f1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:25.802524 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab373222-ff10-4253-8381-7bb8ad877f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:25.802524 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab373222-ff10-4253-8381-7bb8ad877f1f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:25.813229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 381/778] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:25.814102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab373222-ff10-4253-8381-7bb8ad877f1f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:25.836861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd58ccd-1620-4a57-834e-bc93c4447250 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:25.873367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4c7b9-cdb1-4667-a25f-4fa96110e90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:25.874083 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4c7b9-cdb1-4667-a25f-4fa96110e90f None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:25.874424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4c7b9-cdb1-4667-a25f-4fa96110e90f None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:25.874701 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4c7b9-cdb1-4667-a25f-4fa96110e90f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:25.882249 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4c7b9-cdb1-4667-a25f-4fa96110e90f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:25.883957 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4c7b9-cdb1-4667-a25f-4fa96110e90f None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:25.893796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:25.899704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-93b4c7b9-cdb1-4667-a25f-4fa96110e90f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:25.899704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:25.899704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:25.899704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:25.899704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:25.899704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:25.899704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:25.899704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:25.899704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:25.899704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:25.899704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:25.899704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:25.899704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:25.899704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:25.899704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:25.900638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:25.901573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:25.901573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:25.901573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:25.901573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:25.901573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:25.901573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:25.901573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:25.901573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:25.909301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 398/779] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:25.910537 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4c7b9-cdb1-4667-a25f-4fa96110e90f None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:25.939690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab373222-ff10-4253-8381-7bb8ad877f1f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:25.976502 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3475e60-2176-498d-b674-9d1ec80fafc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:25.977199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3475e60-2176-498d-b674-9d1ec80fafc3 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:25.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3475e60-2176-498d-b674-9d1ec80fafc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:25.977798 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3475e60-2176-498d-b674-9d1ec80fafc3 None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:25.978509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3475e60-2176-498d-b674-9d1ec80fafc3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:25.978821 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3475e60-2176-498d-b674-9d1ec80fafc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:25.980196 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3475e60-2176-498d-b674-9d1ec80fafc3 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:25.985920 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 382/780] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:25.987094 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3475e60-2176-498d-b674-9d1ec80fafc3 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:26.018547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4c7b9-cdb1-4667-a25f-4fa96110e90f None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:26.036080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:26.054703 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd9b51-31c8-4c6f-bcd5-13c245ce7ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:26.055830 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd9b51-31c8-4c6f-bcd5-13c245ce7ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:26.056283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd9b51-31c8-4c6f-bcd5-13c245ce7ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:26.068681 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd9b51-31c8-4c6f-bcd5-13c245ce7ad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.068681 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd9b51-31c8-4c6f-bcd5-13c245ce7ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:26.069996 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd9b51-31c8-4c6f-bcd5-13c245ce7ad9 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:26.088826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-9fdd9b51-31c8-4c6f-bcd5-13c245ce7ad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:26.088826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:26.088826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:26.088826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:26.088826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:26.088826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:26.088826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:26.088826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:26.088826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:26.088826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:26.088826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:26.088826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:26.088826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:26.088826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:26.088826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:26.089881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:26.090950 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:26.090950 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:26.090950 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:26.090950 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:26.093100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 399/781] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:26.094647 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd9b51-31c8-4c6f-bcd5-13c245ce7ad9 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:26.103417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3475e60-2176-498d-b674-9d1ec80fafc3 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:26.131046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:26.143965 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f5e95-74ba-4ba0-9d81-d5265c1c1344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:26.144426 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f5e95-74ba-4ba0-9d81-d5265c1c1344 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:26.144426 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f5e95-74ba-4ba0-9d81-d5265c1c1344 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:26.144704 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f5e95-74ba-4ba0-9d81-d5265c1c1344 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.145521 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f5e95-74ba-4ba0-9d81-d5265c1c1344 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:26.145840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f5e95-74ba-4ba0-9d81-d5265c1c1344 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:26.147324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f5e95-74ba-4ba0-9d81-d5265c1c1344 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:26.166929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 383/782] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:26.166929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f5e95-74ba-4ba0-9d81-d5265c1c1344 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:26.219649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd9b51-31c8-4c6f-bcd5-13c245ce7ad9 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:26.256753 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f90782-1140-4e21-8e53-c049bfdf6da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:26.257868 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90782-1140-4e21-8e53-c049bfdf6da4 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:26.258362 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90782-1140-4e21-8e53-c049bfdf6da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:26.258843 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90782-1140-4e21-8e53-c049bfdf6da4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.259850 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f90782-1140-4e21-8e53-c049bfdf6da4 None admin] RBAC: Adding query filter params (interface=public, service_id=673d58e546c24db589f5956b3e39efa6, region_id=RegionOne) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:26.260376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f90782-1140-4e21-8e53-c049bfdf6da4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:26.262011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f90782-1140-4e21-8e53-c049bfdf6da4 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:26.271043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 400/783] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jun 16 14:44:26 2022] GET /identity/v3/endpoints?service_id=673d58e546c24db589f5956b3e39efa6&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:26.272171 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f90782-1140-4e21-8e53-c049bfdf6da4 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:26.274360 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f5e95-74ba-4ba0-9d81-d5265c1c1344 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:26.305220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:26.313272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd1625-c23b-49e5-b82b-b4366ad55d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:26.313947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd1625-c23b-49e5-b82b-b4366ad55d76 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:26.314234 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd1625-c23b-49e5-b82b-b4366ad55d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:26.314513 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd1625-c23b-49e5-b82b-b4366ad55d76 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.315237 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd1625-c23b-49e5-b82b-b4366ad55d76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:26.315544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd1625-c23b-49e5-b82b-b4366ad55d76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:26.316992 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd1625-c23b-49e5-b82b-b4366ad55d76 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:26.333548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 384/784] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:26.334488 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd1625-c23b-49e5-b82b-b4366ad55d76 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:26.380147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f90782-1140-4e21-8e53-c049bfdf6da4 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:26.383068 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:26.416391 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e49ad-020b-49c1-b75c-3e4efeaf4dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:26.417242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e49ad-020b-49c1-b75c-3e4efeaf4dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:26.417634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e49ad-020b-49c1-b75c-3e4efeaf4dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:26.418100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e49ad-020b-49c1-b75c-3e4efeaf4dc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.419050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e49ad-020b-49c1-b75c-3e4efeaf4dc7 None admin] RBAC: Adding query filter params (role.id=037df45eceeb4cb7aec314c290fa7820, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=c1e11e5614c64b87a892740f39e8fc5b) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:26.419463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e49ad-020b-49c1-b75c-3e4efeaf4dc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:26.420997 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e49ad-020b-49c1-b75c-3e4efeaf4dc7 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:26.434197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 401/785] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:26 2022] GET /identity/v3/role_assignments?user.id=c1e11e5614c64b87a892740f39e8fc5b&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=037df45eceeb4cb7aec314c290fa7820 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:26.435353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e49ad-020b-49c1-b75c-3e4efeaf4dc7 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:26.448735 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd1625-c23b-49e5-b82b-b4366ad55d76 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:26.487120 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6629d0-ba13-4671-92d2-2c8121858048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:26.488156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6629d0-ba13-4671-92d2-2c8121858048 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:26.488585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6629d0-ba13-4671-92d2-2c8121858048 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:26.489003 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6629d0-ba13-4671-92d2-2c8121858048 None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.489928 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6629d0-ba13-4671-92d2-2c8121858048 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:26.491697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6629d0-ba13-4671-92d2-2c8121858048 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:26.498065 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 385/786] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 16 14:44:26 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:26.608401 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:26.618930 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e49ad-020b-49c1-b75c-3e4efeaf4dc7 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:26.663312 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383885b-d81b-4266-91e9-d276aa86e44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:26.664116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383885b-d81b-4266-91e9-d276aa86e44c None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:26.664405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383885b-d81b-4266-91e9-d276aa86e44c None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:26.664684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383885b-d81b-4266-91e9-d276aa86e44c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.674166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383885b-d81b-4266-91e9-d276aa86e44c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:26.675774 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383885b-d81b-4266-91e9-d276aa86e44c None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:26.692185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-8383885b-d81b-4266-91e9-d276aa86e44c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:44:26.692185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:26.692185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:26.692185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:26.692185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:26.692185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:26.692185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:26.692185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:26.692185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:26.692185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:26.692185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:26.692185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:26.692185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:26.692185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:26.692185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:26.692185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:26.693232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:26.694205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:26.694205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:26.694205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:26.694205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:26.694205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:26.694205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:26.694205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:26.694205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:26.694205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:44:26.694205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:26.694205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 402/787] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:26.701047 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6629d0-ba13-4671-92d2-2c8121858048 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:26.847593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6629d0-ba13-4671-92d2-2c8121858048 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:26.855589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:26.884035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1309ef-c699-4f23-9756-8792be7f4d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:26.885019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1309ef-c699-4f23-9756-8792be7f4d8b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:26.885505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1309ef-c699-4f23-9756-8792be7f4d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:26.885982 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1309ef-c699-4f23-9756-8792be7f4d8b None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:26.886995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1309ef-c699-4f23-9756-8792be7f4d8b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:26.887519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1309ef-c699-4f23-9756-8792be7f4d8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:26.889191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1309ef-c699-4f23-9756-8792be7f4d8b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:26.915061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 386/788] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jun 16 14:44:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:26.921020 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383885b-d81b-4266-91e9-d276aa86e44c None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:27.010692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb3a49-1164-4114-a57e-5e6c58087c82 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.011007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb3a49-1164-4114-a57e-5e6c58087c82 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.011292 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb3a49-1164-4114-a57e-5e6c58087c82 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.012748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 387/789] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:27.020208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fe3cf-605d-4565-b36d-a6cd3c50da30 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.021314 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fe3cf-605d-4565-b36d-a6cd3c50da30 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.021314 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fe3cf-605d-4565-b36d-a6cd3c50da30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.052888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-7c7fe3cf-605d-4565-b36d-a6cd3c50da30 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:27.054117 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-7c7fe3cf-605d-4565-b36d-a6cd3c50da30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:27.071910 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383885b-d81b-4266-91e9-d276aa86e44c None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:27.123051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2232c15-32ef-4ad2-b581-8081a75d175d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:27.129768 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2232c15-32ef-4ad2-b581-8081a75d175d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.130256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2232c15-32ef-4ad2-b581-8081a75d175d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.130724 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2232c15-32ef-4ad2-b581-8081a75d175d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.152098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2232c15-32ef-4ad2-b581-8081a75d175d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:27.154753 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2232c15-32ef-4ad2-b581-8081a75d175d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:27.183882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-e2232c15-32ef-4ad2-b581-8081a75d175d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:27.183882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:27.183882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:27.183882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:27.183882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:27.183882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:27.183882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:27.183882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:27.183882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:27.183882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:27.183882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:27.183882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:27.183882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:27.183882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:27.183882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:27.184815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:27.185727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:27.185727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:27.185727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:27.185727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:27.185727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 403/790] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:27.192468 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 388/791] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:27.193201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2232c15-32ef-4ad2-b581-8081a75d175d None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:27.215228 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fe3cf-605d-4565-b36d-a6cd3c50da30 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:27.229532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:27.376458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:27.384032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2232c15-32ef-4ad2-b581-8081a75d175d None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:27.384210 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fe3cf-605d-4565-b36d-a6cd3c50da30 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:27.433407 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8070830-a96d-4e25-b574-687cae45d340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:27.434133 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8070830-a96d-4e25-b574-687cae45d340 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.434363 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8070830-a96d-4e25-b574-687cae45d340 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.434637 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8070830-a96d-4e25-b574-687cae45d340 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.435358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8070830-a96d-4e25-b574-687cae45d340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:27.435662 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8070830-a96d-4e25-b574-687cae45d340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:27.437269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8070830-a96d-4e25-b574-687cae45d340 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:27.438573 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c6064-85f7-41f9-bda7-e696037dafab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:27.439952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c6064-85f7-41f9-bda7-e696037dafab None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.440980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c6064-85f7-41f9-bda7-e696037dafab None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.441486 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c6064-85f7-41f9-bda7-e696037dafab None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.442361 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c6064-85f7-41f9-bda7-e696037dafab None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:27.444045 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c6064-85f7-41f9-bda7-e696037dafab None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:27.456081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 404/792] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:27.456081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd449b4-52f6-4b91-93e4-5c20fd59aa1b None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.456081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd449b4-52f6-4b91-93e4-5c20fd59aa1b None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.456081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd449b4-52f6-4b91-93e4-5c20fd59aa1b None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.456081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 405/793] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:27.457299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd449b4-52f6-4b91-93e4-5c20fd59aa1b None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:27.466275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-6d0c6064-85f7-41f9-bda7-e696037dafab None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:44:27.466275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:27.466275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:27.466275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:27.466275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:27.466275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:27.466275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:27.466275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:27.466275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:44:27.466275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:27.466275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:27.466275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:27.466275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:27.466275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:27.466275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:27.466275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:27.467313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:27.467313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:27.467313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:27.467313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:27.467313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:27.467313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:27.467313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:27.467313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:27.467313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:27.467313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:27.467313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:27.467313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:27.467313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:27.467313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:27.467313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:27.467313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:27.468156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:27.468156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:27.468156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:27.468156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:27.468156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:27.468156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:27.468156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:27.468156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:27.468156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:27.468156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:27.468156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:27.468156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:27.468156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:27.468156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 14:44:27.468156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:27.471831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 389/794] 10.222.0.23 () {56 vars in 1129 bytes} [Thu Jun 16 14:44:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:27.473829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2510-1cdd-41aa-907a-031bdc9f7235 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.474710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2510-1cdd-41aa-907a-031bdc9f7235 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.475352 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2510-1cdd-41aa-907a-031bdc9f7235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.498240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-80af2510-1cdd-41aa-907a-031bdc9f7235 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:27.501444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-80af2510-1cdd-41aa-907a-031bdc9f7235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:27.535256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:27.571056 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd449b4-52f6-4b91-93e4-5c20fd59aa1b None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:27.582317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 390/795] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:27.583463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af2510-1cdd-41aa-907a-031bdc9f7235 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:27.630565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050eb0c-c8b2-4c38-a1b8-cd281a0da0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:27.631491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050eb0c-c8b2-4c38-a1b8-cd281a0da0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.631856 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050eb0c-c8b2-4c38-a1b8-cd281a0da0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.632128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050eb0c-c8b2-4c38-a1b8-cd281a0da0b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.640197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050eb0c-c8b2-4c38-a1b8-cd281a0da0b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:27.642338 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050eb0c-c8b2-4c38-a1b8-cd281a0da0b5 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:27.656823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-e050eb0c-c8b2-4c38-a1b8-cd281a0da0b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:27.656823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:27.656823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:27.656823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:27.656823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:27.656823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:27.656823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:27.656823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:27.656823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:27.656823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:27.656823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:27.656823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:27.656823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:27.656823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:27.656823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:27.657727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:27.658624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:27.658624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:27.658624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:27.658624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:27.658624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:27.658624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:27.658624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:27.658624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:27.662705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 406/796] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:27.663538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050eb0c-c8b2-4c38-a1b8-cd281a0da0b5 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:27.681638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:27.699837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af2510-1cdd-41aa-907a-031bdc9f7235 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:27.735347 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceeca34-3170-40dc-b13a-10f681598bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:27.736504 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeca34-3170-40dc-b13a-10f681598bcd None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.737001 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeca34-3170-40dc-b13a-10f681598bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.737511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeca34-3170-40dc-b13a-10f681598bcd None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.738455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceeca34-3170-40dc-b13a-10f681598bcd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:27.738984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceeca34-3170-40dc-b13a-10f681598bcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:27.740642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceeca34-3170-40dc-b13a-10f681598bcd None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:27.746805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 391/797] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jun 16 14:44:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:27.748030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceeca34-3170-40dc-b13a-10f681598bcd None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:27.769450 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050eb0c-c8b2-4c38-a1b8-cd281a0da0b5 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:27.799624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:27.807521 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c314b2-33c4-4fd7-9294-c645276b9db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:27.808771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c314b2-33c4-4fd7-9294-c645276b9db1 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.809276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c314b2-33c4-4fd7-9294-c645276b9db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.809741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c314b2-33c4-4fd7-9294-c645276b9db1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.823098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c314b2-33c4-4fd7-9294-c645276b9db1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:27.831128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-47c314b2-33c4-4fd7-9294-c645276b9db1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:27.831128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:27.831128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:27.831128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:27.831128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:27.831128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:27.831128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:27.831128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:27.831128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:27.831128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:27.831128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:27.831128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:27.831128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:27.831128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:27.831128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:27.831128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:27.832054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:27.832054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:27.832054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:27.832054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:27.832054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:27.832054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:27.832054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:27.832054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:27.832054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:27.832054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:27.832054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:27.832054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:27.832054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:27.832054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:27.832054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:27.832054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:27.832889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:27.832889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:27.832889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:27.832889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:27.832889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:27.832889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:27.832889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:27.832889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:27.832889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:27.832889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:27.832889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:27.832889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:27.837336 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 407/798] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:27.838599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c314b2-33c4-4fd7-9294-c645276b9db1 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:27.869891 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceeca34-3170-40dc-b13a-10f681598bcd None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:27.908639 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c155410-dcce-4f22-9fda-a5e0b178c76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:27.909726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c155410-dcce-4f22-9fda-a5e0b178c76b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:27.910221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c155410-dcce-4f22-9fda-a5e0b178c76b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:27.910703 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c155410-dcce-4f22-9fda-a5e0b178c76b None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:27.911788 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c155410-dcce-4f22-9fda-a5e0b178c76b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:27.912374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c155410-dcce-4f22-9fda-a5e0b178c76b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:27.914059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c155410-dcce-4f22-9fda-a5e0b178c76b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:27.927898 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 392/799] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:27.929037 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c155410-dcce-4f22-9fda-a5e0b178c76b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:27.945779 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:27.952744 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c314b2-33c4-4fd7-9294-c645276b9db1 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:27.999724 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906428d6-85a8-4370-97f2-8162aa5796fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:28.000998 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906428d6-85a8-4370-97f2-8162aa5796fd None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:28.001328 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906428d6-85a8-4370-97f2-8162aa5796fd None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:28.001613 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906428d6-85a8-4370-97f2-8162aa5796fd None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:28.002318 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906428d6-85a8-4370-97f2-8162aa5796fd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:28.002627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906428d6-85a8-4370-97f2-8162aa5796fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:28.003989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906428d6-85a8-4370-97f2-8162aa5796fd None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:28.009469 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 408/800] 10.222.0.23 () {56 vars in 1124 bytes} [Thu Jun 16 14:44:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:28.010418 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906428d6-85a8-4370-97f2-8162aa5796fd None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:28.045588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c155410-dcce-4f22-9fda-a5e0b178c76b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:28.070494 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:28.096649 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f27d4a-80a6-43d3-af34-3c289b0d3091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:28.098720 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f27d4a-80a6-43d3-af34-3c289b0d3091 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:28.100058 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f27d4a-80a6-43d3-af34-3c289b0d3091 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:28.101155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f27d4a-80a6-43d3-af34-3c289b0d3091 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:28.102212 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f27d4a-80a6-43d3-af34-3c289b0d3091 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:28.102728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f27d4a-80a6-43d3-af34-3c289b0d3091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:28.104409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f27d4a-80a6-43d3-af34-3c289b0d3091 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:28.116999 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 393/801] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:28.118087 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f27d4a-80a6-43d3-af34-3c289b0d3091 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:28.123329 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906428d6-85a8-4370-97f2-8162aa5796fd None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:28.161745 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9ad04-c8fa-4a86-8e4a-8e62836a5b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:28.162645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9ad04-c8fa-4a86-8e4a-8e62836a5b4c None admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:28.162931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9ad04-c8fa-4a86-8e4a-8e62836a5b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:28.163276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9ad04-c8fa-4a86-8e4a-8e62836a5b4c None admin] PATH_INFO: `/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/a952ee6a39e1453b80a8a8b787d0fdf5/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:28.165360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9ad04-c8fa-4a86-8e4a-8e62836a5b4c None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9e5996685142bb94c83c5403fbf17d, user_id=a952ee6a39e1453b80a8a8b787d0fdf5, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:28.166885 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9ad04-c8fa-4a86-8e4a-8e62836a5b4c None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:28.211028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:28.236565 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f27d4a-80a6-43d3-af34-3c289b0d3091 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:28.249864 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 409/802] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:44:28 2022] PUT /identity/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/a952ee6a39e1453b80a8a8b787d0fdf5/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:44:28.251236 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9ad04-c8fa-4a86-8e4a-8e62836a5b4c None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:28.312841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a536c97-76b1-4647-9f5b-720c0ed61d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:28.313559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536c97-76b1-4647-9f5b-720c0ed61d02 None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:28.313850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536c97-76b1-4647-9f5b-720c0ed61d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:28.314140 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536c97-76b1-4647-9f5b-720c0ed61d02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:28.315179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a536c97-76b1-4647-9f5b-720c0ed61d02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:28.316579 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a536c97-76b1-4647-9f5b-720c0ed61d02 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:28.424982 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 394/803] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 16 14:44:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:28.431373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9ad04-c8fa-4a86-8e4a-8e62836a5b4c None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:28.459478 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:28.499278 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068d2d9-0e6a-4495-8886-1622f0292bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:28.500679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068d2d9-0e6a-4495-8886-1622f0292bca None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:28.500992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068d2d9-0e6a-4495-8886-1622f0292bca None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:28.501309 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068d2d9-0e6a-4495-8886-1622f0292bca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:28.514606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068d2d9-0e6a-4495-8886-1622f0292bca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:28.516331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068d2d9-0e6a-4495-8886-1622f0292bca None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:28.537922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-b068d2d9-0e6a-4495-8886-1622f0292bca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:28.537922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:28.537922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:28.537922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:28.537922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:28.537922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:28.537922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:28.537922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:28.537922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:28.537922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:28.537922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:28.537922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:28.537922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:28.537922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:28.537922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:28.538870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:28.540031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:28.540031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:28.540031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:28.540031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:28.540031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 410/804] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:28.546450 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a536c97-76b1-4647-9f5b-720c0ed61d02 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:28.665030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a536c97-76b1-4647-9f5b-720c0ed61d02 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:28.696048 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:28.702561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b575afd-0485-43d8-9edc-09bdadb0836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:28.703770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b575afd-0485-43d8-9edc-09bdadb0836b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:28.704064 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b575afd-0485-43d8-9edc-09bdadb0836b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:28.704350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b575afd-0485-43d8-9edc-09bdadb0836b None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:28.705087 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b575afd-0485-43d8-9edc-09bdadb0836b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:28.705435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b575afd-0485-43d8-9edc-09bdadb0836b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:28.706911 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b575afd-0485-43d8-9edc-09bdadb0836b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:28.720464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 395/805] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:28.725305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068d2d9-0e6a-4495-8886-1622f0292bca None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:28.847025 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a3742-a05b-440b-b55b-d2ea19916986 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:28.847330 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a3742-a05b-440b-b55b-d2ea19916986 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:28.847529 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a3742-a05b-440b-b55b-d2ea19916986 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:28.847720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068d2d9-0e6a-4495-8886-1622f0292bca None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:28.849116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 396/806] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:28.854915 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a48b9-08fa-467a-8ce0-265ce671aec6 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:28.855200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a48b9-08fa-467a-8ce0-265ce671aec6 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:28.855482 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a48b9-08fa-467a-8ce0-265ce671aec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:28.873913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-479a48b9-08fa-467a-8ce0-265ce671aec6 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:28.875366 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-479a48b9-08fa-467a-8ce0-265ce671aec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:28.891690 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981838be-4417-42b5-8b9b-cb9d8cabd2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:28.893021 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981838be-4417-42b5-8b9b-cb9d8cabd2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:28.893551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981838be-4417-42b5-8b9b-cb9d8cabd2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:28.894414 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981838be-4417-42b5-8b9b-cb9d8cabd2b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:28.905078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981838be-4417-42b5-8b9b-cb9d8cabd2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:28.908149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981838be-4417-42b5-8b9b-cb9d8cabd2b7 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:28.925087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-981838be-4417-42b5-8b9b-cb9d8cabd2b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:28.925087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:28.925087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:28.925087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:28.925087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:28.925087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:28.925087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:28.925087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:28.925087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:28.925087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:28.925087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:28.925087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:28.925087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:28.925087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:28.925087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:28.925087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:28.926354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:28.927286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:28.927286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:28.927286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:28.927286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:28.927286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:28.927286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:28.927286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:28.927286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:28.927286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:28.927286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:28.928567 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 411/807] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 16 14:44:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:28.932922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981838be-4417-42b5-8b9b-cb9d8cabd2b7 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:28.959729 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 397/808] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:28.961497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:28.986055 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a48b9-08fa-467a-8ce0-265ce671aec6 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:29.072439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981838be-4417-42b5-8b9b-cb9d8cabd2b7 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:29.107425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffdb66-e6af-4876-991e-037fa570ff83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:29.107997 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffdb66-e6af-4876-991e-037fa570ff83 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:29.108286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffdb66-e6af-4876-991e-037fa570ff83 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:29.108562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffdb66-e6af-4876-991e-037fa570ff83 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:29.109431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffdb66-e6af-4876-991e-037fa570ff83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:29.109771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffdb66-e6af-4876-991e-037fa570ff83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:29.111204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffdb66-e6af-4876-991e-037fa570ff83 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:29.128567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a48b9-08fa-467a-8ce0-265ce671aec6 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:29.133890 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 412/809] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 16 14:44:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:29.135312 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58882357-22f4-4cdb-8502-84094a7cca36 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:29.135603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58882357-22f4-4cdb-8502-84094a7cca36 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:29.135879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58882357-22f4-4cdb-8502-84094a7cca36 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:29.141843 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 413/810] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:29.141843 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58882357-22f4-4cdb-8502-84094a7cca36 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:29.157099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:29.172556 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773048d-356e-458a-9740-328c458e7d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:29.173804 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773048d-356e-458a-9740-328c458e7d4c None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:29.174345 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773048d-356e-458a-9740-328c458e7d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:29.174828 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773048d-356e-458a-9740-328c458e7d4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:29.185987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773048d-356e-458a-9740-328c458e7d4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:29.197239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-4773048d-356e-458a-9740-328c458e7d4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:29.197239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:29.197239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:29.197239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:29.197239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:29.197239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:29.197239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:29.197239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:29.197239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:29.197239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:29.197239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:29.197239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:29.197239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:29.197239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:29.197239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:29.197239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:29.198194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:29.198194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:29.198194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:29.198194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:29.198194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:29.198194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:29.198194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:29.198194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:29.198194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:29.198194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:29.198194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:29.198194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:29.198194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:29.198194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:29.198194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:29.198194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:29.199043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:29.199043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:29.199043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:29.199043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:29.199043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:29.199043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:29.199043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:29.199043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:29.199043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:29.199043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:29.199043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:29.199043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:29.203188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 398/811] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:29.205241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdf0f9-9d52-44a5-bac0-720d40c97ae1 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:29.205751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdf0f9-9d52-44a5-bac0-720d40c97ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:29.206299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdf0f9-9d52-44a5-bac0-720d40c97ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:29.224122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:29.225918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-dbcdf0f9-9d52-44a5-bac0-720d40c97ae1 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:29.227348 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-dbcdf0f9-9d52-44a5-bac0-720d40c97ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:29.246422 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58882357-22f4-4cdb-8502-84094a7cca36 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:29.285214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58a79c-7dc7-401c-a05a-48c933b4b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:29.286150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58a79c-7dc7-401c-a05a-48c933b4b8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:29.286609 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58a79c-7dc7-401c-a05a-48c933b4b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:29.287035 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58a79c-7dc7-401c-a05a-48c933b4b8e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:29.312057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 399/812] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:29.313578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdf0f9-9d52-44a5-bac0-720d40c97ae1 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:29.361197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58a79c-7dc7-401c-a05a-48c933b4b8e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:29.362981 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58a79c-7dc7-401c-a05a-48c933b4b8e3 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:29.434417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdf0f9-9d52-44a5-bac0-720d40c97ae1 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:29.448109 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:29.465190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:29.472303 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ae8c5-d6d8-40ba-b815-9e27c1308d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:29.473295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ae8c5-d6d8-40ba-b815-9e27c1308d36 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:29.473789 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ae8c5-d6d8-40ba-b815-9e27c1308d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:29.474270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ae8c5-d6d8-40ba-b815-9e27c1308d36 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:29.475259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ae8c5-d6d8-40ba-b815-9e27c1308d36 None admin] RBAC: Adding query filter params (name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:29.475787 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ae8c5-d6d8-40ba-b815-9e27c1308d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:29.477462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ae8c5-d6d8-40ba-b815-9e27c1308d36 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:29.486840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 400/813] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:29.488193 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ae8c5-d6d8-40ba-b815-9e27c1308d36 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:29.491426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 414/814] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:44:29.493250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58a79c-7dc7-401c-a05a-48c933b4b8e3 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:29.603472 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ae8c5-d6d8-40ba-b815-9e27c1308d36 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:29.610247 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58a79c-7dc7-401c-a05a-48c933b4b8e3 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:29.639108 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec1f85-31ad-4038-9c7d-d58fc86b88bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:29.639818 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1f85-31ad-4038-9c7d-d58fc86b88bc None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:29.640178 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1f85-31ad-4038-9c7d-d58fc86b88bc None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:29.640455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec1f85-31ad-4038-9c7d-d58fc86b88bc None admin] PATH_INFO: `/v3/services/network` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:29.641225 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec1f85-31ad-4038-9c7d-d58fc86b88bc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:29.642586 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec1f85-31ad-4038-9c7d-d58fc86b88bc None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:29.649320 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc869d2-819b-442e-8ab0-63f20960f0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:29.650368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc869d2-819b-442e-8ab0-63f20960f0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:29.650854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc869d2-819b-442e-8ab0-63f20960f0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:29.651343 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc869d2-819b-442e-8ab0-63f20960f0c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-8aec1f85-31ad-4038-9c7d-d58fc86b88bc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:29.654464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:29.655444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:29.655444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:29.655444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:29.655444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:29.655444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:29.655444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:29.655444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:29.655444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:29.655444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:29.655444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:29.655444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:29.655444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:29.655444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:29.655444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:29.655444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:29.655444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:29.657165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:29.657165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:29.657165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:29.657165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:29.657165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:29.657165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:29.657165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:29.657165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:29.657165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:29.657165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:29.657165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:29.657165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:29.657165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 14:44:29.657165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:29.657165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 401/815] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:29 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:29.657989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec1f85-31ad-4038-9c7d-d58fc86b88bc None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:29.666233 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc869d2-819b-442e-8ab0-63f20960f0c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:29.667994 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc869d2-819b-442e-8ab0-63f20960f0c7 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:29.687096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-ffc869d2-819b-442e-8ab0-63f20960f0c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:29.687096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:29.687096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:29.687096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:29.687096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:29.687096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:29.687096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:29.687096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:29.687096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:29.687096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:29.687096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:29.687096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:29.687096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:29.687096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:29.687096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:29.688732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:29.689725 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:29.689725 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:29.689725 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:29.689725 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:29.692260 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 415/816] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:29.693540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc869d2-819b-442e-8ab0-63f20960f0c7 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:29.696004 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:29.727460 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:29.768619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec1f85-31ad-4038-9c7d-d58fc86b88bc None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:29.801870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc869d2-819b-442e-8ab0-63f20960f0c7 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:29.811626 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c725edc-310c-4258-b933-3a37e4d4d3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:29.813302 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c725edc-310c-4258-b933-3a37e4d4d3ea None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:29.813592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c725edc-310c-4258-b933-3a37e4d4d3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:29.813870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c725edc-310c-4258-b933-3a37e4d4d3ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:29.827486 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c725edc-310c-4258-b933-3a37e4d4d3ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:29.828977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c725edc-310c-4258-b933-3a37e4d4d3ea None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:29.841835 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8742b0-d636-4cb8-9518-7a20be202ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:29.842780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8742b0-d636-4cb8-9518-7a20be202ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:29.843246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8742b0-d636-4cb8-9518-7a20be202ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:29.843701 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8742b0-d636-4cb8-9518-7a20be202ad9 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:29.845163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8742b0-d636-4cb8-9518-7a20be202ad9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:29.845671 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8742b0-d636-4cb8-9518-7a20be202ad9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:29.847297 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8742b0-d636-4cb8-9518-7a20be202ad9 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:29.847978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-4c725edc-310c-4258-b933-3a37e4d4d3ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:29.847978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:29.847978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:29.847978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:29.847978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:29.847978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:29.847978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:29.847978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:29.847978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:29.847978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:29.847978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:29.847978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:29.847978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:29.847978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:29.847978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:29.848847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:29.849952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:29.849952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:29.849952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:29.849952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:29.849952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 402/817] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:29.850348 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c725edc-310c-4258-b933-3a37e4d4d3ea None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:29.855498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 416/818] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:29.856745 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8742b0-d636-4cb8-9518-7a20be202ad9 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:29.950008 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:29.956010 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:29.964571 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c725edc-310c-4258-b933-3a37e4d4d3ea None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:29.968596 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8742b0-d636-4cb8-9518-7a20be202ad9 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:30.002031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b39d85-ef72-4fe6-8a39-4da57b2b20bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:30.003024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b39d85-ef72-4fe6-8a39-4da57b2b20bc None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:30.007656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b39d85-ef72-4fe6-8a39-4da57b2b20bc None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:30.007656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b39d85-ef72-4fe6-8a39-4da57b2b20bc None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:30.007656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b39d85-ef72-4fe6-8a39-4da57b2b20bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:30.007656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b39d85-ef72-4fe6-8a39-4da57b2b20bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:30.007656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b39d85-ef72-4fe6-8a39-4da57b2b20bc None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:30.011187 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad04853-6334-4ed1-a058-161e8a79e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:30.011993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad04853-6334-4ed1-a058-161e8a79e6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:30.012367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad04853-6334-4ed1-a058-161e8a79e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:30.012722 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad04853-6334-4ed1-a058-161e8a79e6b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:30.013599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad04853-6334-4ed1-a058-161e8a79e6b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:30.013982 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad04853-6334-4ed1-a058-161e8a79e6b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:30.015488 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad04853-6334-4ed1-a058-161e8a79e6b2 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:30.028681 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 417/819] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:30.029754 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad04853-6334-4ed1-a058-161e8a79e6b2 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:30.144869 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 403/820] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:30.146037 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b39d85-ef72-4fe6-8a39-4da57b2b20bc None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:30.150764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad04853-6334-4ed1-a058-161e8a79e6b2 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:30.189864 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05610d-ba25-4177-bb20-f5794968c8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:30.190752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05610d-ba25-4177-bb20-f5794968c8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:30.191181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05610d-ba25-4177-bb20-f5794968c8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:30.191598 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05610d-ba25-4177-bb20-f5794968c8d7 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:30.192675 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05610d-ba25-4177-bb20-f5794968c8d7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:30.193251 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05610d-ba25-4177-bb20-f5794968c8d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:30.195418 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05610d-ba25-4177-bb20-f5794968c8d7 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:30.209560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 418/821] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:30.210972 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05610d-ba25-4177-bb20-f5794968c8d7 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:30.235559 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:30.261827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b39d85-ef72-4fe6-8a39-4da57b2b20bc None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:30.307306 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30df2ef-65f3-490e-9072-9d7f8af53bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:30.308522 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30df2ef-65f3-490e-9072-9d7f8af53bbd None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:30.309092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30df2ef-65f3-490e-9072-9d7f8af53bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:30.309567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30df2ef-65f3-490e-9072-9d7f8af53bbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:30.317214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30df2ef-65f3-490e-9072-9d7f8af53bbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:30.318991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30df2ef-65f3-490e-9072-9d7f8af53bbd None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:30.334544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-d30df2ef-65f3-490e-9072-9d7f8af53bbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:30.334544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:30.334544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:30.334544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:30.334544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:30.334544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:30.334544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:30.334544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:30.334544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:30.334544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:30.334544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:30.334544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:30.334544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:30.334544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:30.334544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:30.335446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:30.336329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:30.336329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:30.336329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:30.336329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:30.336329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:30.336329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:30.336329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:30.336329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:30.338961 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 404/822] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:30.339925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30df2ef-65f3-490e-9072-9d7f8af53bbd None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:30.340428 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05610d-ba25-4177-bb20-f5794968c8d7 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:30.352673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:30.376475 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29449687-1386-4553-9bdc-820f255d956a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:30.377328 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29449687-1386-4553-9bdc-820f255d956a None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:30.377679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29449687-1386-4553-9bdc-820f255d956a None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:30.378059 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29449687-1386-4553-9bdc-820f255d956a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:30.386920 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29449687-1386-4553-9bdc-820f255d956a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:30.388518 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29449687-1386-4553-9bdc-820f255d956a None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:30.404239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-29449687-1386-4553-9bdc-820f255d956a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:44:30.404239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:30.404239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:30.404239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:30.404239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:30.404239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:30.404239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:30.404239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:30.404239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:30.404239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:30.404239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:30.404239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:30.404239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:30.404239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:30.404239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:30.404239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:30.405266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:30.406468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:30.406468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:30.406468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:30.406468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:30.406468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:30.406468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:30.406468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:30.406468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:30.406468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:44:30.406468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:30.406468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 419/823] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 16 14:44:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:30.407713 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29449687-1386-4553-9bdc-820f255d956a None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:30.456075 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30df2ef-65f3-490e-9072-9d7f8af53bbd None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:30.490588 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:30.494624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0601d-a6cb-4082-8038-c7c7c1dc37d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:30.495529 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0601d-a6cb-4082-8038-c7c7c1dc37d0 None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:30.495993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0601d-a6cb-4082-8038-c7c7c1dc37d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:30.496478 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0601d-a6cb-4082-8038-c7c7c1dc37d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:30.497484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0601d-a6cb-4082-8038-c7c7c1dc37d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:30.499062 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0601d-a6cb-4082-8038-c7c7c1dc37d0 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:30.513276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29449687-1386-4553-9bdc-820f255d956a None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:30.549016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a269b90-0996-4a65-9aed-56afdf834cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:30.552240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a269b90-0996-4a65-9aed-56afdf834cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:30.552368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a269b90-0996-4a65-9aed-56afdf834cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:30.552584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a269b90-0996-4a65-9aed-56afdf834cb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:30.561247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 405/824] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 16 14:44:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:30.561247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0601d-a6cb-4082-8038-c7c7c1dc37d0 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:30.561474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a269b90-0996-4a65-9aed-56afdf834cb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:30.561474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a269b90-0996-4a65-9aed-56afdf834cb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:30.561474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a269b90-0996-4a65-9aed-56afdf834cb8 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:30.589851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 420/825] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:30.596322 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a269b90-0996-4a65-9aed-56afdf834cb8 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:30.686814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:30.776588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0601d-a6cb-4082-8038-c7c7c1dc37d0 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:30.800493 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a269b90-0996-4a65-9aed-56afdf834cb8 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:30.829887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ef73e-8e7e-4439-8dfa-c8123242a493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:30.830726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ef73e-8e7e-4439-8dfa-c8123242a493 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:30.831015 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ef73e-8e7e-4439-8dfa-c8123242a493 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:30.831639 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ef73e-8e7e-4439-8dfa-c8123242a493 None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:30.832493 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ef73e-8e7e-4439-8dfa-c8123242a493 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:30.832810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ef73e-8e7e-4439-8dfa-c8123242a493 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:30.834280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ef73e-8e7e-4439-8dfa-c8123242a493 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:30.842790 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5fe94-46eb-4e00-9174-4b362f23b70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:30.843793 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5fe94-46eb-4e00-9174-4b362f23b70e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:30.844197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5fe94-46eb-4e00-9174-4b362f23b70e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:30.844489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5fe94-46eb-4e00-9174-4b362f23b70e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:30.845372 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5fe94-46eb-4e00-9174-4b362f23b70e None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=60c2f1c63a674e3195c490ab5ad1318f) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:30.845693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5fe94-46eb-4e00-9174-4b362f23b70e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:30.847154 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5fe94-46eb-4e00-9174-4b362f23b70e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:30.853877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 421/826] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:30 2022] GET /identity/v3/role_assignments?user.id=60c2f1c63a674e3195c490ab5ad1318f&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=c865040abd6c4b099381557da21c471d => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:30.854445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 406/827] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jun 16 14:44:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:30.855351 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e200c-e20c-43df-bf20-34c5b4321a90 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:30.855652 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e200c-e20c-43df-bf20-34c5b4321a90 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:30.855932 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e200c-e20c-43df-bf20-34c5b4321a90 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:30.861278 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 422/828] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:30.862480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ef73e-8e7e-4439-8dfa-c8123242a493 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:30.864305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb88216-901d-4e0c-aa18-28f5c138203f None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:30.864598 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb88216-901d-4e0c-aa18-28f5c138203f None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:30.864878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb88216-901d-4e0c-aa18-28f5c138203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:30.870517 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:30.889127 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-7bb88216-901d-4e0c-aa18-28f5c138203f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:30.890915 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-7bb88216-901d-4e0c-aa18-28f5c138203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:31.007868 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 423/829] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:31.021684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab63640-9dc4-4232-b216-b23f724822ce None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:31.021985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab63640-9dc4-4232-b216-b23f724822ce None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:31.022269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab63640-9dc4-4232-b216-b23f724822ce None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:31.023811 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 424/830] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:31.028658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ef73e-8e7e-4439-8dfa-c8123242a493 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:31.030028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a0c15-28cf-4746-8391-9579fd69c32e None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:31.030378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a0c15-28cf-4746-8391-9579fd69c32e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:31.030664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a0c15-28cf-4746-8391-9579fd69c32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:31.050042 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-9a8a0c15-28cf-4746-8391-9579fd69c32e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:31.051231 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9a8a0c15-28cf-4746-8391-9579fd69c32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:31.051842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:31.073991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4889fa3-2ccd-47d5-9be9-2be51cc4d49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:31.074906 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4889fa3-2ccd-47d5-9be9-2be51cc4d49d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:31.075259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4889fa3-2ccd-47d5-9be9-2be51cc4d49d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:31.075602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4889fa3-2ccd-47d5-9be9-2be51cc4d49d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:31.086871 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4889fa3-2ccd-47d5-9be9-2be51cc4d49d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:31.088261 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4889fa3-2ccd-47d5-9be9-2be51cc4d49d None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:31.108863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-e4889fa3-2ccd-47d5-9be9-2be51cc4d49d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:31.108863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:31.108863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:31.108863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:31.108863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:31.108863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:31.108863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:31.108863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:31.108863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:31.108863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:31.108863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:31.108863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:31.108863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:31.108863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:31.108863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:31.110402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:31.111473 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:31.111473 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:31.111473 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:31.111473 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:31.113077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 407/831] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:31.114778 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4889fa3-2ccd-47d5-9be9-2be51cc4d49d None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:31.132114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 425/832] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:31.132950 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a0c15-28cf-4746-8391-9579fd69c32e None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:31.198132 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:31.226078 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4889fa3-2ccd-47d5-9be9-2be51cc4d49d None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:31.240250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a0c15-28cf-4746-8391-9579fd69c32e None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:31.263779 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e601f1-a4d7-4d05-bf1d-8a97a510f1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:31.264685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e601f1-a4d7-4d05-bf1d-8a97a510f1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:31.265049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e601f1-a4d7-4d05-bf1d-8a97a510f1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:31.265616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e601f1-a4d7-4d05-bf1d-8a97a510f1e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:31.275926 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e601f1-a4d7-4d05-bf1d-8a97a510f1e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:31.276548 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03172bee-5ae8-4cc7-84bd-3fb3c1f16172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:31.277254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03172bee-5ae8-4cc7-84bd-3fb3c1f16172 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:31.277533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03172bee-5ae8-4cc7-84bd-3fb3c1f16172 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:31.277815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03172bee-5ae8-4cc7-84bd-3fb3c1f16172 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:31.278552 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03172bee-5ae8-4cc7-84bd-3fb3c1f16172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:31.278916 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03172bee-5ae8-4cc7-84bd-3fb3c1f16172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:31.280248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03172bee-5ae8-4cc7-84bd-3fb3c1f16172 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:31.284331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-d3e601f1-a4d7-4d05-bf1d-8a97a510f1e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:31.284331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:31.284331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:31.284331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:31.284331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:31.284331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:31.284331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:31.284331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:31.284331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:31.284331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:31.284331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:31.284331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:31.284331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:31.284331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:31.284331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:31.284331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:31.285498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:31.285498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:31.285498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:31.285498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:31.285498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:31.285498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:31.285498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:31.285498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:31.285498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:31.285498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:31.285498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:31.285498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:31.285498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:31.285498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:31.285498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:31.285498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:31.286344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:31.286344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:31.286344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:31.286344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:31.286344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:31.286344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:31.286344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:31.286344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:31.286344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:31.286344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:31.286344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:44:31.286344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:31.286344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 408/833] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:31.287046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e601f1-a4d7-4d05-bf1d-8a97a510f1e1 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:31.297180 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 426/834] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:31.299928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03172bee-5ae8-4cc7-84bd-3fb3c1f16172 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:31.324083 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:31.396038 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e601f1-a4d7-4d05-bf1d-8a97a510f1e1 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:31.404958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03172bee-5ae8-4cc7-84bd-3fb3c1f16172 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:31.430626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:31.432622 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e73a4-823b-4db9-93f8-b3140b6f3d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:31.433614 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e73a4-823b-4db9-93f8-b3140b6f3d4d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:31.434004 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e73a4-823b-4db9-93f8-b3140b6f3d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:31.434386 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e73a4-823b-4db9-93f8-b3140b6f3d4d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:31.435152 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e73a4-823b-4db9-93f8-b3140b6f3d4d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:31.436633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e73a4-823b-4db9-93f8-b3140b6f3d4d None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:31.444896 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293083df-cbdc-4451-b170-dc58d4a4f7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:31.445600 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293083df-cbdc-4451-b170-dc58d4a4f7cc None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:31.445886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293083df-cbdc-4451-b170-dc58d4a4f7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:31.446169 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293083df-cbdc-4451-b170-dc58d4a4f7cc None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:31.446919 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293083df-cbdc-4451-b170-dc58d4a4f7cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:31.447231 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293083df-cbdc-4451-b170-dc58d4a4f7cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:31.448611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293083df-cbdc-4451-b170-dc58d4a4f7cc None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-7e2e73a4-823b-4db9-93f8-b3140b6f3d4d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:31.449975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:31.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:31.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:31.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:31.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:31.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:31.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:31.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:31.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:31.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:31.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:31.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:31.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:31.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:31.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:31.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:31.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:31.452122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:31.452122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:31.452122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:31.452122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:31.452122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:31.452122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:31.452122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:31.452122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:31.452122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:31.452122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:31.452122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:31.452122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:31.452122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:44:31.452122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:31.458802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 409/835] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:44:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:31.458802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e73a4-823b-4db9-93f8-b3140b6f3d4d None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:31.467614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 427/836] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:31.467614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293083df-cbdc-4451-b170-dc58d4a4f7cc None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:31.556555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:31.563541 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e73a4-823b-4db9-93f8-b3140b6f3d4d None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:31.602059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0794b8c-2130-4a75-bbe5-6ecb837397dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:31.602882 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0794b8c-2130-4a75-bbe5-6ecb837397dc None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:31.603170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0794b8c-2130-4a75-bbe5-6ecb837397dc None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:31.603448 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0794b8c-2130-4a75-bbe5-6ecb837397dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:31.611831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0794b8c-2130-4a75-bbe5-6ecb837397dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:31.613344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0794b8c-2130-4a75-bbe5-6ecb837397dc None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:31.628918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-f0794b8c-2130-4a75-bbe5-6ecb837397dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:31.628918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:31.628918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:31.628918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:31.628918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:31.628918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:31.628918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:31.628918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:31.628918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:31.628918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:31.628918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:31.628918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:31.628918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:31.628918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:31.628918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:31.630060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:31.630934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:31.630934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:31.630934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:31.630934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:31.630934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:31.630934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:31.630934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:31.630934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:31.633456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 410/837] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:31.634515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0794b8c-2130-4a75-bbe5-6ecb837397dc None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:31.698248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293083df-cbdc-4451-b170-dc58d4a4f7cc None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:31.732576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03c3e4-3b0f-4bd8-a29a-1a462aea1f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:31.733283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03c3e4-3b0f-4bd8-a29a-1a462aea1f4c None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:31.733570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03c3e4-3b0f-4bd8-a29a-1a462aea1f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:31.733855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03c3e4-3b0f-4bd8-a29a-1a462aea1f4c None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:31.734562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03c3e4-3b0f-4bd8-a29a-1a462aea1f4c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:31.734902 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03c3e4-3b0f-4bd8-a29a-1a462aea1f4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:31.736266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03c3e4-3b0f-4bd8-a29a-1a462aea1f4c None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:31.740001 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0794b8c-2130-4a75-bbe5-6ecb837397dc None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:31.740787 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 428/838] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:44:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:31.743472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03c3e4-3b0f-4bd8-a29a-1a462aea1f4c None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:31.780776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae96be3-cc1c-42d2-884d-e8d89c414259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:31.782989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae96be3-cc1c-42d2-884d-e8d89c414259 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:31.783186 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae96be3-cc1c-42d2-884d-e8d89c414259 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:31.783530 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae96be3-cc1c-42d2-884d-e8d89c414259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:31.793373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:31.794126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae96be3-cc1c-42d2-884d-e8d89c414259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:31.795630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae96be3-cc1c-42d2-884d-e8d89c414259 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:31.814011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-1ae96be3-cc1c-42d2-884d-e8d89c414259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:31.814011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:31.814011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:31.814011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:31.814011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:31.814011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:31.814011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:31.814011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:31.814011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:31.814011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:31.814011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:31.814011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:31.814011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:31.814011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:31.814011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:31.814894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:31.815801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:31.815801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:31.815801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:31.815801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:31.815801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 411/839] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:31.816091 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae96be3-cc1c-42d2-884d-e8d89c414259 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:31.825389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:31.852542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03c3e4-3b0f-4bd8-a29a-1a462aea1f4c None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:31.888282 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88ded1-e282-4622-91b7-8b1835800952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:31.889253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88ded1-e282-4622-91b7-8b1835800952 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:31.889715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88ded1-e282-4622-91b7-8b1835800952 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:31.890161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88ded1-e282-4622-91b7-8b1835800952 None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:31.891635 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88ded1-e282-4622-91b7-8b1835800952 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:31.892129 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88ded1-e282-4622-91b7-8b1835800952 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:31.894189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88ded1-e282-4622-91b7-8b1835800952 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:31.914011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 429/840] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:31.914011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88ded1-e282-4622-91b7-8b1835800952 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:31.924363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae96be3-cc1c-42d2-884d-e8d89c414259 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:31.958699 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460b18a-bc3c-4064-b3e8-840227c3d56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:31.959363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460b18a-bc3c-4064-b3e8-840227c3d56c None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:31.959647 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460b18a-bc3c-4064-b3e8-840227c3d56c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:31.959921 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460b18a-bc3c-4064-b3e8-840227c3d56c None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:31.960617 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460b18a-bc3c-4064-b3e8-840227c3d56c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:31.960925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460b18a-bc3c-4064-b3e8-840227c3d56c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:31.962335 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460b18a-bc3c-4064-b3e8-840227c3d56c None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:31.970124 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 412/841] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:44:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:31.971134 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460b18a-bc3c-4064-b3e8-840227c3d56c None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:32.023644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88ded1-e282-4622-91b7-8b1835800952 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:32.057606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:32.076284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f79d93-d123-4feb-8dff-d6b2e2ad9dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:32.076284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f79d93-d123-4feb-8dff-d6b2e2ad9dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:32.076284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f79d93-d123-4feb-8dff-d6b2e2ad9dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:32.076284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f79d93-d123-4feb-8dff-d6b2e2ad9dc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:32.076692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:32.077100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f79d93-d123-4feb-8dff-d6b2e2ad9dc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:32.077100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f79d93-d123-4feb-8dff-d6b2e2ad9dc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:32.077100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f79d93-d123-4feb-8dff-d6b2e2ad9dc8 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:32.094755 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 430/842] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:32.095072 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f79d93-d123-4feb-8dff-d6b2e2ad9dc8 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:32.110943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460b18a-bc3c-4064-b3e8-840227c3d56c None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:32.158821 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e0a60-8c8c-4c6c-a695-0b583013e543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:32.159708 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e0a60-8c8c-4c6c-a695-0b583013e543 None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:32.159990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e0a60-8c8c-4c6c-a695-0b583013e543 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:32.160263 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e0a60-8c8c-4c6c-a695-0b583013e543 None admin] PATH_INFO: `/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/c1e11e5614c64b87a892740f39e8fc5b/roles/037df45eceeb4cb7aec314c290fa7820` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:32.179326 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e0a60-8c8c-4c6c-a695-0b583013e543 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9e5996685142bb94c83c5403fbf17d, user_id=c1e11e5614c64b87a892740f39e8fc5b, role_id=037df45eceeb4cb7aec314c290fa7820)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:32.180772 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e0a60-8c8c-4c6c-a695-0b583013e543 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:32.217755 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f79d93-d123-4feb-8dff-d6b2e2ad9dc8 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:32.252230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa45f9-1bdc-4644-99a2-a2ad86909173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:32.253161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa45f9-1bdc-4644-99a2-a2ad86909173 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:32.253453 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa45f9-1bdc-4644-99a2-a2ad86909173 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:32.253728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa45f9-1bdc-4644-99a2-a2ad86909173 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:32.262340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa45f9-1bdc-4644-99a2-a2ad86909173 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:32.264118 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa45f9-1bdc-4644-99a2-a2ad86909173 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:32.273471 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 413/843] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:44:31 2022] PUT /identity/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/c1e11e5614c64b87a892740f39e8fc5b/roles/037df45eceeb4cb7aec314c290fa7820 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:44:32.282370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-68aa45f9-1bdc-4644-99a2-a2ad86909173 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:44:32.282370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:32.282370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:32.282370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:32.282370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:32.282370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:32.282370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:32.282370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:32.282370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:32.282370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:32.282370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:32.282370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:32.282370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:32.282370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:32.282370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:32.282370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:32.283385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:32.284661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:32.284661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:32.284661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:32.284661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:32.284661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:32.284661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:32.284661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:32.284661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:32.284661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 14:44:32.284661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:32.284661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 431/844] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:44:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:32.290164 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e0a60-8c8c-4c6c-a695-0b583013e543 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:32.405237 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e0a60-8c8c-4c6c-a695-0b583013e543 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:32.428525 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:32.446333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947f3af-d1b3-4d36-87b9-d39d4f483504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:32.447377 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947f3af-d1b3-4d36-87b9-d39d4f483504 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:32.447863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947f3af-d1b3-4d36-87b9-d39d4f483504 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:32.448355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947f3af-d1b3-4d36-87b9-d39d4f483504 None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:32.449450 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947f3af-d1b3-4d36-87b9-d39d4f483504 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:32.458118 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947f3af-d1b3-4d36-87b9-d39d4f483504 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:32.458118 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947f3af-d1b3-4d36-87b9-d39d4f483504 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:32.470568 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 414/845] 10.222.0.23 () {56 vars in 1135 bytes} [Thu Jun 16 14:44:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:32.476614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa45f9-1bdc-4644-99a2-a2ad86909173 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:32.510238 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:32.587650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa45f9-1bdc-4644-99a2-a2ad86909173 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:32.623224 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c5aa5-41cf-4902-8c90-00ca086ed241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:32.623922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c5aa5-41cf-4902-8c90-00ca086ed241 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:32.624211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c5aa5-41cf-4902-8c90-00ca086ed241 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:32.624484 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c5aa5-41cf-4902-8c90-00ca086ed241 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:32.696266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c5aa5-41cf-4902-8c90-00ca086ed241 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:32.697748 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c5aa5-41cf-4902-8c90-00ca086ed241 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:32.727139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:32.816573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 432/846] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:44:32.821920 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947f3af-d1b3-4d36-87b9-d39d4f483504 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:32.930957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947f3af-d1b3-4d36-87b9-d39d4f483504 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:32.976256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a75fc-e301-47b0-8c81-2dce15018b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:32.977068 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a75fc-e301-47b0-8c81-2dce15018b9d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:32.977387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a75fc-e301-47b0-8c81-2dce15018b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:32.977665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a75fc-e301-47b0-8c81-2dce15018b9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:32.989067 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a75fc-e301-47b0-8c81-2dce15018b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:32.990610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a75fc-e301-47b0-8c81-2dce15018b9d None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:33.012610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-657a75fc-e301-47b0-8c81-2dce15018b9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:33.012610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:33.012610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:33.012610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:33.012610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:33.012610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:33.012610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:33.012610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:33.012610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:33.012610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:33.012610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:33.012610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:33.012610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:33.012610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:33.012610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:33.013567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:33.014438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:33.014438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:33.014438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:33.014438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:33.020242 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 415/847] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:33.023266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c5aa5-41cf-4902-8c90-00ca086ed241 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:33.131492 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf749a90-68b0-4151-aa8a-8a96b1895d56 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:33.132024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf749a90-68b0-4151-aa8a-8a96b1895d56 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:33.132024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf749a90-68b0-4151-aa8a-8a96b1895d56 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:33.133803 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 416/848] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:33.138607 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd584aa-799a-4937-bdaf-40b060bf38f4 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:33.138902 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd584aa-799a-4937-bdaf-40b060bf38f4 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:33.139188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd584aa-799a-4937-bdaf-40b060bf38f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:33.162995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-6dd584aa-799a-4937-bdaf-40b060bf38f4 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:33.164218 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-6dd584aa-799a-4937-bdaf-40b060bf38f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:33.210433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c5aa5-41cf-4902-8c90-00ca086ed241 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:33.230428 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:33.258373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:33.294274 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bbad3-77cc-4004-899e-5b02e4134d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:33.295476 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bbad3-77cc-4004-899e-5b02e4134d73 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:33.296789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bbad3-77cc-4004-899e-5b02e4134d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:33.297322 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bbad3-77cc-4004-899e-5b02e4134d73 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:33.298289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bbad3-77cc-4004-899e-5b02e4134d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:33.299592 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bbad3-77cc-4004-899e-5b02e4134d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:33.301651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bbad3-77cc-4004-899e-5b02e4134d73 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:33.307648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 417/849] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:33.320492 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 433/850] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:33.326038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bbad3-77cc-4004-899e-5b02e4134d73 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:33.326595 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd584aa-799a-4937-bdaf-40b060bf38f4 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:33.434049 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bbad3-77cc-4004-899e-5b02e4134d73 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:33.465889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd584aa-799a-4937-bdaf-40b060bf38f4 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:33.471634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40288957-599a-4848-a360-99aeb5b36b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:33.472693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40288957-599a-4848-a360-99aeb5b36b82 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:33.473222 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40288957-599a-4848-a360-99aeb5b36b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:33.473730 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40288957-599a-4848-a360-99aeb5b36b82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:33.484695 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40288957-599a-4848-a360-99aeb5b36b82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:33.487257 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40288957-599a-4848-a360-99aeb5b36b82 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:33.503207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-40288957-599a-4848-a360-99aeb5b36b82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:33.503207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:33.503207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:33.503207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:33.503207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:33.503207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:33.503207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:33.503207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:33.503207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:33.503207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:33.503207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:33.503207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:33.503207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:33.503207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:33.503207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:33.504157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:33.505044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:33.505044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:33.505044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:33.505044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:33.505044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:33.505044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:33.505044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:33.505044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:33.508443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0390860-7136-420d-b131-77fe708cb1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:33.509574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0390860-7136-420d-b131-77fe708cb1ea None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:33.509682 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 434/851] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:33.510144 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0390860-7136-420d-b131-77fe708cb1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:33.510593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0390860-7136-420d-b131-77fe708cb1ea None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:33.510693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40288957-599a-4848-a360-99aeb5b36b82 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:33.511696 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0390860-7136-420d-b131-77fe708cb1ea None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:33.513274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0390860-7136-420d-b131-77fe708cb1ea None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:33.536451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-e0390860-7136-420d-b131-77fe708cb1ea None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:44:33.536451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:33.536451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:33.536451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:33.536451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:33.536451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:33.536451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:33.536451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:33.536451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:44:33.536451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:33.536451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:33.536451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:33.536451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:33.536451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:33.536451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:33.536451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:33.537497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:33.537497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:33.537497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:33.537497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:33.537497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:33.537497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:33.537497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:33.537497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:33.537497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:33.537497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:33.537497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:33.537497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:33.537497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:33.537497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:33.537497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:33.537497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:33.538309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:33.538309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:33.538309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:33.538309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:33.538309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:33.538309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:33.538309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:33.538309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:33.538309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:33.538309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:33.538309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:33.538309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:33.538309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:33.538309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:44:33.538309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:33.539085 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 418/852] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Jun 16 14:44:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:33.546313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0390860-7136-420d-b131-77fe708cb1ea None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:33.572097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:33.582819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:33.634187 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40288957-599a-4848-a360-99aeb5b36b82 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:33.668333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0390860-7136-420d-b131-77fe708cb1ea None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:33.678414 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b84bbd-55ec-4091-95c6-7abc8417b286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:33.679665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b84bbd-55ec-4091-95c6-7abc8417b286 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:33.680427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b84bbd-55ec-4091-95c6-7abc8417b286 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:33.680930 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b84bbd-55ec-4091-95c6-7abc8417b286 None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:33.682097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b84bbd-55ec-4091-95c6-7abc8417b286 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:33.682987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b84bbd-55ec-4091-95c6-7abc8417b286 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:33.685061 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b84bbd-55ec-4091-95c6-7abc8417b286 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:33.701024 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 435/853] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:33.702895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d727dcf-2e07-4c8a-969e-f2f69c356eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:33.703632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d727dcf-2e07-4c8a-969e-f2f69c356eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:33.704031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d727dcf-2e07-4c8a-969e-f2f69c356eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:33.704375 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d727dcf-2e07-4c8a-969e-f2f69c356eb1 None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:33.705167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d727dcf-2e07-4c8a-969e-f2f69c356eb1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:33.705557 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d727dcf-2e07-4c8a-969e-f2f69c356eb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:33.706630 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b84bbd-55ec-4091-95c6-7abc8417b286 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:33.707017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d727dcf-2e07-4c8a-969e-f2f69c356eb1 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:33.712482 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 419/854] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:33.718393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d727dcf-2e07-4c8a-969e-f2f69c356eb1 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:33.813320 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:33.830506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d727dcf-2e07-4c8a-969e-f2f69c356eb1 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:33.837796 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b84bbd-55ec-4091-95c6-7abc8417b286 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:33.847853 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:33.873170 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0239f2-6b31-4202-bac7-c48f80cedf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:33.873855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0239f2-6b31-4202-bac7-c48f80cedf92 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:33.874142 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0239f2-6b31-4202-bac7-c48f80cedf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:33.874421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0239f2-6b31-4202-bac7-c48f80cedf92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:33.875275 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0239f2-6b31-4202-bac7-c48f80cedf92 None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=a952ee6a39e1453b80a8a8b787d0fdf5) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:33.875569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0239f2-6b31-4202-bac7-c48f80cedf92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:33.877862 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0239f2-6b31-4202-bac7-c48f80cedf92 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:33.878376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b8e55-b5f6-4bda-a3e6-a89bced5b8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:33.879213 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b8e55-b5f6-4bda-a3e6-a89bced5b8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:33.879627 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b8e55-b5f6-4bda-a3e6-a89bced5b8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:33.880054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b8e55-b5f6-4bda-a3e6-a89bced5b8d3 None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:33.881565 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b8e55-b5f6-4bda-a3e6-a89bced5b8d3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:33.882601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b8e55-b5f6-4bda-a3e6-a89bced5b8d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:33.884363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b8e55-b5f6-4bda-a3e6-a89bced5b8d3 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:33.889475 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 436/855] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:33 2022] GET /identity/v3/role_assignments?user.id=a952ee6a39e1453b80a8a8b787d0fdf5&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=c865040abd6c4b099381557da21c471d => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:33.889828 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 420/856] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:34.332777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04eec0-8459-475e-8410-6a8282127cae None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:34.333340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04eec0-8459-475e-8410-6a8282127cae None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:34.333340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04eec0-8459-475e-8410-6a8282127cae None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:34.334964 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 437/857] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:34.340303 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b174-e7fd-4916-9b8f-1feb6343fae3 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:34.340712 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b174-e7fd-4916-9b8f-1feb6343fae3 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:34.340904 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b174-e7fd-4916-9b8f-1feb6343fae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:34.358125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-f368b174-e7fd-4916-9b8f-1feb6343fae3 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:34.359481 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f368b174-e7fd-4916-9b8f-1feb6343fae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:34.431477 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 421/858] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:34.455051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04eec0-8459-475e-8410-6a8282127cae None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:34.569883 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04eec0-8459-475e-8410-6a8282127cae None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:34.573482 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a0945-38b0-42e6-a68f-409717f40d33 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:34.574867 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a0945-38b0-42e6-a68f-409717f40d33 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:34.575365 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a0945-38b0-42e6-a68f-409717f40d33 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:34.577228 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 422/859] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:34.582573 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d51aa3-6610-40e2-abc3-2add0529f68d None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:34.583178 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d51aa3-6610-40e2-abc3-2add0529f68d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:34.583648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d51aa3-6610-40e2-abc3-2add0529f68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:34.604572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-35d51aa3-6610-40e2-abc3-2add0529f68d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:34.606128 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-35d51aa3-6610-40e2-abc3-2add0529f68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:34.607861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbdff2-458e-430f-8d5a-6ae4077d1d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:34.608532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbdff2-458e-430f-8d5a-6ae4077d1d69 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:34.608893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbdff2-458e-430f-8d5a-6ae4077d1d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:34.609163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbdff2-458e-430f-8d5a-6ae4077d1d69 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:34.610049 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbdff2-458e-430f-8d5a-6ae4077d1d69 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:34.611941 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbdff2-458e-430f-8d5a-6ae4077d1d69 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:34.685270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 423/860] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:34.696489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 438/861] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 16 14:44:34 2022] POST /identity/v3/services => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:34.705393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d51aa3-6610-40e2-abc3-2add0529f68d None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:34.723325 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:34.827454 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d51aa3-6610-40e2-abc3-2add0529f68d None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:34.871796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e1b8c-ffab-4aa1-8e25-212b29842168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:34.872526 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e1b8c-ffab-4aa1-8e25-212b29842168 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:34.872810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e1b8c-ffab-4aa1-8e25-212b29842168 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:34.873085 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e1b8c-ffab-4aa1-8e25-212b29842168 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:34.884360 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e1b8c-ffab-4aa1-8e25-212b29842168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:34.892197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-179e1b8c-ffab-4aa1-8e25-212b29842168 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:34.892197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:34.892197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:34.892197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:34.892197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:34.892197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:34.892197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:34.892197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:34.892197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:34.892197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:34.892197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:34.892197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:34.892197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:34.892197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:34.892197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:34.892197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:34.893086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:34.893086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:34.893086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:34.893086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:34.893086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:34.893086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:34.893086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:34.893086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:34.893086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:34.893086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:34.893086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:34.893086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:34.893086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:34.893086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:34.893086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:34.893086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:34.894382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:34.894382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:34.894382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:34.894382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:34.894382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:34.894382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:34.894382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:34.894382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:34.894382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:34.894382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:34.894382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:44:34.894382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:34.894382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 424/862] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:44:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:34.899546 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbdff2-458e-430f-8d5a-6ae4077d1d69 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:34.933467 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:35.018098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbdff2-458e-430f-8d5a-6ae4077d1d69 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:35.056092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62149c5e-481b-4191-971d-ee99326da6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:35.057019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62149c5e-481b-4191-971d-ee99326da6ea None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:35.057496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62149c5e-481b-4191-971d-ee99326da6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:35.057918 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62149c5e-481b-4191-971d-ee99326da6ea None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:35.058854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62149c5e-481b-4191-971d-ee99326da6ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:35.059303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62149c5e-481b-4191-971d-ee99326da6ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:35.060817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62149c5e-481b-4191-971d-ee99326da6ea None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:35.070185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 439/863] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:44:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:35.076048 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e1b8c-ffab-4aa1-8e25-212b29842168 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:35.154182 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:35.189831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e1b8c-ffab-4aa1-8e25-212b29842168 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:35.224271 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2c44e-ff86-467f-8660-be3d7f10ac0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:35.225067 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2c44e-ff86-467f-8660-be3d7f10ac0c None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:35.225369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2c44e-ff86-467f-8660-be3d7f10ac0c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:35.225639 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2c44e-ff86-467f-8660-be3d7f10ac0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:35.236998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2c44e-ff86-467f-8660-be3d7f10ac0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:35.238485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2c44e-ff86-467f-8660-be3d7f10ac0c None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:35.256007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-cba2c44e-ff86-467f-8660-be3d7f10ac0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:35.256007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:35.256007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:35.256007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:35.256007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:35.256007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:35.256007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:35.256007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:35.256007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:35.256007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:35.256007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:35.256007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:35.256007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:35.256007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:35.256007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:35.256929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:35.257913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:35.257913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:35.257913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:35.257913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:35.257913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 425/864] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:35.264197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62149c5e-481b-4191-971d-ee99326da6ea None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:35.365359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:35.378227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62149c5e-481b-4191-971d-ee99326da6ea None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:35.414768 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60c73e-8201-498e-be09-a9ec6b884d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:35.415720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60c73e-8201-498e-be09-a9ec6b884d68 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:35.416204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60c73e-8201-498e-be09-a9ec6b884d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:35.416677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60c73e-8201-498e-be09-a9ec6b884d68 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:35.417644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60c73e-8201-498e-be09-a9ec6b884d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:35.418166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60c73e-8201-498e-be09-a9ec6b884d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:35.419741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60c73e-8201-498e-be09-a9ec6b884d68 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:35.432023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 440/865] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:35.437782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2c44e-ff86-467f-8660-be3d7f10ac0c None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:35.541226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2c44e-ff86-467f-8660-be3d7f10ac0c None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:35.561867 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:35.576210 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e833cc-3cc1-47ff-9355-b88ce40dc2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:35.577284 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e833cc-3cc1-47ff-9355-b88ce40dc2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:35.577713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e833cc-3cc1-47ff-9355-b88ce40dc2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:35.578132 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e833cc-3cc1-47ff-9355-b88ce40dc2c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:35.586768 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e833cc-3cc1-47ff-9355-b88ce40dc2c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:35.588485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e833cc-3cc1-47ff-9355-b88ce40dc2c9 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:35.604802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-d6e833cc-3cc1-47ff-9355-b88ce40dc2c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:44:35.604802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:35.604802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:35.604802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:35.604802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:35.604802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:35.604802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:35.604802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:35.604802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:35.604802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:35.604802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:35.604802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:35.604802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:35.604802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:35.604802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:35.604802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:35.605998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:35.607167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:35.607167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:35.607167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:35.607167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:35.607167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:35.607167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:35.607167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:35.607167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:35.607167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:44:35.607167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:35.609374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 426/866] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 16 14:44:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:35.615215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60c73e-8201-498e-be09-a9ec6b884d68 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:35.724019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60c73e-8201-498e-be09-a9ec6b884d68 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:35.759645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa2c5a-6721-4f55-b91c-de3d905daf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:35.760319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa2c5a-6721-4f55-b91c-de3d905daf34 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:35.760604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa2c5a-6721-4f55-b91c-de3d905daf34 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:35.760880 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa2c5a-6721-4f55-b91c-de3d905daf34 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:35.761744 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa2c5a-6721-4f55-b91c-de3d905daf34 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:35.762055 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa2c5a-6721-4f55-b91c-de3d905daf34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:35.763485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa2c5a-6721-4f55-b91c-de3d905daf34 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:35.781594 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 441/867] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jun 16 14:44:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:35.787749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e833cc-3cc1-47ff-9355-b88ce40dc2c9 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:35.891556 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e833cc-3cc1-47ff-9355-b88ce40dc2c9 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:35.926397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0d74b-7f2d-45d3-8aec-1895fe7f0bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:35.927059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0d74b-7f2d-45d3-8aec-1895fe7f0bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:35.927343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0d74b-7f2d-45d3-8aec-1895fe7f0bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:35.927620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0d74b-7f2d-45d3-8aec-1895fe7f0bf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:35.979623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:35.998912 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0d74b-7f2d-45d3-8aec-1895fe7f0bf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:36.000592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0d74b-7f2d-45d3-8aec-1895fe7f0bf8 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:36.090471 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f40ff-5d89-4280-a65e-33cb32e839b6 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:36.090801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f40ff-5d89-4280-a65e-33cb32e839b6 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:36.091034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f40ff-5d89-4280-a65e-33cb32e839b6 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:36.092535 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 442/868] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:36.099295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348bdf-355a-47eb-ad20-ca11c6088404 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:36.100015 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348bdf-355a-47eb-ad20-ca11c6088404 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:36.100844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348bdf-355a-47eb-ad20-ca11c6088404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:36.111252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 427/869] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:35 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:44:36.118129 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0d74b-7f2d-45d3-8aec-1895fe7f0bf8 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:36.120641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-6e348bdf-355a-47eb-ad20-ca11c6088404 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:36.122209 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6e348bdf-355a-47eb-ad20-ca11c6088404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:36.130400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:36.209462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 443/870] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:36 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:36.216263 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e2fa3-12a3-4d99-8405-277e9663246a None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:36.216553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e2fa3-12a3-4d99-8405-277e9663246a None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:36.216827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e2fa3-12a3-4d99-8405-277e9663246a None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:36.220784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:36.222052 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 444/871] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:36.223537 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9bf55-a5ad-4ee8-9a2c-9fe6c67e4a84 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:36.223824 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9bf55-a5ad-4ee8-9a2c-9fe6c67e4a84 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:36.224101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9bf55-a5ad-4ee8-9a2c-9fe6c67e4a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:36.240721 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-8df9bf55-a5ad-4ee8-9a2c-9fe6c67e4a84 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:36.241837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-8df9bf55-a5ad-4ee8-9a2c-9fe6c67e4a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:36.243028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0d74b-7f2d-45d3-8aec-1895fe7f0bf8 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:36.280239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057a972-b1fa-45e7-b78e-743759789ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:36.281027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057a972-b1fa-45e7-b78e-743759789ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:36.281476 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057a972-b1fa-45e7-b78e-743759789ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:36.281753 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057a972-b1fa-45e7-b78e-743759789ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:36.294546 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057a972-b1fa-45e7-b78e-743759789ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:36.296673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057a972-b1fa-45e7-b78e-743759789ae0 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:36.309602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 445/872] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:36 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:36.310224 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9bf55-a5ad-4ee8-9a2c-9fe6c67e4a84 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:36.324149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-9057a972-b1fa-45e7-b78e-743759789ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:36.324149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:36.324149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:36.324149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:36.324149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:36.324149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:36.324149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:36.324149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:36.324149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:36.324149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:36.324149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:36.324149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:36.324149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:36.324149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:36.324149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:36.325031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:36.325967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:36.325967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:36.325967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:36.325967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:36.331254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 428/873] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:36.332248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057a972-b1fa-45e7-b78e-743759789ae0 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:36.395547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:36.424773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9bf55-a5ad-4ee8-9a2c-9fe6c67e4a84 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:36.436720 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057a972-b1fa-45e7-b78e-743759789ae0 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:36.460316 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84793f64-6151-4980-92be-3d21c4c9aa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:36.461207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84793f64-6151-4980-92be-3d21c4c9aa74 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:36.461629 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84793f64-6151-4980-92be-3d21c4c9aa74 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:36.462045 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84793f64-6151-4980-92be-3d21c4c9aa74 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:36.462921 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84793f64-6151-4980-92be-3d21c4c9aa74 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:36.464422 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84793f64-6151-4980-92be-3d21c4c9aa74 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:36.469356 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:36.474870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e3652-096f-4ab6-b98c-0605d8ff81fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:36.475536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e3652-096f-4ab6-b98c-0605d8ff81fe None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:36.475848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e3652-096f-4ab6-b98c-0605d8ff81fe None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:36.476130 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e3652-096f-4ab6-b98c-0605d8ff81fe None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:36.476851 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e3652-096f-4ab6-b98c-0605d8ff81fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:36.477189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e3652-096f-4ab6-b98c-0605d8ff81fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:36.478641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e3652-096f-4ab6-b98c-0605d8ff81fe None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:36.490316 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 429/874] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:36.491159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e3652-096f-4ab6-b98c-0605d8ff81fe None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:36.574944 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 446/875] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 16 14:44:36 2022] POST /identity/v3/services => generated 269 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:36.576212 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84793f64-6151-4980-92be-3d21c4c9aa74 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:36.599472 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e3652-096f-4ab6-b98c-0605d8ff81fe None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:36.649577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcaaf5-76e4-4ca6-9d09-097283bfe388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:36.651106 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcaaf5-76e4-4ca6-9d09-097283bfe388 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:36.651762 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcaaf5-76e4-4ca6-9d09-097283bfe388 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:36.652578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcaaf5-76e4-4ca6-9d09-097283bfe388 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:36.654208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcaaf5-76e4-4ca6-9d09-097283bfe388 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:36.658234 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcaaf5-76e4-4ca6-9d09-097283bfe388 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-5afcaaf5-76e4-4ca6-9d09-097283bfe388 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:36.672700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:36.674385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:36.674385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:36.674385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:36.674385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:36.674385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:36.674385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:36.674385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:36.674385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:36.674385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:36.674385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:36.674385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:36.674385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:36.674385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:36.674385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:36.674385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:36.674385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:36.675291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:36.675291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:36.675291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:36.675291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:36.675291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:36.675291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:36.675291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:36.675291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:36.675291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:36.675291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:36.675291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:36.675291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:36.675291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:36.675291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:36.683247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 430/876] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:36.685011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcaaf5-76e4-4ca6-9d09-097283bfe388 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:36.742112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84793f64-6151-4980-92be-3d21c4c9aa74 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:36.774785 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:36.780409 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:36.788786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f083d-e84a-4311-99dd-a8776f2d39ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:36.789797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f083d-e84a-4311-99dd-a8776f2d39ed None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:36.789949 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f083d-e84a-4311-99dd-a8776f2d39ed None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:36.790217 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f083d-e84a-4311-99dd-a8776f2d39ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:36.804190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f083d-e84a-4311-99dd-a8776f2d39ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:36.806963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f083d-e84a-4311-99dd-a8776f2d39ed None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:36.833993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcaaf5-76e4-4ca6-9d09-097283bfe388 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:36.835634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-c00f083d-e84a-4311-99dd-a8776f2d39ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:36.835634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:36.835634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:36.835634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:36.835634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:36.835634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:36.835634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:36.835634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:36.835634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:36.835634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:36.835634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:36.835634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:36.835634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:36.835634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:36.835634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:36.836491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:36.837419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:36.837419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:36.837419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:36.837419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:36.837419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:36.837419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:36.837419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:36.837419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:36.838773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 447/877] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:36.846503 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f083d-e84a-4311-99dd-a8776f2d39ed None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:36.884735 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22615ff-2f22-4f1d-8d3e-42808daddb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:36.885512 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22615ff-2f22-4f1d-8d3e-42808daddb75 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:36.885805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22615ff-2f22-4f1d-8d3e-42808daddb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:36.886089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22615ff-2f22-4f1d-8d3e-42808daddb75 None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:36.886860 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22615ff-2f22-4f1d-8d3e-42808daddb75 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:36.887179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22615ff-2f22-4f1d-8d3e-42808daddb75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:36.888551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22615ff-2f22-4f1d-8d3e-42808daddb75 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:36.898898 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 431/878] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:36.900245 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22615ff-2f22-4f1d-8d3e-42808daddb75 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:36.983674 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f083d-e84a-4311-99dd-a8776f2d39ed None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:37.017650 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22615ff-2f22-4f1d-8d3e-42808daddb75 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:37.026721 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f86621-5e62-44ac-a43e-0bf6e4751de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:37.027936 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f86621-5e62-44ac-a43e-0bf6e4751de6 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:37.028364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f86621-5e62-44ac-a43e-0bf6e4751de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:37.029071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f86621-5e62-44ac-a43e-0bf6e4751de6 None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:37.030381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f86621-5e62-44ac-a43e-0bf6e4751de6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:37.030856 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f86621-5e62-44ac-a43e-0bf6e4751de6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:37.033934 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f86621-5e62-44ac-a43e-0bf6e4751de6 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:37.035971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:37.049564 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 448/879] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:37.056327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f86621-5e62-44ac-a43e-0bf6e4751de6 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:37.060291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dece0f9-fe3a-40ce-85ec-155fc021189a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:37.061876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dece0f9-fe3a-40ce-85ec-155fc021189a None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:37.061876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dece0f9-fe3a-40ce-85ec-155fc021189a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:37.061876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dece0f9-fe3a-40ce-85ec-155fc021189a None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:37.062484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dece0f9-fe3a-40ce-85ec-155fc021189a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:37.062799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dece0f9-fe3a-40ce-85ec-155fc021189a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:37.064299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dece0f9-fe3a-40ce-85ec-155fc021189a None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:37.077373 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 432/880] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:37.126420 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:37.144217 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180302ab-6311-4dc7-98b3-18a464c8ca47 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:37.144641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180302ab-6311-4dc7-98b3-18a464c8ca47 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:37.147358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180302ab-6311-4dc7-98b3-18a464c8ca47 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:37.147358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 433/881] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:37.152566 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821070be-b3a7-4dcd-b176-f5ba0d10c0b0 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:37.152951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821070be-b3a7-4dcd-b176-f5ba0d10c0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:37.153337 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821070be-b3a7-4dcd-b176-f5ba0d10c0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:37.171907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-821070be-b3a7-4dcd-b176-f5ba0d10c0b0 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:37.173221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-821070be-b3a7-4dcd-b176-f5ba0d10c0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:37.190433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f86621-5e62-44ac-a43e-0bf6e4751de6 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:37.241628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34055fe-f105-4bbf-9167-37dc56c70cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:37.242577 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34055fe-f105-4bbf-9167-37dc56c70cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:37.242859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34055fe-f105-4bbf-9167-37dc56c70cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:37.243133 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34055fe-f105-4bbf-9167-37dc56c70cb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:37.244143 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34055fe-f105-4bbf-9167-37dc56c70cb9 None admin] RBAC: Adding query filter params (role.id=037df45eceeb4cb7aec314c290fa7820, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=c1e11e5614c64b87a892740f39e8fc5b) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:37.244458 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34055fe-f105-4bbf-9167-37dc56c70cb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:37.246249 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34055fe-f105-4bbf-9167-37dc56c70cb9 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:37.256758 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 449/882] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:37 2022] GET /identity/v3/role_assignments?user.id=c1e11e5614c64b87a892740f39e8fc5b&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=037df45eceeb4cb7aec314c290fa7820 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:37.279599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 434/883] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:37.302455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34055fe-f105-4bbf-9167-37dc56c70cb9 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:37.417693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34055fe-f105-4bbf-9167-37dc56c70cb9 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:37.434924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:37.453520 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941d04d-74e4-4a19-b388-fb315926149b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:37.462683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941d04d-74e4-4a19-b388-fb315926149b None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:37.462683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941d04d-74e4-4a19-b388-fb315926149b None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:37.462683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941d04d-74e4-4a19-b388-fb315926149b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:37.462683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941d04d-74e4-4a19-b388-fb315926149b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:37.462683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941d04d-74e4-4a19-b388-fb315926149b None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-1941d04d-74e4-4a19-b388-fb315926149b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:37.469495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:37.470516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:37.470516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:37.470516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:37.470516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:37.470516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:37.470516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:37.470516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:37.470516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:37.470516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:37.470516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:37.470516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:37.470516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:37.470516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:37.470516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:37.470516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:37.470516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:37.471819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:37.471819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:37.471819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:37.471819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:37.471819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:37.471819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:37.471819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:37.471819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:37.471819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:37.471819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:37.471819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:37.471819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:37.471819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:44:37.471819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:37.471819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 450/884] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:44:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:37.477523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821070be-b3a7-4dcd-b176-f5ba0d10c0b0 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:37.585626 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821070be-b3a7-4dcd-b176-f5ba0d10c0b0 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:37.600614 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:37.624755 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ba95b-1365-49fc-9efb-b61673f44638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:37.625469 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ba95b-1365-49fc-9efb-b61673f44638 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:37.625757 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ba95b-1365-49fc-9efb-b61673f44638 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:37.626038 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ba95b-1365-49fc-9efb-b61673f44638 None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:37.627324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ba95b-1365-49fc-9efb-b61673f44638 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:37.627636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ba95b-1365-49fc-9efb-b61673f44638 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:37.629019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ba95b-1365-49fc-9efb-b61673f44638 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:37.634142 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 435/885] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:44:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:37.640279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941d04d-74e4-4a19-b388-fb315926149b None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:37.748377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941d04d-74e4-4a19-b388-fb315926149b None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:37.786208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526f54f-58cb-4c71-8240-5efbfce2d883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:37.786894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526f54f-58cb-4c71-8240-5efbfce2d883 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:37.787177 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526f54f-58cb-4c71-8240-5efbfce2d883 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:37.787455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526f54f-58cb-4c71-8240-5efbfce2d883 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:37.788184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526f54f-58cb-4c71-8240-5efbfce2d883 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:37.788494 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526f54f-58cb-4c71-8240-5efbfce2d883 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:37.789943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526f54f-58cb-4c71-8240-5efbfce2d883 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:37.796289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 451/886] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:44:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:37.802523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ba95b-1365-49fc-9efb-b61673f44638 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:37.904973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ba95b-1365-49fc-9efb-b61673f44638 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:37.947185 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a489fd-4252-4b3f-8092-a7664da14dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:37.948506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a489fd-4252-4b3f-8092-a7664da14dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:37.949226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a489fd-4252-4b3f-8092-a7664da14dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:37.949955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a489fd-4252-4b3f-8092-a7664da14dd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:37.951748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a489fd-4252-4b3f-8092-a7664da14dd7 None admin] RBAC: Adding query filter params (interface=public, service_id=07441dbc661842b9bd37ad9ee64cbceb, region_id=RegionOne) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:37.952623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a489fd-4252-4b3f-8092-a7664da14dd7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:37.955431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a489fd-4252-4b3f-8092-a7664da14dd7 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:37.963719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 436/887] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jun 16 14:44:37 2022] GET /identity/v3/endpoints?service_id=07441dbc661842b9bd37ad9ee64cbceb&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:37.972366 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526f54f-58cb-4c71-8240-5efbfce2d883 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:38.030554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:38.090399 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526f54f-58cb-4c71-8240-5efbfce2d883 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:38.124152 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9013e-cbab-45a1-ae75-6d9394d156ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:38.125151 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9013e-cbab-45a1-ae75-6d9394d156ff None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:38.125582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9013e-cbab-45a1-ae75-6d9394d156ff None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:38.126017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9013e-cbab-45a1-ae75-6d9394d156ff None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:38.127012 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9013e-cbab-45a1-ae75-6d9394d156ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:38.128823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9013e-cbab-45a1-ae75-6d9394d156ff None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:38.134978 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 452/888] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 16 14:44:37 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:44:38.876759 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084871cb-911e-43a1-a286-aa9f1004b770 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:38.877298 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084871cb-911e-43a1-a286-aa9f1004b770 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:38.877376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084871cb-911e-43a1-a286-aa9f1004b770 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:38.878928 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 437/889] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:38.884566 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dacac-5b93-4253-b755-274546904e4f None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:38.884987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dacac-5b93-4253-b755-274546904e4f None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:38.885181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dacac-5b93-4253-b755-274546904e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:38.902673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-4c2dacac-5b93-4253-b755-274546904e4f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:38.903853 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4c2dacac-5b93-4253-b755-274546904e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:38.977460 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 453/890] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:38.996280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084871cb-911e-43a1-a286-aa9f1004b770 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:39.038973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:39.105400 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084871cb-911e-43a1-a286-aa9f1004b770 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:39.141288 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0198e7d-0e7a-488d-95a2-72f06ef4827a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:39.142491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0198e7d-0e7a-488d-95a2-72f06ef4827a None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:39.143462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0198e7d-0e7a-488d-95a2-72f06ef4827a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:39.143945 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0198e7d-0e7a-488d-95a2-72f06ef4827a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:39.144798 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0198e7d-0e7a-488d-95a2-72f06ef4827a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:39.146387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0198e7d-0e7a-488d-95a2-72f06ef4827a None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:39.159370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-a0198e7d-0e7a-488d-95a2-72f06ef4827a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:44:39.159370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:39.159370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:39.159370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:39.159370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:39.159370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:39.159370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:39.159370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:39.159370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:44:39.159370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:39.159370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:39.159370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:39.159370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:39.159370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:39.159370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:39.159370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:39.160304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:39.160304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:39.160304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:39.160304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:39.160304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:39.160304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:39.160304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:39.160304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:39.160304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:39.160304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:39.160304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:39.160304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:39.160304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:39.160304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:39.160304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:39.160304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:39.161126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:39.161126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:39.161126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:39.161126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:39.161126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:39.161126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:39.161126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:39.161126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:39.161126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:39.161126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:39.161126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:39.161126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:39.161126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:39.161126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:44:39.161126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:39.164159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 438/891] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Jun 16 14:44:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:39.169860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dacac-5b93-4253-b755-274546904e4f None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:39.210973 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:39.273960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dacac-5b93-4253-b755-274546904e4f None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:39.312176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7711f8-2cc3-439f-823d-1961e07c2d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:39.312882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7711f8-2cc3-439f-823d-1961e07c2d36 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:39.313193 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7711f8-2cc3-439f-823d-1961e07c2d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:39.313478 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7711f8-2cc3-439f-823d-1961e07c2d36 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:39.314849 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7711f8-2cc3-439f-823d-1961e07c2d36 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:39.315166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7711f8-2cc3-439f-823d-1961e07c2d36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:39.316592 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7711f8-2cc3-439f-823d-1961e07c2d36 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:39.324194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 454/892] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:39.329648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0198e7d-0e7a-488d-95a2-72f06ef4827a None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:39.366836 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0648e48-9fe7-4d43-b4d2-c732e7ecc1f2 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:39.367149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0648e48-9fe7-4d43-b4d2-c732e7ecc1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:39.367406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0648e48-9fe7-4d43-b4d2-c732e7ecc1f2 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:39.370631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 455/893] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:39.376069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f710f30-b4fc-469a-9b1d-76d7c7614a6b None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:39.379226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f710f30-b4fc-469a-9b1d-76d7c7614a6b None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:39.379516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f710f30-b4fc-469a-9b1d-76d7c7614a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:39.410294 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-0f710f30-b4fc-469a-9b1d-76d7c7614a6b None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:39.411562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0f710f30-b4fc-469a-9b1d-76d7c7614a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:39.473927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0198e7d-0e7a-488d-95a2-72f06ef4827a None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:39.475423 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:39.489277 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 456/894] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:39.512645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f710f30-b4fc-469a-9b1d-76d7c7614a6b None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:39.519944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a645cde-99d9-4729-8650-18e4e89016b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:39.520874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a645cde-99d9-4729-8650-18e4e89016b3 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:39.521439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a645cde-99d9-4729-8650-18e4e89016b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:39.522353 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a645cde-99d9-4729-8650-18e4e89016b3 None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:39.523267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a645cde-99d9-4729-8650-18e4e89016b3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:39.523776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a645cde-99d9-4729-8650-18e4e89016b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:39.525996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a645cde-99d9-4729-8650-18e4e89016b3 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:39.533760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 439/895] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:39.542694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a645cde-99d9-4729-8650-18e4e89016b3 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:39.552426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:39.641352 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f710f30-b4fc-469a-9b1d-76d7c7614a6b None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:39.667299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a645cde-99d9-4729-8650-18e4e89016b3 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:39.676974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc6fe1-7d8a-4666-af05-e36e1cb91dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:39.677690 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc6fe1-7d8a-4666-af05-e36e1cb91dfe None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:39.677979 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc6fe1-7d8a-4666-af05-e36e1cb91dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:39.678258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc6fe1-7d8a-4666-af05-e36e1cb91dfe None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:39.678974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc6fe1-7d8a-4666-af05-e36e1cb91dfe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:39.680338 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc6fe1-7d8a-4666-af05-e36e1cb91dfe None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:39.701774 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9402e-ed2b-4e62-927b-30cb535efde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:39.702419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9402e-ed2b-4e62-927b-30cb535efde3 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:39.702720 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9402e-ed2b-4e62-927b-30cb535efde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:39.702975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9402e-ed2b-4e62-927b-30cb535efde3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:39.703749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9402e-ed2b-4e62-927b-30cb535efde3 None admin] RBAC: Adding query filter params (interface=public, service_id=7d5a79379cbc40208448a048cd7dcea8, region_id=RegionOne) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:39.704057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9402e-ed2b-4e62-927b-30cb535efde3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:39.705496 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9402e-ed2b-4e62-927b-30cb535efde3 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:39.710551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 440/896] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jun 16 14:44:39 2022] GET /identity/v3/endpoints?service_id=7d5a79379cbc40208448a048cd7dcea8&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:39.711761 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e63ef-1e74-4fa4-ad7b-4634a816cb96 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:39.712045 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e63ef-1e74-4fa4-ad7b-4634a816cb96 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:39.712321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e63ef-1e74-4fa4-ad7b-4634a816cb96 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:39.717185 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 441/897] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:39.717185 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e63ef-1e74-4fa4-ad7b-4634a816cb96 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:39.749551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:39.754272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 457/898] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 16 14:44:39 2022] POST /identity/v3/services => generated 241 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:44:39.755744 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092db3a-518f-46ac-9561-abd3a7147cce None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:39.756090 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092db3a-518f-46ac-9561-abd3a7147cce None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:39.756372 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092db3a-518f-46ac-9561-abd3a7147cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:39.777582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-b092db3a-518f-46ac-9561-abd3a7147cce None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:39.778917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b092db3a-518f-46ac-9561-abd3a7147cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:39.865092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e63ef-1e74-4fa4-ad7b-4634a816cb96 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:39.867666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 458/899] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:39.897193 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092db3a-518f-46ac-9561-abd3a7147cce None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:39.915589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fde8cf-c51a-474c-9145-fc6c81fe6631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:39.916379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fde8cf-c51a-474c-9145-fc6c81fe6631 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:39.916672 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fde8cf-c51a-474c-9145-fc6c81fe6631 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:39.916960 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fde8cf-c51a-474c-9145-fc6c81fe6631 None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:39.918380 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fde8cf-c51a-474c-9145-fc6c81fe6631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:39.920017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fde8cf-c51a-474c-9145-fc6c81fe6631 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:39.922295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:39.929519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 442/900] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 16 14:44:39 2022] GET /identity/v3/services => generated 1497 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:44:40.044586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092db3a-518f-46ac-9561-abd3a7147cce None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:40.083932 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859326a-eff6-40d7-ac74-fd28d2c8899a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:40.085164 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859326a-eff6-40d7-ac74-fd28d2c8899a None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:40.085680 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859326a-eff6-40d7-ac74-fd28d2c8899a None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:40.086152 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859326a-eff6-40d7-ac74-fd28d2c8899a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:40.098285 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859326a-eff6-40d7-ac74-fd28d2c8899a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:40.106953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-8859326a-eff6-40d7-ac74-fd28d2c8899a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:40.106953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:40.106953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:40.106953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:40.106953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:40.106953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:40.106953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:40.106953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:40.106953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:40.106953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:40.106953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:40.106953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:40.106953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:40.106953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:40.106953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:40.106953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:40.107894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:40.107894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:40.107894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:40.107894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:40.107894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:40.107894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:40.107894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:40.107894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:40.107894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:40.107894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:40.107894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:40.107894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:40.107894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:40.107894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:40.107894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:40.107894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:40.108711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:40.108711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:40.108711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:40.108711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:40.108711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:40.108711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:40.108711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:40.108711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:40.108711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:40.108711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:40.108711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:40.108711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:40.112121 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 459/901] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jun 16 14:44:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:40.117785 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fde8cf-c51a-474c-9145-fc6c81fe6631 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:40.219159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:40.230100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fde8cf-c51a-474c-9145-fc6c81fe6631 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:40.264948 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f2c4b-64c8-4b33-9312-47189b94a07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:40.265699 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f2c4b-64c8-4b33-9312-47189b94a07b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:40.265987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f2c4b-64c8-4b33-9312-47189b94a07b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:40.266265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f2c4b-64c8-4b33-9312-47189b94a07b None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:40.267030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f2c4b-64c8-4b33-9312-47189b94a07b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:40.267344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f2c4b-64c8-4b33-9312-47189b94a07b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:40.268708 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f2c4b-64c8-4b33-9312-47189b94a07b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:40.277316 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 443/902] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jun 16 14:44:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:40.283442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859326a-eff6-40d7-ac74-fd28d2c8899a None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:40.369337 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05196501-8c7c-49f5-9b2e-6ba930961ecb None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:40.369631 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05196501-8c7c-49f5-9b2e-6ba930961ecb None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:40.369919 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05196501-8c7c-49f5-9b2e-6ba930961ecb None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:40.371535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 444/903] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:40.373779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:40.376548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231b2ab-52ef-4484-af77-618d970a7eb0 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:40.376846 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231b2ab-52ef-4484-af77-618d970a7eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:40.377155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231b2ab-52ef-4484-af77-618d970a7eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:40.393820 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-5231b2ab-52ef-4484-af77-618d970a7eb0 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:40.395378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-5231b2ab-52ef-4484-af77-618d970a7eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:40.397834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859326a-eff6-40d7-ac74-fd28d2c8899a None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:40.438429 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b28da-ee46-4bb6-86ed-924b91ffe900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:40.439798 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b28da-ee46-4bb6-86ed-924b91ffe900 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:40.440087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b28da-ee46-4bb6-86ed-924b91ffe900 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:40.440424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b28da-ee46-4bb6-86ed-924b91ffe900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:40.452061 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b28da-ee46-4bb6-86ed-924b91ffe900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:40.453569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965b28da-ee46-4bb6-86ed-924b91ffe900 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:40.472091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-965b28da-ee46-4bb6-86ed-924b91ffe900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:40.472091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:40.472091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:40.472091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:40.472091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:40.472091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:40.472091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:40.472091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:40.472091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:40.472091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:40.472091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:40.472091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:40.472091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:40.472091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:40.472091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:40.473074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:40.474079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:40.474079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:40.474079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:40.474079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:40.477464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 460/904] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:40.479078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b28da-ee46-4bb6-86ed-924b91ffe900 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:40.479340 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 445/905] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:40.507370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231b2ab-52ef-4484-af77-618d970a7eb0 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:40.588576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b28da-ee46-4bb6-86ed-924b91ffe900 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:40.605926 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:40.620891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:40.627422 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39f82c-511b-44e6-9774-57e165aa3434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:40.628057 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39f82c-511b-44e6-9774-57e165aa3434 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:40.628340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39f82c-511b-44e6-9774-57e165aa3434 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:40.628614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39f82c-511b-44e6-9774-57e165aa3434 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:40.629353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39f82c-511b-44e6-9774-57e165aa3434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:40.629659 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39f82c-511b-44e6-9774-57e165aa3434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:40.631059 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39f82c-511b-44e6-9774-57e165aa3434 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:40.632864 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231b2ab-52ef-4484-af77-618d970a7eb0 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:40.648703 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 461/906] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:40.650330 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39f82c-511b-44e6-9774-57e165aa3434 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:40.677893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d54a1-42a4-4c1e-917a-5e1f8eb8be07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:40.678865 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d54a1-42a4-4c1e-917a-5e1f8eb8be07 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:40.679157 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d54a1-42a4-4c1e-917a-5e1f8eb8be07 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:40.679437 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d54a1-42a4-4c1e-917a-5e1f8eb8be07 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:40.680095 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d54a1-42a4-4c1e-917a-5e1f8eb8be07 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:40.681800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d54a1-42a4-4c1e-917a-5e1f8eb8be07 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-f31d54a1-42a4-4c1e-917a-5e1f8eb8be07 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:40.694508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:40.695560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:40.695560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:40.695560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:40.695560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:40.695560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:40.695560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:40.695560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:40.695560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:40.695560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:40.695560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:40.695560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:40.695560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:40.695560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:40.695560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:40.695560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:40.695560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:40.696419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:40.696419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:40.696419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:40.696419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:40.696419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:40.696419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:40.696419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:40.696419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:40.696419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:40.696419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:40.696419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:40.696419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:40.696419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 14:44:40.696419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:40.701598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 446/907] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:44:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:40.701733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d54a1-42a4-4c1e-917a-5e1f8eb8be07 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:40.778859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39f82c-511b-44e6-9774-57e165aa3434 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:40.815149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ef87f-3a52-45c9-8b31-ce0109222aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:40.815977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ef87f-3a52-45c9-8b31-ce0109222aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:40.816359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ef87f-3a52-45c9-8b31-ce0109222aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:40.816641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ef87f-3a52-45c9-8b31-ce0109222aa0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:40.824411 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ef87f-3a52-45c9-8b31-ce0109222aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:40.826338 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ef87f-3a52-45c9-8b31-ce0109222aa0 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:40.828600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d54a1-42a4-4c1e-917a-5e1f8eb8be07 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:40.842669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-d86ef87f-3a52-45c9-8b31-ce0109222aa0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:44:40.842669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:40.842669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:40.842669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:40.842669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:40.842669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:40.842669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:40.842669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:40.842669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:40.842669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:40.842669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:40.842669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:40.842669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:40.842669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:40.842669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:40.842669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:40.843634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:40.844747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:40.844747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:40.844747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:40.844747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:40.844747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:40.844747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:40.844747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:40.844747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:40.844747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:44:40.844747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:40.844747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 462/908] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 16 14:44:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:40.851066 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ef87f-3a52-45c9-8b31-ce0109222aa0 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:40.869905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374705e8-600e-4086-8b36-273b55325bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:40.870964 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374705e8-600e-4086-8b36-273b55325bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:40.871519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374705e8-600e-4086-8b36-273b55325bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:40.872012 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374705e8-600e-4086-8b36-273b55325bb7 None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:40.872902 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374705e8-600e-4086-8b36-273b55325bb7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:40.873455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374705e8-600e-4086-8b36-273b55325bb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:40.875118 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374705e8-600e-4086-8b36-273b55325bb7 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:40.885447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 447/909] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:44:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:40.887039 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374705e8-600e-4086-8b36-273b55325bb7 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:40.899726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:40.905292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:40.957456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ef87f-3a52-45c9-8b31-ce0109222aa0 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:40.999154 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d14b5-c158-4591-8bec-6e7d2608b417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:40.999830 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d14b5-c158-4591-8bec-6e7d2608b417 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:41.000115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d14b5-c158-4591-8bec-6e7d2608b417 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:41.000447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d14b5-c158-4591-8bec-6e7d2608b417 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:41.001343 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d14b5-c158-4591-8bec-6e7d2608b417 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:41.001690 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d14b5-c158-4591-8bec-6e7d2608b417 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:41.002983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374705e8-600e-4086-8b36-273b55325bb7 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:41.003431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d14b5-c158-4591-8bec-6e7d2608b417 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:41.028381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 463/910] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jun 16 14:44:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:41.029515 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d14b5-c158-4591-8bec-6e7d2608b417 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:41.047258 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7980eab-5b11-4929-a0e6-28e56cc6b24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:41.047939 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7980eab-5b11-4929-a0e6-28e56cc6b24f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:41.048229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7980eab-5b11-4929-a0e6-28e56cc6b24f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:41.049059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7980eab-5b11-4929-a0e6-28e56cc6b24f None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:41.049856 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7980eab-5b11-4929-a0e6-28e56cc6b24f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:41.050175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7980eab-5b11-4929-a0e6-28e56cc6b24f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:41.052157 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7980eab-5b11-4929-a0e6-28e56cc6b24f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:41.062770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 448/911] 10.222.0.23 () {56 vars in 1114 bytes} [Thu Jun 16 14:44:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:41.064325 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7980eab-5b11-4929-a0e6-28e56cc6b24f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:41.150797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d14b5-c158-4591-8bec-6e7d2608b417 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:41.157098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:41.161473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:41.181290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7980eab-5b11-4929-a0e6-28e56cc6b24f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:41.194296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50458c45-e395-43f5-a6e0-90bf9c50cb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:41.195203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50458c45-e395-43f5-a6e0-90bf9c50cb75 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:41.195786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50458c45-e395-43f5-a6e0-90bf9c50cb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:41.196260 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50458c45-e395-43f5-a6e0-90bf9c50cb75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:41.216807 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a419d-06d6-46c1-bf27-28511a2a93f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:41.217724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a419d-06d6-46c1-bf27-28511a2a93f9 None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:41.218083 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a419d-06d6-46c1-bf27-28511a2a93f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:41.218417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a419d-06d6-46c1-bf27-28511a2a93f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:41.219261 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a419d-06d6-46c1-bf27-28511a2a93f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:41.221353 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a419d-06d6-46c1-bf27-28511a2a93f9 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:41.274478 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50458c45-e395-43f5-a6e0-90bf9c50cb75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:41.275996 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50458c45-e395-43f5-a6e0-90bf9c50cb75 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:41.297503 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 449/912] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 16 14:44:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:41.410765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 464/913] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:41 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:44:41.416513 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a419d-06d6-46c1-bf27-28511a2a93f9 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:41.536677 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a419d-06d6-46c1-bf27-28511a2a93f9 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:41.563223 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:41.571990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69012cff-34fc-46b3-860a-9905496cbc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:41.572794 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69012cff-34fc-46b3-860a-9905496cbc1f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:41.573076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69012cff-34fc-46b3-860a-9905496cbc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:41.573382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69012cff-34fc-46b3-860a-9905496cbc1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:41.585628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69012cff-34fc-46b3-860a-9905496cbc1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:41.587082 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69012cff-34fc-46b3-860a-9905496cbc1f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:41.605175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-69012cff-34fc-46b3-860a-9905496cbc1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:41.605175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:41.605175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:41.605175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:41.605175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:41.605175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:41.605175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:41.605175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:41.605175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:41.605175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:41.605175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:41.605175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:41.605175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:41.605175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:41.605175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:41.606154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:41.607031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:41.607031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:41.607031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:41.607031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:41.607031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 450/914] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:41.612688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50458c45-e395-43f5-a6e0-90bf9c50cb75 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:41.623333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:41.717315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50458c45-e395-43f5-a6e0-90bf9c50cb75 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:41.753002 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150132fa-533a-40cd-b8b0-d21e0e0a693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:41.753694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150132fa-533a-40cd-b8b0-d21e0e0a693c None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:41.753976 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150132fa-533a-40cd-b8b0-d21e0e0a693c None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:41.754251 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150132fa-533a-40cd-b8b0-d21e0e0a693c None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:41.754965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150132fa-533a-40cd-b8b0-d21e0e0a693c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:41.755271 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150132fa-533a-40cd-b8b0-d21e0e0a693c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:41.756700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150132fa-533a-40cd-b8b0-d21e0e0a693c None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:41.768913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 465/915] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:41.774739 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69012cff-34fc-46b3-860a-9905496cbc1f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:41.877891 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69012cff-34fc-46b3-860a-9905496cbc1f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:41.912654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d28cc-5218-4119-aef1-0d459ac6e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:41.913535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d28cc-5218-4119-aef1-0d459ac6e41a None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:41.913854 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d28cc-5218-4119-aef1-0d459ac6e41a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:41.914143 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d28cc-5218-4119-aef1-0d459ac6e41a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:41.920959 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d28cc-5218-4119-aef1-0d459ac6e41a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:41.922424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d28cc-5218-4119-aef1-0d459ac6e41a None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:41.936775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-fa0d28cc-5218-4119-aef1-0d459ac6e41a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:41.936775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:41.936775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:41.936775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:41.936775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:41.936775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:41.936775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:41.936775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:41.936775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:41.936775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:41.936775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:41.936775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:41.936775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:41.936775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:41.936775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:41.937717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:41.938609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:41.938609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:41.938609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:41.938609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:41.938609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:41.938609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:41.938609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:41.938609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:41.938609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 451/916] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:41.944494 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150132fa-533a-40cd-b8b0-d21e0e0a693c None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:42.025677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:42.053781 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150132fa-533a-40cd-b8b0-d21e0e0a693c None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:42.089625 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5541af-8f1d-4525-b788-4cc0c14b2c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:42.090298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5541af-8f1d-4525-b788-4cc0c14b2c9d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:42.090581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5541af-8f1d-4525-b788-4cc0c14b2c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:42.090857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5541af-8f1d-4525-b788-4cc0c14b2c9d None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:42.091645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5541af-8f1d-4525-b788-4cc0c14b2c9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:42.091953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5541af-8f1d-4525-b788-4cc0c14b2c9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:42.094624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e5e0b-989d-44ff-aa44-7143ce457f5b None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:42.095086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e5e0b-989d-44ff-aa44-7143ce457f5b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:42.095177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e5e0b-989d-44ff-aa44-7143ce457f5b None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:42.097191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 452/917] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:42.097710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5541af-8f1d-4525-b788-4cc0c14b2c9d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:42.103054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcf4a5-1637-4424-ba03-2fbc15cd08b8 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:42.103357 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcf4a5-1637-4424-ba03-2fbc15cd08b8 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:42.103614 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcf4a5-1637-4424-ba03-2fbc15cd08b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:42.112762 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 466/918] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:42.119022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5541af-8f1d-4525-b788-4cc0c14b2c9d None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:42.122785 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-93fcf4a5-1637-4424-ba03-2fbc15cd08b8 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:42.124038 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-93fcf4a5-1637-4424-ba03-2fbc15cd08b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:42.161598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:42.213298 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 453/919] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:42.215241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194559a-9ee5-4d14-af3f-10d65a85a281 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:42.215532 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194559a-9ee5-4d14-af3f-10d65a85a281 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:42.215945 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194559a-9ee5-4d14-af3f-10d65a85a281 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:42.217950 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 454/920] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:42.224217 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8746b-fa1f-493a-8c06-786ff5d6ccda None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:42.224501 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8746b-fa1f-493a-8c06-786ff5d6ccda None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:42.224779 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8746b-fa1f-493a-8c06-786ff5d6ccda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:42.231264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5541af-8f1d-4525-b788-4cc0c14b2c9d None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:42.242130 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-f7f8746b-fa1f-493a-8c06-786ff5d6ccda None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:42.243317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f7f8746b-fa1f-493a-8c06-786ff5d6ccda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:42.260700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:42.269173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d666d0-cc3c-4729-a428-f3645b225223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:42.270114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d666d0-cc3c-4729-a428-f3645b225223 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:42.273301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d666d0-cc3c-4729-a428-f3645b225223 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:42.273301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d666d0-cc3c-4729-a428-f3645b225223 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:42.273301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d666d0-cc3c-4729-a428-f3645b225223 None admin] RBAC: Adding query filter params (role.id=53ff5be561de46ca931c143cf800c0f7, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=c1e11e5614c64b87a892740f39e8fc5b) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:42.273301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d666d0-cc3c-4729-a428-f3645b225223 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:42.274206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d666d0-cc3c-4729-a428-f3645b225223 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:42.280049 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 467/921] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:42 2022] GET /identity/v3/role_assignments?user.id=c1e11e5614c64b87a892740f39e8fc5b&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=53ff5be561de46ca931c143cf800c0f7 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:42.280971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d666d0-cc3c-4729-a428-f3645b225223 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:42.321834 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 455/922] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:42.346809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8746b-fa1f-493a-8c06-786ff5d6ccda None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:42.413029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d666d0-cc3c-4729-a428-f3645b225223 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:42.453321 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13621c8-1c1d-491b-9a8b-ae150860b492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:42.454078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13621c8-1c1d-491b-9a8b-ae150860b492 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:42.454466 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13621c8-1c1d-491b-9a8b-ae150860b492 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:42.455494 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13621c8-1c1d-491b-9a8b-ae150860b492 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:42.456219 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13621c8-1c1d-491b-9a8b-ae150860b492 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:42.457834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13621c8-1c1d-491b-9a8b-ae150860b492 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:42.463543 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:42.467656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8746b-fa1f-493a-8c06-786ff5d6ccda None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-e13621c8-1c1d-491b-9a8b-ae150860b492 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:42.472858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:42.480018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:42.480018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:42.480018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:42.480018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:42.480018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:42.480018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:42.480018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:42.480018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:42.480018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:42.480018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:42.480018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:42.480018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:42.480018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:42.480018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:42.480018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:42.480018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:42.480877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:42.480877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:42.480877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:42.480877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:42.480877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:42.480877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:42.480877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:42.480877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:42.480877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:42.480877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:42.480877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:42.480877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:42.480877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:42.480877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:42.480877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 468/923] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:42.484616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13621c8-1c1d-491b-9a8b-ae150860b492 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:42.512293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afde02-8a96-4ed1-a8e6-aec13a8d9e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:42.513118 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afde02-8a96-4ed1-a8e6-aec13a8d9e41 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:42.513437 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afde02-8a96-4ed1-a8e6-aec13a8d9e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:42.513718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afde02-8a96-4ed1-a8e6-aec13a8d9e41 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:42.514670 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afde02-8a96-4ed1-a8e6-aec13a8d9e41 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:42.516968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afde02-8a96-4ed1-a8e6-aec13a8d9e41 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:42.534780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-17afde02-8a96-4ed1-a8e6-aec13a8d9e41 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:44:42.534780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:42.534780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:42.534780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:42.534780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:42.534780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:42.534780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:42.534780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:42.534780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:44:42.534780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:42.534780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:42.534780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:42.534780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:42.534780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:42.534780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:42.534780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:42.535887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:42.535887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:42.535887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:42.535887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:42.535887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:42.535887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:42.535887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:42.535887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:42.535887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:42.535887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:42.535887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:42.535887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:42.535887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:42.535887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:42.535887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:42.535887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:42.537188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:42.537188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:42.537188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:42.537188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:42.537188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:42.537188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:42.537188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:42.537188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:42.537188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:42.537188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:42.537188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:42.537188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:42.537188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:42.537188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 14:44:42.537188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:42.541875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 456/924] 10.222.0.23 () {56 vars in 1132 bytes} [Thu Jun 16 14:44:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:42.542859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afde02-8a96-4ed1-a8e6-aec13a8d9e41 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:42.558666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:42.616969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13621c8-1c1d-491b-9a8b-ae150860b492 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:42.661417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2d45b-dede-4bf6-88b9-a3bd077d9c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:42.662088 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2d45b-dede-4bf6-88b9-a3bd077d9c40 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:42.662373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2d45b-dede-4bf6-88b9-a3bd077d9c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:42.662652 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2d45b-dede-4bf6-88b9-a3bd077d9c40 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:42.663412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2d45b-dede-4bf6-88b9-a3bd077d9c40 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:42.663669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2d45b-dede-4bf6-88b9-a3bd077d9c40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:42.665047 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce2d45b-dede-4bf6-88b9-a3bd077d9c40 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:42.670613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afde02-8a96-4ed1-a8e6-aec13a8d9e41 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:42.678701 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 469/925] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:42.679721 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2d45b-dede-4bf6-88b9-a3bd077d9c40 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:42.711449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50e57b-c1c7-4d5e-826a-13e52fd1ec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:42.712155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50e57b-c1c7-4d5e-826a-13e52fd1ec60 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:42.712442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50e57b-c1c7-4d5e-826a-13e52fd1ec60 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:42.712720 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50e57b-c1c7-4d5e-826a-13e52fd1ec60 None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:42.713470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50e57b-c1c7-4d5e-826a-13e52fd1ec60 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:42.714076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50e57b-c1c7-4d5e-826a-13e52fd1ec60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:42.715152 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50e57b-c1c7-4d5e-826a-13e52fd1ec60 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:42.720975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 457/926] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:42.726134 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50e57b-c1c7-4d5e-826a-13e52fd1ec60 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:42.756680 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:42.814909 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2d45b-dede-4bf6-88b9-a3bd077d9c40 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:42.842867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:42.844233 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50e57b-c1c7-4d5e-826a-13e52fd1ec60 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:42.862358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ec987-efb2-4a36-b492-b225f920ca29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:42.863686 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ec987-efb2-4a36-b492-b225f920ca29 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:42.864133 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ec987-efb2-4a36-b492-b225f920ca29 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:42.864570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ec987-efb2-4a36-b492-b225f920ca29 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:42.866280 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ec987-efb2-4a36-b492-b225f920ca29 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:42.866835 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ec987-efb2-4a36-b492-b225f920ca29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:42.868987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ec987-efb2-4a36-b492-b225f920ca29 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:42.881205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 470/927] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:42.882849 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ec987-efb2-4a36-b492-b225f920ca29 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:42.890127 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2e061-a2ee-4f76-b740-fd0a93da59b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:42.891056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2e061-a2ee-4f76-b740-fd0a93da59b0 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:42.891576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2e061-a2ee-4f76-b740-fd0a93da59b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:42.892059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2e061-a2ee-4f76-b740-fd0a93da59b0 None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:42.893961 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2e061-a2ee-4f76-b740-fd0a93da59b0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:42.894495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2e061-a2ee-4f76-b740-fd0a93da59b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:42.896444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2e061-a2ee-4f76-b740-fd0a93da59b0 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:42.906396 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 458/928] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:42.914574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2e061-a2ee-4f76-b740-fd0a93da59b0 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:43.005878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ec987-efb2-4a36-b492-b225f920ca29 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:43.019441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:43.029809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2e061-a2ee-4f76-b740-fd0a93da59b0 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:43.043121 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c224030-51f8-42ca-b5c4-29698691a014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:43.043869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c224030-51f8-42ca-b5c4-29698691a014 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:43.044127 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c224030-51f8-42ca-b5c4-29698691a014 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:43.044409 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c224030-51f8-42ca-b5c4-29698691a014 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:43.045245 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c224030-51f8-42ca-b5c4-29698691a014 None admin] RBAC: Adding query filter params (interface=public, service_id=25a6d4e0ed13457fbd2a236eb1cf21d5, region_id=RegionOne) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:43.045563 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c224030-51f8-42ca-b5c4-29698691a014 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:43.046952 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c224030-51f8-42ca-b5c4-29698691a014 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:43.053175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 471/929] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jun 16 14:44:42 2022] GET /identity/v3/endpoints?service_id=25a6d4e0ed13457fbd2a236eb1cf21d5&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:43.058534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c224030-51f8-42ca-b5c4-29698691a014 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:43.078371 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908382a-8c7b-43b3-9b85-e424d5a57363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:43.080987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908382a-8c7b-43b3-9b85-e424d5a57363 None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:43.081517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908382a-8c7b-43b3-9b85-e424d5a57363 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:43.081802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908382a-8c7b-43b3-9b85-e424d5a57363 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:43.082551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908382a-8c7b-43b3-9b85-e424d5a57363 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:43.084893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908382a-8c7b-43b3-9b85-e424d5a57363 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:43.120958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:43.171674 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c224030-51f8-42ca-b5c4-29698691a014 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:43.201104 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 459/930] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 16 14:44:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:43.231619 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d914d-93d1-411e-8709-015add7bad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:43.232854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d914d-93d1-411e-8709-015add7bad18 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:43.233485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d914d-93d1-411e-8709-015add7bad18 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:43.233967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d914d-93d1-411e-8709-015add7bad18 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:43.235037 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d914d-93d1-411e-8709-015add7bad18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:43.236812 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d914d-93d1-411e-8709-015add7bad18 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:43.244901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 472/931] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 16 14:44:43 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:44:43.622379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c919d6-1d9c-44d1-8deb-9828ee5cbb28 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:43.622782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c919d6-1d9c-44d1-8deb-9828ee5cbb28 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:43.622962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c919d6-1d9c-44d1-8deb-9828ee5cbb28 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:43.624447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 460/932] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:43.630451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced412c-0600-4185-bb97-b58fb339ab80 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:43.630968 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced412c-0600-4185-bb97-b58fb339ab80 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:43.631459 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced412c-0600-4185-bb97-b58fb339ab80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:43.649317 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-2ced412c-0600-4185-bb97-b58fb339ab80 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:43.650817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2ced412c-0600-4185-bb97-b58fb339ab80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:43.720546 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 473/933] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:43.744776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c919d6-1d9c-44d1-8deb-9828ee5cbb28 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:43.860846 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c919d6-1d9c-44d1-8deb-9828ee5cbb28 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:43.896465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55199cfd-f712-4a4f-a843-6c994aa2b76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:43.897103 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55199cfd-f712-4a4f-a843-6c994aa2b76b None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:43.897418 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55199cfd-f712-4a4f-a843-6c994aa2b76b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:43.897697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55199cfd-f712-4a4f-a843-6c994aa2b76b None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:43.898463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55199cfd-f712-4a4f-a843-6c994aa2b76b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:43.899954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55199cfd-f712-4a4f-a843-6c994aa2b76b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:43.901402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: WARNING keystone.server.flask.common [None req-55199cfd-f712-4a4f-a843-6c994aa2b76b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 14:44:43.947005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.sql.core [None req-55199cfd-f712-4a4f-a843-6c994aa2b76b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 14:44:43.947005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 14:44:43.947005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [parameters: {'id': '85b79ee793784076a5a98e28829477cf', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 14:44:43.947005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80273) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 14:44:43.974319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-55199cfd-f712-4a4f-a843-6c994aa2b76b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 85b79ee793784076a5a98e28829477cf.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 85b79ee793784076a5a98e28829477cf. Jun 16 14:44:43.974319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:43.974319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:44:43.974319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:44:43.974319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:44:43.974319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:44:43.974319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:44:43.974319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:44:43.974319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:44:43.974319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:44:43.974319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:44:43.974319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:44:43.974319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application result.read() Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 16 14:44:43.975191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application yield resource Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise self.value Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application session.commit() Jun 16 14:44:43.976601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self.session.flush() Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application compat.raise_( Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 14:44:43.977514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 14:44:43.978393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 14:44:43.978393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 14:44:43.978393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 14:44:43.978393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 14:44:43.978393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 14:44:43.978393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 14:44:43.978393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 14:44:43.978393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 14:44:43.978393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 14:44:43.978393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 14:44:43.978393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 14:44:43.978393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 14:44:43.978393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 14:44:43.978393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 14:44:43.978393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application result.read() Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:44:43.979247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:44:43.980096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:44:43.980096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:44:43.980096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:44:43.980096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:44:43.980096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:44:43.980096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:44:43.980096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 14:44:43.980096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 14:44:43.980096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [parameters: {'id': '85b79ee793784076a5a98e28829477cf', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 14:44:43.980096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 14:44:43.980096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:43.980096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:43.980096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:43.980096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:43.980096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:43.980859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:43.983809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:43.983809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 16 14:44:43.983809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 16 14:44:43.983809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:43.983809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:43.983809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 16 14:44:43.983809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 16 14:44:43.983809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 85b79ee793784076a5a98e28829477cf. Jun 16 14:44:43.983809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:43.987400 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 461/934] 10.222.0.23 () {60 vars in 1140 bytes} [Thu Jun 16 14:44:43 2022] POST /identity/v3/projects => generated 262 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:43.993537 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced412c-0600-4185-bb97-b58fb339ab80 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:44.038486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:44.100088 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced412c-0600-4185-bb97-b58fb339ab80 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:44.139876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c981f-c5fe-4d9c-9a24-05884841aa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:44.140689 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c981f-c5fe-4d9c-9a24-05884841aa05 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:44.140983 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c981f-c5fe-4d9c-9a24-05884841aa05 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:44.141290 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c981f-c5fe-4d9c-9a24-05884841aa05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:44.150583 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c981f-c5fe-4d9c-9a24-05884841aa05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:44.151990 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c981f-c5fe-4d9c-9a24-05884841aa05 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:44.166346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-ad9c981f-c5fe-4d9c-9a24-05884841aa05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:44.166346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:44.166346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:44.166346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:44.166346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:44.166346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:44.166346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:44.166346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:44.166346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:44.166346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:44.166346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:44.166346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:44.166346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:44.166346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:44.166346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:44.167248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:44.168125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:44.168125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:44.168125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:44.168125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:44.168125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:44.168125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:44.168125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:44.168125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:44.168125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 474/935] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:44.175377 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55199cfd-f712-4a4f-a843-6c994aa2b76b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:44.180935 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:44.287230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55199cfd-f712-4a4f-a843-6c994aa2b76b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:44.323620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e370077-6338-4c4b-be16-34655f89e399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:44.324615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e370077-6338-4c4b-be16-34655f89e399 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:44.325101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e370077-6338-4c4b-be16-34655f89e399 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:44.325630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e370077-6338-4c4b-be16-34655f89e399 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:44.327109 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e370077-6338-4c4b-be16-34655f89e399 None admin] RBAC: Adding query filter params (name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:44.327656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e370077-6338-4c4b-be16-34655f89e399 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:44.329549 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e370077-6338-4c4b-be16-34655f89e399 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:44.350680 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 462/936] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:44.445780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3f21d-14df-45b4-a091-e206868637b7 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:44.446137 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3f21d-14df-45b4-a091-e206868637b7 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:44.446347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3f21d-14df-45b4-a091-e206868637b7 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:44.448039 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 475/937] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:44.453855 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a412d01-7f3f-4a47-ae3a-0e773e127fa2 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:44.454140 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a412d01-7f3f-4a47-ae3a-0e773e127fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:44.454426 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a412d01-7f3f-4a47-ae3a-0e773e127fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:44.474860 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-7a412d01-7f3f-4a47-ae3a-0e773e127fa2 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:44.476420 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-7a412d01-7f3f-4a47-ae3a-0e773e127fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:44.546851 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:44.558842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 463/938] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:44.582149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3f21d-14df-45b4-a091-e206868637b7 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:44.686218 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:44.691639 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3f21d-14df-45b4-a091-e206868637b7 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:44.726989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b693fcb-b6d3-43f5-b20d-ba029f140d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:44.727815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b693fcb-b6d3-43f5-b20d-ba029f140d07 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:44.728101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b693fcb-b6d3-43f5-b20d-ba029f140d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:44.728376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b693fcb-b6d3-43f5-b20d-ba029f140d07 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:44.738986 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b693fcb-b6d3-43f5-b20d-ba029f140d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:44.747482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-3b693fcb-b6d3-43f5-b20d-ba029f140d07 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:44.747482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:44.747482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:44.747482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:44.747482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:44.747482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:44.747482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:44.747482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:44.747482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:44.747482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:44.747482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:44.747482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:44.747482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:44.747482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:44.747482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:44.747482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:44.748447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:44.748447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:44.748447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:44.748447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:44.748447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:44.748447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:44.748447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:44.748447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:44.748447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:44.748447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:44.748447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:44.748447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:44.748447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:44.748447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:44.748447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:44.748447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:44.749298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:44.749298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:44.749298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:44.749298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:44.749298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:44.749298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:44.749298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:44.749298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:44.749298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:44.749298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:44.749298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:44.749298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:44.753252 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 476/939] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jun 16 14:44:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:44.755800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a412d01-7f3f-4a47-ae3a-0e773e127fa2 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:44.862868 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a412d01-7f3f-4a47-ae3a-0e773e127fa2 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:44.899129 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cccfa-59e5-4a3c-85a6-b36063ab54a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:44.900151 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cccfa-59e5-4a3c-85a6-b36063ab54a4 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:44.900660 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cccfa-59e5-4a3c-85a6-b36063ab54a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:44.901179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cccfa-59e5-4a3c-85a6-b36063ab54a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:44.902139 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cccfa-59e5-4a3c-85a6-b36063ab54a4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:44.902656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cccfa-59e5-4a3c-85a6-b36063ab54a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:44.904220 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cccfa-59e5-4a3c-85a6-b36063ab54a4 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:44.914012 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 464/940] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jun 16 14:44:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:44.921537 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b693fcb-b6d3-43f5-b20d-ba029f140d07 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:45.045573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b693fcb-b6d3-43f5-b20d-ba029f140d07 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:45.081978 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5af748-1def-4551-ae09-881230c9b9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:45.083148 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5af748-1def-4551-ae09-881230c9b9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:45.083655 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5af748-1def-4551-ae09-881230c9b9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:45.084131 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5af748-1def-4551-ae09-881230c9b9a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:45.095816 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5af748-1def-4551-ae09-881230c9b9a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:45.097672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5af748-1def-4551-ae09-881230c9b9a1 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:45.116116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-fd5af748-1def-4551-ae09-881230c9b9a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:45.116116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:45.116116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:45.116116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:45.116116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:45.116116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:45.116116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:45.116116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:45.116116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:45.116116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:45.116116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:45.116116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:45.116116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:45.116116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:45.116116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:45.117041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:45.117993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:45.117993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:45.117993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:45.117993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:45.120240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 477/941] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:45.125819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cccfa-59e5-4a3c-85a6-b36063ab54a4 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:45.191414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:45.240355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cccfa-59e5-4a3c-85a6-b36063ab54a4 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:45.276101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8ab43-50a0-4a2a-9141-8c02ae8767df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:45.277180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ab43-50a0-4a2a-9141-8c02ae8767df None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:45.277672 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ab43-50a0-4a2a-9141-8c02ae8767df None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:45.278191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ab43-50a0-4a2a-9141-8c02ae8767df None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:45.279140 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8ab43-50a0-4a2a-9141-8c02ae8767df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:45.279649 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8ab43-50a0-4a2a-9141-8c02ae8767df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:45.281239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8ab43-50a0-4a2a-9141-8c02ae8767df None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:45.295370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 465/942] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:45.305264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5af748-1def-4551-ae09-881230c9b9a1 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:45.314966 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:45.411792 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5af748-1def-4551-ae09-881230c9b9a1 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:45.454125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0136a5-9d5b-4eb6-abfa-7b6168f7f0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:45.456093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0136a5-9d5b-4eb6-abfa-7b6168f7f0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:45.456595 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0136a5-9d5b-4eb6-abfa-7b6168f7f0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:45.457085 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0136a5-9d5b-4eb6-abfa-7b6168f7f0e3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:45.465815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0136a5-9d5b-4eb6-abfa-7b6168f7f0e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:45.467544 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0136a5-9d5b-4eb6-abfa-7b6168f7f0e3 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:45.474659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca697d-a0e7-495d-b381-e1252ef748dd None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:45.474953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca697d-a0e7-495d-b381-e1252ef748dd None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:45.475234 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca697d-a0e7-495d-b381-e1252ef748dd None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:45.476832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 466/943] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:45.481615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48d929-0017-4255-862f-ddcb7c3f4109 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:45.481903 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48d929-0017-4255-862f-ddcb7c3f4109 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:45.482182 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48d929-0017-4255-862f-ddcb7c3f4109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:45.484985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-6d0136a5-9d5b-4eb6-abfa-7b6168f7f0e3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:44:45.484985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:45.484985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:45.484985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:45.484985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:45.484985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:45.484985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:45.484985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:45.484985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:45.484985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:45.484985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:45.484985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:45.484985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:45.484985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:45.484985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:45.484985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:45.486109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:45.487070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:45.487070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:45.487070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:45.487070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:45.487070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:45.487070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:45.487070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:45.487070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:45.487070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:44:45.487070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:45.492963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 478/944] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 16 14:44:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:45.494492 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614cfd6-6e0d-4ba0-a77e-5ba68e83de28 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:45.494917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614cfd6-6e0d-4ba0-a77e-5ba68e83de28 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:45.495202 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614cfd6-6e0d-4ba0-a77e-5ba68e83de28 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:45.496743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 479/945] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:45.497584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614cfd6-6e0d-4ba0-a77e-5ba68e83de28 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:45.501443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-ca48d929-0017-4255-862f-ddcb7c3f4109 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:45.503177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ca48d929-0017-4255-862f-ddcb7c3f4109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:45.574215 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 467/946] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:45.575879 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cea447-8c4c-44f9-8706-18285daca644 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:45.576235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cea447-8c4c-44f9-8706-18285daca644 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:45.576585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cea447-8c4c-44f9-8706-18285daca644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:45.581877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:45.596533 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-b7cea447-8c4c-44f9-8706-18285daca644 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:45.599600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b7cea447-8c4c-44f9-8706-18285daca644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:45.617738 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614cfd6-6e0d-4ba0-a77e-5ba68e83de28 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:45.644665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:45.651902 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c7e73-67d9-4999-9764-f04b09a44bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:45.652575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c7e73-67d9-4999-9764-f04b09a44bfd None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:45.652859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c7e73-67d9-4999-9764-f04b09a44bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:45.656841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c7e73-67d9-4999-9764-f04b09a44bfd None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:45.656841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c7e73-67d9-4999-9764-f04b09a44bfd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:45.656841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c7e73-67d9-4999-9764-f04b09a44bfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:45.656841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c7e73-67d9-4999-9764-f04b09a44bfd None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:45.679196 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 480/947] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jun 16 14:44:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:45.679196 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c7e73-67d9-4999-9764-f04b09a44bfd None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:45.681356 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 468/948] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:45.682141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cea447-8c4c-44f9-8706-18285daca644 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:45.791739 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cea447-8c4c-44f9-8706-18285daca644 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:45.795904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c7e73-67d9-4999-9764-f04b09a44bfd None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:45.825895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:45.827731 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979acd8-3a11-447f-adc9-4038cacbb0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:45.828572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979acd8-3a11-447f-adc9-4038cacbb0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:45.828860 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979acd8-3a11-447f-adc9-4038cacbb0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:45.829319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979acd8-3a11-447f-adc9-4038cacbb0c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:45.834966 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db3b7a-85a5-4949-831f-da3cbfeb3c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:45.840051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db3b7a-85a5-4949-831f-da3cbfeb3c27 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:45.840051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db3b7a-85a5-4949-831f-da3cbfeb3c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:45.840051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db3b7a-85a5-4949-831f-da3cbfeb3c27 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:45.840051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db3b7a-85a5-4949-831f-da3cbfeb3c27 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:45.840051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db3b7a-85a5-4949-831f-da3cbfeb3c27 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:45.840456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979acd8-3a11-447f-adc9-4038cacbb0c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:45.841213 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e979acd8-3a11-447f-adc9-4038cacbb0c3 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-96db3b7a-85a5-4949-831f-da3cbfeb3c27 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:45.852733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:45.853785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:45.853785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:45.853785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:45.853785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:45.853785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:45.853785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:45.853785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:45.853785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:45.853785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:45.853785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:45.853785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:45.853785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:45.853785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:45.853785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:45.853785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:45.853785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:45.855538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:45.855538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:45.855538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:45.855538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:45.855538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:45.855538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:45.855538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:45.855538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:45.855538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:45.855538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:45.855538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:45.855538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:45.855538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:45.855538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:45.858048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 481/949] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:45.859020 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db3b7a-85a5-4949-831f-da3cbfeb3c27 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:45.866634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-e979acd8-3a11-447f-adc9-4038cacbb0c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:45.866634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:45.866634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:45.866634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:45.866634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:45.866634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:45.866634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:45.866634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:45.866634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:45.866634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:45.866634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:45.866634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:45.866634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:45.866634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:45.866634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:45.867537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:45.868408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:45.868408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:45.868408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:45.868408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:45.869032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 469/950] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:45.873929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979acd8-3a11-447f-adc9-4038cacbb0c3 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:45.901609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:45.975967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db3b7a-85a5-4949-831f-da3cbfeb3c27 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:45.990525 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979acd8-3a11-447f-adc9-4038cacbb0c3 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:46.011447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc44c0f-51ff-47f6-a88c-d10b6574b731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:46.012248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc44c0f-51ff-47f6-a88c-d10b6574b731 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.012541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc44c0f-51ff-47f6-a88c-d10b6574b731 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.012818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc44c0f-51ff-47f6-a88c-d10b6574b731 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.013503 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc44c0f-51ff-47f6-a88c-d10b6574b731 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:46.014879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc44c0f-51ff-47f6-a88c-d10b6574b731 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-6bc44c0f-51ff-47f6-a88c-d10b6574b731 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:46.026530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:46.027525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:46.027525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:46.027525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:46.027525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:46.027525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:46.027525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:46.027525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:46.027525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:46.027525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:46.027525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:46.027525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:46.027525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:46.027525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:46.027525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:46.027525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:46.027525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:46.028580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:46.028580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:46.028580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:46.028580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:46.028580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:46.028580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:46.028580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:46.028580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:46.028580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:46.028580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:46.028580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:46.028580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:46.028580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:46.028580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:46.028580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 482/951] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:46.029481 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc44c0f-51ff-47f6-a88c-d10b6574b731 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:46.030097 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d9bb9-dade-4dfe-a9e2-e28a55c792eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:46.030401 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d9bb9-dade-4dfe-a9e2-e28a55c792eb None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.030688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d9bb9-dade-4dfe-a9e2-e28a55c792eb None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.030965 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d9bb9-dade-4dfe-a9e2-e28a55c792eb None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.031665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d9bb9-dade-4dfe-a9e2-e28a55c792eb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:46.031978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d9bb9-dade-4dfe-a9e2-e28a55c792eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:46.033690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d9bb9-dade-4dfe-a9e2-e28a55c792eb None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:46.038669 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 470/952] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:46.039439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d9bb9-dade-4dfe-a9e2-e28a55c792eb None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:46.095415 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:46.137534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:46.143721 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc44c0f-51ff-47f6-a88c-d10b6574b731 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:46.146043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d9bb9-dade-4dfe-a9e2-e28a55c792eb None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:46.180344 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855566aa-cd9a-4e29-93da-f27853bd29ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:46.181016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855566aa-cd9a-4e29-93da-f27853bd29ea None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.181337 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855566aa-cd9a-4e29-93da-f27853bd29ea None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.181618 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855566aa-cd9a-4e29-93da-f27853bd29ea None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.181850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c09f0d-5d0b-468b-8202-6e5cdab43e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:46.182343 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855566aa-cd9a-4e29-93da-f27853bd29ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:46.182504 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c09f0d-5d0b-468b-8202-6e5cdab43e6b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.182669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855566aa-cd9a-4e29-93da-f27853bd29ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:46.182774 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c09f0d-5d0b-468b-8202-6e5cdab43e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.183053 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c09f0d-5d0b-468b-8202-6e5cdab43e6b None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.183746 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c09f0d-5d0b-468b-8202-6e5cdab43e6b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:46.184019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855566aa-cd9a-4e29-93da-f27853bd29ea None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:46.184220 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c09f0d-5d0b-468b-8202-6e5cdab43e6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:46.185445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c09f0d-5d0b-468b-8202-6e5cdab43e6b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:46.191186 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 471/953] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:46.191963 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c09f0d-5d0b-468b-8202-6e5cdab43e6b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:46.206165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 483/954] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:46.207228 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855566aa-cd9a-4e29-93da-f27853bd29ea None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:46.304131 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c09f0d-5d0b-468b-8202-6e5cdab43e6b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:46.315669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855566aa-cd9a-4e29-93da-f27853bd29ea None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:46.331825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:46.340757 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba1765-fd62-4546-a47e-ca750c4633dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:46.341461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba1765-fd62-4546-a47e-ca750c4633dd None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.341750 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba1765-fd62-4546-a47e-ca750c4633dd None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.354624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba1765-fd62-4546-a47e-ca750c4633dd None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.354624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba1765-fd62-4546-a47e-ca750c4633dd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:46.354624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba1765-fd62-4546-a47e-ca750c4633dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:46.354624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba1765-fd62-4546-a47e-ca750c4633dd None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:46.354956 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdb6cf-78c9-4835-9b7f-dd8a5ec78ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:46.355062 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 472/955] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:46.355142 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdb6cf-78c9-4835-9b7f-dd8a5ec78ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.355214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba1765-fd62-4546-a47e-ca750c4633dd None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:46.355282 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdb6cf-78c9-4835-9b7f-dd8a5ec78ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.355282 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdb6cf-78c9-4835-9b7f-dd8a5ec78ba5 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.355282 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdb6cf-78c9-4835-9b7f-dd8a5ec78ba5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:46.355282 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdb6cf-78c9-4835-9b7f-dd8a5ec78ba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:46.355282 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdb6cf-78c9-4835-9b7f-dd8a5ec78ba5 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:46.358429 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 484/956] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:46.365279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdb6cf-78c9-4835-9b7f-dd8a5ec78ba5 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:46.385624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:46.482683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdb6cf-78c9-4835-9b7f-dd8a5ec78ba5 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:46.483333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba1765-fd62-4546-a47e-ca750c4633dd None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:46.520784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492bcb4-0e97-4164-8796-f909287b762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:46.521663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492bcb4-0e97-4164-8796-f909287b762d None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.522023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492bcb4-0e97-4164-8796-f909287b762d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.522373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492bcb4-0e97-4164-8796-f909287b762d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.522947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30370930-5439-41b6-864d-adf2730eac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:46.523360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492bcb4-0e97-4164-8796-f909287b762d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:46.523945 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30370930-5439-41b6-864d-adf2730eac5f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.524305 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30370930-5439-41b6-864d-adf2730eac5f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.524656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30370930-5439-41b6-864d-adf2730eac5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.525007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492bcb4-0e97-4164-8796-f909287b762d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:46.533033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30370930-5439-41b6-864d-adf2730eac5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:46.535475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30370930-5439-41b6-864d-adf2730eac5f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:46.550668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-30370930-5439-41b6-864d-adf2730eac5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:46.550668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:46.550668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:46.550668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:46.550668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:46.550668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:46.550668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:46.550668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:46.550668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:46.550668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:46.550668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:46.550668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:46.550668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:46.550668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:46.550668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:46.553984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:46.554880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:46.554880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:46.554880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:46.554880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:46.554880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:46.554880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:46.554880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:46.554880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:46.554880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 473/957] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:46.557848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30370930-5439-41b6-864d-adf2730eac5f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:46.621584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 485/958] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 16 14:44:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:46.655579 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:46.681352 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30370930-5439-41b6-864d-adf2730eac5f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:46.727491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d1faa-5c58-47f5-8d2b-5936dc752fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:46.728588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d1faa-5c58-47f5-8d2b-5936dc752fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.729089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d1faa-5c58-47f5-8d2b-5936dc752fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.729667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d1faa-5c58-47f5-8d2b-5936dc752fd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.730692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d1faa-5c58-47f5-8d2b-5936dc752fd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:46.731228 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d1faa-5c58-47f5-8d2b-5936dc752fd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:46.732975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d1faa-5c58-47f5-8d2b-5936dc752fd2 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:46.749859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 474/959] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:46.758542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492bcb4-0e97-4164-8796-f909287b762d None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:46.801084 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:46.824044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c82369-a9e1-4c9e-939f-6ee97116a203 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.824349 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c82369-a9e1-4c9e-939f-6ee97116a203 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.824637 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c82369-a9e1-4c9e-939f-6ee97116a203 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.826358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 475/960] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:46.832530 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa943a6-ce7a-4aa7-a344-2d059e7ff047 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.845197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa943a6-ce7a-4aa7-a344-2d059e7ff047 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.845197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa943a6-ce7a-4aa7-a344-2d059e7ff047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.852382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-1fa943a6-ce7a-4aa7-a344-2d059e7ff047 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:46.853625 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-1fa943a6-ce7a-4aa7-a344-2d059e7ff047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:46.875505 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492bcb4-0e97-4164-8796-f909287b762d None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:46.917940 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003b8a8-848f-4261-a915-2e577c431bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:46.919342 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003b8a8-848f-4261-a915-2e577c431bc7 None admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:46.919945 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003b8a8-848f-4261-a915-2e577c431bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:46.920374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003b8a8-848f-4261-a915-2e577c431bc7 None admin] PATH_INFO: `/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/c1e11e5614c64b87a892740f39e8fc5b/roles/53ff5be561de46ca931c143cf800c0f7` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:46.923848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003b8a8-848f-4261-a915-2e577c431bc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9e5996685142bb94c83c5403fbf17d, user_id=c1e11e5614c64b87a892740f39e8fc5b, role_id=53ff5be561de46ca931c143cf800c0f7)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:46.925947 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003b8a8-848f-4261-a915-2e577c431bc7 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:46.932054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 476/961] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:46.957161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa943a6-ce7a-4aa7-a344-2d059e7ff047 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:47.030213 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:47.037300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 486/962] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:44:46 2022] PUT /identity/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/c1e11e5614c64b87a892740f39e8fc5b/roles/53ff5be561de46ca931c143cf800c0f7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:44:47.076597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa943a6-ce7a-4aa7-a344-2d059e7ff047 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:47.116075 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fd153-9c15-43bc-8c38-2610aac24792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:47.116770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fd153-9c15-43bc-8c38-2610aac24792 None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:47.117054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fd153-9c15-43bc-8c38-2610aac24792 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:47.117414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fd153-9c15-43bc-8c38-2610aac24792 None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:47.118146 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fd153-9c15-43bc-8c38-2610aac24792 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:47.119756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fd153-9c15-43bc-8c38-2610aac24792 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:47.164534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.sql.core [None req-3f2fd153-9c15-43bc-8c38-2610aac24792 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 14:44:47.164534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 14:44:47.164534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [parameters: {'user_id': '526d9436c5e34b7799b53748b4939a36', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 14:44:47.164534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80273) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 14:44:47.172435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-3f2fd153-9c15-43bc-8c38-2610aac24792 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 14:44:47.172435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:47.172435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:44:47.172435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:44:47.172435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:44:47.172435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:44:47.172435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:44:47.172435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:44:47.172435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:44:47.172435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:44:47.172435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:44:47.172435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:44:47.172435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:44:47.172435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application result.read() Jun 16 14:44:47.172435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:44:47.173429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application yield resource Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application next(self.gen) Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise self.value Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application session.commit() Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 14:44:47.174429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self.session.flush() Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application compat.raise_( Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 14:44:47.175332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 14:44:47.176229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 14:44:47.176229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 14:44:47.176229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 14:44:47.176229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 16 14:44:47.176229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 14:44:47.176229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 14:44:47.176229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 14:44:47.176229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 14:44:47.176229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 14:44:47.176229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 14:44:47.176229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 14:44:47.176229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 14:44:47.176229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 14:44:47.176229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 14:44:47.176229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 14:44:47.176229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception Jun 16 14:44:47.177105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 14:44:47.177105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 14:44:47.177105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 14:44:47.177105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 14:44:47.177105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 14:44:47.177105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 14:44:47.177105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 14:44:47.177105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application conn.query(q) Jun 16 14:44:47.177105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 14:44:47.177105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 14:44:47.177105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 14:44:47.177105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application result.read() Jun 16 14:44:47.177105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 14:44:47.177105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 14:44:47.177105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 14:44:47.177105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 14:44:47.177989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 14:44:47.177989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 14:44:47.177989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 14:44:47.177989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 14:44:47.177989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 14:44:47.177989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 14:44:47.177989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [parameters: {'user_id': '526d9436c5e34b7799b53748b4939a36', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 14:44:47.177989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 14:44:47.177989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:47.177989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:47.177989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:47.177989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:47.177989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:47.177989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:47.177989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 16 14:44:47.178808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 16 14:44:47.179729 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 16 14:44:47.179729 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 16 14:44:47.179729 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 14:44:47.179729 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 14:44:47.179729 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 14:44:47.179729 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:47.179729 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 477/963] 10.222.0.23 () {60 vars in 1131 bytes} [Thu Jun 16 14:44:46 2022] POST /identity/v3/users => generated 160 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:47.186550 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003b8a8-848f-4261-a915-2e577c431bc7 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:47.296061 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:47.302868 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003b8a8-848f-4261-a915-2e577c431bc7 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:47.338814 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50736b53-e2cc-4c5c-8230-ba75bec7d140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:47.339620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50736b53-e2cc-4c5c-8230-ba75bec7d140 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:47.339905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50736b53-e2cc-4c5c-8230-ba75bec7d140 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:47.340185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50736b53-e2cc-4c5c-8230-ba75bec7d140 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:47.348461 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50736b53-e2cc-4c5c-8230-ba75bec7d140 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:47.349936 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50736b53-e2cc-4c5c-8230-ba75bec7d140 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:47.364451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-50736b53-e2cc-4c5c-8230-ba75bec7d140 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:44:47.364451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:47.364451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:47.364451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:47.364451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:47.364451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:47.364451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:47.364451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:47.364451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:47.364451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:47.364451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:47.364451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:47.364451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:47.364451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:47.364451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:47.364451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:47.366661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:47.369022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:47.369022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:47.369022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:47.369022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:47.369022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:47.369022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:47.369022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:47.369022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:47.369022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 14:44:47.369022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:47.370325 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 487/964] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:44:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:47.377156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fd153-9c15-43bc-8c38-2610aac24792 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:47.478800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fd153-9c15-43bc-8c38-2610aac24792 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:47.504452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:47.512931 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fd939-06d4-4b56-929a-01db0035b96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:47.513642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fd939-06d4-4b56-929a-01db0035b96d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:47.513928 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fd939-06d4-4b56-929a-01db0035b96d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:47.514213 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fd939-06d4-4b56-929a-01db0035b96d None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:47.515018 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fd939-06d4-4b56-929a-01db0035b96d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:47.515324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fd939-06d4-4b56-929a-01db0035b96d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:47.517024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fd939-06d4-4b56-929a-01db0035b96d None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:47.558422 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 478/965] 10.222.0.23 () {56 vars in 1101 bytes} [Thu Jun 16 14:44:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:48.607337 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6d48d-fec4-455f-95f5-98e55b65b032 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:48.607884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6d48d-fec4-455f-95f5-98e55b65b032 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:48.607884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6d48d-fec4-455f-95f5-98e55b65b032 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:48.609462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 488/966] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:48.615059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cc886-9877-46bd-b103-83ffa870ae2e None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:48.615455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cc886-9877-46bd-b103-83ffa870ae2e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:48.615637 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cc886-9877-46bd-b103-83ffa870ae2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:48.632409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-3e3cc886-9877-46bd-b103-83ffa870ae2e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:48.633967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3e3cc886-9877-46bd-b103-83ffa870ae2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:48.702379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 479/967] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:48.723723 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6d48d-fec4-455f-95f5-98e55b65b032 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:48.831368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6d48d-fec4-455f-95f5-98e55b65b032 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:48.865825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5666533-0736-4b33-848b-480bbd76e4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:48.866459 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5666533-0736-4b33-848b-480bbd76e4a9 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:48.866840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5666533-0736-4b33-848b-480bbd76e4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:48.867019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5666533-0736-4b33-848b-480bbd76e4a9 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:48.867749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5666533-0736-4b33-848b-480bbd76e4a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:48.868229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e1ae6-905a-4ffe-94aa-83031dd9d77b None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:48.868598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e1ae6-905a-4ffe-94aa-83031dd9d77b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:48.868952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e1ae6-905a-4ffe-94aa-83031dd9d77b None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:48.869230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5666533-0736-4b33-848b-480bbd76e4a9 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:48.870631 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 480/968] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:48.875480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3434bcf-9038-4b45-a6bd-984e4891579f None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:48.875772 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3434bcf-9038-4b45-a6bd-984e4891579f None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:48.876051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3434bcf-9038-4b45-a6bd-984e4891579f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:48.893507 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-a3434bcf-9038-4b45-a6bd-984e4891579f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:48.894744 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a3434bcf-9038-4b45-a6bd-984e4891579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:48.937191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 489/969] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 16 14:44:48 2022] POST /identity/v3/services => generated 242 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:48.981751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 481/970] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:49.004460 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5666533-0736-4b33-848b-480bbd76e4a9 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:49.025799 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:49.117285 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5666533-0736-4b33-848b-480bbd76e4a9 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:49.153743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e77001-c334-467a-ae8f-d6c5b66006ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:49.154560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e77001-c334-467a-ae8f-d6c5b66006ed None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:49.154845 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e77001-c334-467a-ae8f-d6c5b66006ed None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:49.155123 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e77001-c334-467a-ae8f-d6c5b66006ed None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:49.155780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e77001-c334-467a-ae8f-d6c5b66006ed None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:49.157177 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e77001-c334-467a-ae8f-d6c5b66006ed None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-77e77001-c334-467a-ae8f-d6c5b66006ed None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:49.170175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:49.171194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:49.171194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:49.171194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:49.171194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:49.171194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:49.171194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:49.171194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:49.171194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:49.171194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:49.171194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:49.171194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:49.171194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:49.171194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:49.171194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:49.171194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:49.171194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:49.172032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:49.172032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:49.172032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:49.172032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:49.172032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:49.172032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:49.172032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:49.172032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:49.172032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:49.172032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:49.172032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:49.172032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:49.172032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:49.172032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:49.172032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 490/971] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:49.179315 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3434bcf-9038-4b45-a6bd-984e4891579f None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:49.225957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:49.252315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19774e1c-3ff1-4d6d-86ed-05c997cfcbd5 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:49.252641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19774e1c-3ff1-4d6d-86ed-05c997cfcbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:49.252925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19774e1c-3ff1-4d6d-86ed-05c997cfcbd5 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:49.254670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 491/972] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:49.259331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1086e-9ad5-439f-a309-c3d52448b304 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:49.259617 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1086e-9ad5-439f-a309-c3d52448b304 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:49.259895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1086e-9ad5-439f-a309-c3d52448b304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:49.277631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-e4f1086e-9ad5-439f-a309-c3d52448b304 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:49.278731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e4f1086e-9ad5-439f-a309-c3d52448b304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:49.288447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3434bcf-9038-4b45-a6bd-984e4891579f None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:49.323248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e86240-869a-47ba-930d-8282c5da0009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:49.323921 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e86240-869a-47ba-930d-8282c5da0009 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:49.324205 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e86240-869a-47ba-930d-8282c5da0009 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:49.324483 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e86240-869a-47ba-930d-8282c5da0009 None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:49.325208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e86240-869a-47ba-930d-8282c5da0009 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:49.325518 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e86240-869a-47ba-930d-8282c5da0009 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:49.326885 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e86240-869a-47ba-930d-8282c5da0009 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:49.332071 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 482/973] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:49.338383 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e86240-869a-47ba-930d-8282c5da0009 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:49.358951 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 492/974] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:49.383562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1086e-9ad5-439f-a309-c3d52448b304 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:49.395697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:49.451830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e86240-869a-47ba-930d-8282c5da0009 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:49.454190 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:49.486358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78daf9-d8c2-4409-8987-37167d93884e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:49.487067 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78daf9-d8c2-4409-8987-37167d93884e None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:49.487186 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1086e-9ad5-439f-a309-c3d52448b304 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:49.487354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78daf9-d8c2-4409-8987-37167d93884e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:49.487631 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78daf9-d8c2-4409-8987-37167d93884e None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:49.488341 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78daf9-d8c2-4409-8987-37167d93884e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:49.488654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78daf9-d8c2-4409-8987-37167d93884e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:49.490090 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78daf9-d8c2-4409-8987-37167d93884e None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:49.495123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 483/975] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:49.501126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78daf9-d8c2-4409-8987-37167d93884e None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:49.523847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f6eff-7f75-4372-812d-3a89c2d82bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:49.524667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f6eff-7f75-4372-812d-3a89c2d82bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:49.524956 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f6eff-7f75-4372-812d-3a89c2d82bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:49.525263 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f6eff-7f75-4372-812d-3a89c2d82bf5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:49.536019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f6eff-7f75-4372-812d-3a89c2d82bf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:49.544176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-ef8f6eff-7f75-4372-812d-3a89c2d82bf5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:49.544176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:49.544176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:49.544176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:49.544176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:49.544176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:49.544176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:49.544176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:49.544176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:49.544176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:49.544176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:49.544176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:49.544176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:49.544176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:49.544176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:49.544176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:49.545115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:49.545115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:49.545115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:49.545115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:49.545115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:49.545115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:49.545115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:49.545115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:49.545115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:49.545115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:49.545115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:49.545115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:49.545115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:49.545115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:49.545115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:49.545115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:49.546029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:49.546029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:49.546029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:49.546029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:49.546029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:49.546029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:49.546029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:49.546029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:49.546029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:49.546029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:49.546029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:49.546029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:49.546029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 493/976] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jun 16 14:44:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:49.551964 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f6eff-7f75-4372-812d-3a89c2d82bf5 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:49.605594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78daf9-d8c2-4409-8987-37167d93884e None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:49.637597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:49.642977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea8d0f-ccc0-4701-bfea-2279694891d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:49.643736 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea8d0f-ccc0-4701-bfea-2279694891d2 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:49.644450 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea8d0f-ccc0-4701-bfea-2279694891d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:49.644735 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea8d0f-ccc0-4701-bfea-2279694891d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:49.645592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea8d0f-ccc0-4701-bfea-2279694891d2 None admin] RBAC: Adding query filter params (interface=admin, service_id=25a6d4e0ed13457fbd2a236eb1cf21d5, region_id=RegionOne) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:49.645914 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea8d0f-ccc0-4701-bfea-2279694891d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:49.647355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea8d0f-ccc0-4701-bfea-2279694891d2 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:49.652459 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 484/977] 10.222.0.23 () {56 vars in 1249 bytes} [Thu Jun 16 14:44:49 2022] GET /identity/v3/endpoints?service_id=25a6d4e0ed13457fbd2a236eb1cf21d5&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:49.658278 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea8d0f-ccc0-4701-bfea-2279694891d2 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:49.673838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f6eff-7f75-4372-812d-3a89c2d82bf5 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:49.689939 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:49.714538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef4641-459b-46f5-9a69-4c4fb049c0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:49.715216 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef4641-459b-46f5-9a69-4c4fb049c0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:49.715510 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef4641-459b-46f5-9a69-4c4fb049c0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:49.715784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef4641-459b-46f5-9a69-4c4fb049c0d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:49.716538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef4641-459b-46f5-9a69-4c4fb049c0d9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:49.716846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef4641-459b-46f5-9a69-4c4fb049c0d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:49.718524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef4641-459b-46f5-9a69-4c4fb049c0d9 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:49.728182 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 494/978] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jun 16 14:44:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:49.734277 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef4641-459b-46f5-9a69-4c4fb049c0d9 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:49.766128 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea8d0f-ccc0-4701-bfea-2279694891d2 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:49.803839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859f4f-d13a-433c-a450-87350934995f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:49.806490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859f4f-d13a-433c-a450-87350934995f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:49.806490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859f4f-d13a-433c-a450-87350934995f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:49.806490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859f4f-d13a-433c-a450-87350934995f None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:49.806490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce859f4f-d13a-433c-a450-87350934995f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:49.807446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce859f4f-d13a-433c-a450-87350934995f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:49.814136 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 485/979] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 16 14:44:49 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 14:44:49.838328 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef4641-459b-46f5-9a69-4c4fb049c0d9 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:49.871050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:49.876883 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293d6f9-f582-4ac9-9f94-364781e7c4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:49.882550 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d6f9-f582-4ac9-9f94-364781e7c4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:49.882550 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d6f9-f582-4ac9-9f94-364781e7c4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:49.882550 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d6f9-f582-4ac9-9f94-364781e7c4e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:49.891161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293d6f9-f582-4ac9-9f94-364781e7c4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:49.892550 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293d6f9-f582-4ac9-9f94-364781e7c4e2 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:49.912616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-a293d6f9-f582-4ac9-9f94-364781e7c4e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:49.912616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:49.912616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:49.912616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:49.912616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:49.912616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:49.912616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:49.912616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:49.912616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:49.912616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:49.912616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:49.912616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:49.912616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:49.912616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:49.912616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:49.913866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:49.919985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:49.919985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:49.919985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:49.919985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:49.919985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 495/980] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:49.920333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859f4f-d13a-433c-a450-87350934995f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:50.024505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:50.030409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859f4f-d13a-433c-a450-87350934995f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:50.066060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd958e-6bbd-49ee-a3ec-02d15443b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:50.066827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd958e-6bbd-49ee-a3ec-02d15443b28d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:50.067122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd958e-6bbd-49ee-a3ec-02d15443b28d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:50.067404 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd958e-6bbd-49ee-a3ec-02d15443b28d None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:50.068146 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd958e-6bbd-49ee-a3ec-02d15443b28d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:50.068457 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd958e-6bbd-49ee-a3ec-02d15443b28d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:50.069905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd958e-6bbd-49ee-a3ec-02d15443b28d None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:50.082431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 486/981] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:50.087718 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293d6f9-f582-4ac9-9f94-364781e7c4e2 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:50.190350 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293d6f9-f582-4ac9-9f94-364781e7c4e2 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:50.223700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8230a0-df9f-4131-9481-b625121ab5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:50.224509 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8230a0-df9f-4131-9481-b625121ab5ba None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:50.224790 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8230a0-df9f-4131-9481-b625121ab5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:50.225062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8230a0-df9f-4131-9481-b625121ab5ba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:50.232421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8230a0-df9f-4131-9481-b625121ab5ba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:50.233887 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8230a0-df9f-4131-9481-b625121ab5ba None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:50.248765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-7b8230a0-df9f-4131-9481-b625121ab5ba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:44:50.248765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:50.248765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:50.248765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:50.248765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:50.248765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:50.248765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:50.248765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:50.248765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:50.248765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:50.248765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:50.248765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:50.248765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:50.248765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:50.248765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:50.248765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:50.250122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:50.251213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:50.251213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:50.251213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:50.251213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:50.251213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:50.251213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:50.251213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:50.251213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:50.251213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 14:44:50.251213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:50.251213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 496/982] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 16 14:44:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:50.259134 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd958e-6bbd-49ee-a3ec-02d15443b28d None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:50.363997 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd958e-6bbd-49ee-a3ec-02d15443b28d None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:50.397568 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a41ec-f442-4425-9eab-457a7a93c890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:50.398233 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a41ec-f442-4425-9eab-457a7a93c890 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:50.398517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a41ec-f442-4425-9eab-457a7a93c890 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:50.398792 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a41ec-f442-4425-9eab-457a7a93c890 None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:50.399611 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a41ec-f442-4425-9eab-457a7a93c890 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:50.399918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a41ec-f442-4425-9eab-457a7a93c890 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:50.401359 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a41ec-f442-4425-9eab-457a7a93c890 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:50.419596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 487/983] 10.222.0.23 () {56 vars in 1149 bytes} [Thu Jun 16 14:44:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:50.425038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8230a0-df9f-4131-9481-b625121ab5ba None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:50.472320 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:50.526313 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8230a0-df9f-4131-9481-b625121ab5ba None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:50.559920 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edb7aa-ef50-4117-8298-6dd681e52b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:50.560626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edb7aa-ef50-4117-8298-6dd681e52b6d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:50.560913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edb7aa-ef50-4117-8298-6dd681e52b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:50.561280 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edb7aa-ef50-4117-8298-6dd681e52b6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:50.628537 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edb7aa-ef50-4117-8298-6dd681e52b6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:50.630024 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52edb7aa-ef50-4117-8298-6dd681e52b6d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:50.676116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:50.768098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 497/984] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:50 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:44:50.774448 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a41ec-f442-4425-9eab-457a7a93c890 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:50.790968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:50.874145 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a41ec-f442-4425-9eab-457a7a93c890 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:50.908972 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb5ec2-53df-42ec-99c4-51625fd7af74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:50.909805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb5ec2-53df-42ec-99c4-51625fd7af74 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:50.910093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb5ec2-53df-42ec-99c4-51625fd7af74 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:50.910372 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb5ec2-53df-42ec-99c4-51625fd7af74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:50.920342 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb5ec2-53df-42ec-99c4-51625fd7af74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:50.921813 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb5ec2-53df-42ec-99c4-51625fd7af74 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:50.939036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-f5cb5ec2-53df-42ec-99c4-51625fd7af74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:50.939036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:50.939036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:50.939036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:50.939036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:50.939036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:50.939036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:50.939036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:50.939036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:50.939036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:50.939036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:50.939036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:50.939036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:50.939036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:50.939036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:50.939954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:50.942479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:50.942479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:50.942479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:50.942479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:50.942479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 488/985] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:50.948624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edb7aa-ef50-4117-8298-6dd681e52b6d None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:51.074570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52edb7aa-ef50-4117-8298-6dd681e52b6d None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:51.129483 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7712e-a80c-4e47-916c-515205e0a54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:51.130472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7712e-a80c-4e47-916c-515205e0a54e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.130896 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7712e-a80c-4e47-916c-515205e0a54e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.131313 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7712e-a80c-4e47-916c-515205e0a54e None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.132435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7712e-a80c-4e47-916c-515205e0a54e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:51.132897 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7712e-a80c-4e47-916c-515205e0a54e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:51.135129 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7712e-a80c-4e47-916c-515205e0a54e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:51.159023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 498/986] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:51.160404 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb5ec2-53df-42ec-99c4-51625fd7af74 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:51.188125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3da944-b526-4004-86fc-555552a378b5 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.188405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3da944-b526-4004-86fc-555552a378b5 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.188681 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3da944-b526-4004-86fc-555552a378b5 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.190123 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 499/987] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:51.195313 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654d76e-40f9-49f0-b9e5-05a0221f55a5 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.195602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654d76e-40f9-49f0-b9e5-05a0221f55a5 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.195977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654d76e-40f9-49f0-b9e5-05a0221f55a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.201670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:51.212263 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-e654d76e-40f9-49f0-b9e5-05a0221f55a5 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:51.213732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e654d76e-40f9-49f0-b9e5-05a0221f55a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:51.229451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:51.273235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb5ec2-53df-42ec-99c4-51625fd7af74 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:51.284511 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 500/988] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:51.311061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb3dc2-382b-4860-b50d-35d688fa3b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:51.311873 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb3dc2-382b-4860-b50d-35d688fa3b68 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.312159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb3dc2-382b-4860-b50d-35d688fa3b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.312437 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb3dc2-382b-4860-b50d-35d688fa3b68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.313347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654d76e-40f9-49f0-b9e5-05a0221f55a5 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:51.320743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb3dc2-382b-4860-b50d-35d688fa3b68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:51.322396 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb3dc2-382b-4860-b50d-35d688fa3b68 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:51.345623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-e5cb3dc2-382b-4860-b50d-35d688fa3b68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:51.345623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:51.345623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:51.345623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:51.345623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:51.345623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:51.345623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:51.345623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:51.345623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:51.345623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:51.345623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:51.345623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:51.345623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:51.345623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:51.345623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:51.347321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:51.348874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:51.348874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:51.348874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:51.348874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:51.348874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:51.348874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:51.348874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:51.348874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:51.348874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 489/989] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:51.352389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb3dc2-382b-4860-b50d-35d688fa3b68 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:51.429757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654d76e-40f9-49f0-b9e5-05a0221f55a5 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:51.459848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb3dc2-382b-4860-b50d-35d688fa3b68 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:51.463228 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69c3f2-4622-4d94-aa7c-94b6241165c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:51.464034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69c3f2-4622-4d94-aa7c-94b6241165c5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.464322 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69c3f2-4622-4d94-aa7c-94b6241165c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.464602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69c3f2-4622-4d94-aa7c-94b6241165c5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.465291 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69c3f2-4622-4d94-aa7c-94b6241165c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:51.466672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69c3f2-4622-4d94-aa7c-94b6241165c5 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:51.468489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-ed69c3f2-4622-4d94-aa7c-94b6241165c5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:51.480357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:51.486435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:51.486435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:51.486435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:51.486435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:51.486435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:51.486435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:51.486435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:51.486435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:51.486435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:51.486435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:51.486435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:51.486435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:51.486435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:51.486435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:51.486435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:51.486435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:51.487538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:51.487538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:51.487538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:51.487538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:51.487538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:51.487538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:51.487538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:51.487538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:51.487538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:51.487538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:51.487538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:51.487538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:51.487538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:51.487538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:51.487538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 501/990] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:51.488489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69c3f2-4622-4d94-aa7c-94b6241165c5 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:51.490126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:51.499109 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a93acf-5b55-4354-84c3-2d6bb7060819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:51.499814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a93acf-5b55-4354-84c3-2d6bb7060819 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.500101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a93acf-5b55-4354-84c3-2d6bb7060819 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.500391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a93acf-5b55-4354-84c3-2d6bb7060819 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.501202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a93acf-5b55-4354-84c3-2d6bb7060819 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:51.501520 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a93acf-5b55-4354-84c3-2d6bb7060819 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:51.503485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a93acf-5b55-4354-84c3-2d6bb7060819 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:51.516043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 490/991] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:51.521885 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a93acf-5b55-4354-84c3-2d6bb7060819 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:51.590279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69c3f2-4622-4d94-aa7c-94b6241165c5 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:51.625204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660ebb3-31cd-468a-a2a9-a6296a02e6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:51.625810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660ebb3-31cd-468a-a2a9-a6296a02e6ea None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.626103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660ebb3-31cd-468a-a2a9-a6296a02e6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.626379 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660ebb3-31cd-468a-a2a9-a6296a02e6ea None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.627084 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660ebb3-31cd-468a-a2a9-a6296a02e6ea None admin] RBAC: Adding query filter params (name=compute) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:51.627395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660ebb3-31cd-468a-a2a9-a6296a02e6ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:51.627920 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a93acf-5b55-4354-84c3-2d6bb7060819 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:51.631120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660ebb3-31cd-468a-a2a9-a6296a02e6ea None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:51.637256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 502/992] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:51.642681 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660ebb3-31cd-468a-a2a9-a6296a02e6ea None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:51.670278 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff45016-f355-40b7-b222-0462b71aadd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:51.670940 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff45016-f355-40b7-b222-0462b71aadd6 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.671224 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff45016-f355-40b7-b222-0462b71aadd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.671737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff45016-f355-40b7-b222-0462b71aadd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.672329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff45016-f355-40b7-b222-0462b71aadd6 None admin] RBAC: Adding query filter params (role.id=53ff5be561de46ca931c143cf800c0f7, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=c1e11e5614c64b87a892740f39e8fc5b) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:51.672678 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff45016-f355-40b7-b222-0462b71aadd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:51.674105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff45016-f355-40b7-b222-0462b71aadd6 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:51.681076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 491/993] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:51 2022] GET /identity/v3/role_assignments?user.id=c1e11e5614c64b87a892740f39e8fc5b&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=53ff5be561de46ca931c143cf800c0f7 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:51.708818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:51.752941 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660ebb3-31cd-468a-a2a9-a6296a02e6ea None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:51.789898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70655ed0-370f-4828-93e8-4d2b988cdf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:51.790588 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70655ed0-370f-4828-93e8-4d2b988cdf2e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.790878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70655ed0-370f-4828-93e8-4d2b988cdf2e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.791160 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70655ed0-370f-4828-93e8-4d2b988cdf2e None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.791884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70655ed0-370f-4828-93e8-4d2b988cdf2e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:51.792195 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70655ed0-370f-4828-93e8-4d2b988cdf2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:51.793637 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70655ed0-370f-4828-93e8-4d2b988cdf2e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:51.804820 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 503/994] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:51.806023 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff45016-f355-40b7-b222-0462b71aadd6 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:51.860570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:51.914316 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff45016-f355-40b7-b222-0462b71aadd6 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:51.947811 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c563f2-3c72-483a-beba-f91014ea7160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:51.948543 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c563f2-3c72-483a-beba-f91014ea7160 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:51.948834 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c563f2-3c72-483a-beba-f91014ea7160 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:51.949111 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c563f2-3c72-483a-beba-f91014ea7160 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:51.949941 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c563f2-3c72-483a-beba-f91014ea7160 None admin] RBAC: Adding query filter params (interface=public, service_id=4de444ba3ee34b6c926b20b3fab8509e, region_id=RegionOne) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:51.950259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c563f2-3c72-483a-beba-f91014ea7160 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:51.951674 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c563f2-3c72-483a-beba-f91014ea7160 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:51.963017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 492/995] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jun 16 14:44:51 2022] GET /identity/v3/endpoints?service_id=4de444ba3ee34b6c926b20b3fab8509e&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:51.964375 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70655ed0-370f-4828-93e8-4d2b988cdf2e None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:52.031081 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52b90c-a176-4093-88f6-07f4b72943c1 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:52.031677 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52b90c-a176-4093-88f6-07f4b72943c1 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:52.031971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52b90c-a176-4093-88f6-07f4b72943c1 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:52.033371 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 493/996] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:52.039520 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd37b6-4149-48bc-92de-0b72a2d61f2c None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:52.039812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd37b6-4149-48bc-92de-0b72a2d61f2c None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:52.040095 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd37b6-4149-48bc-92de-0b72a2d61f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:52.056460 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-dbfd37b6-4149-48bc-92de-0b72a2d61f2c None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:52.057681 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-dbfd37b6-4149-48bc-92de-0b72a2d61f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:52.072969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70655ed0-370f-4828-93e8-4d2b988cdf2e None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:52.099099 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:52.107514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccc978-e35e-435a-b4cc-b77db2f2b0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:52.108201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccc978-e35e-435a-b4cc-b77db2f2b0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:52.108486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccc978-e35e-435a-b4cc-b77db2f2b0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:52.108763 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccc978-e35e-435a-b4cc-b77db2f2b0b4 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:52.109491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccc978-e35e-435a-b4cc-b77db2f2b0b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:52.110895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccc978-e35e-435a-b4cc-b77db2f2b0b4 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:52.117633 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 504/997] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 16 14:44:51 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:44:52.132773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 494/998] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:52.155660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccc978-e35e-435a-b4cc-b77db2f2b0b4 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:52.268202 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccc978-e35e-435a-b4cc-b77db2f2b0b4 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:52.309100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebac11-e18d-40ec-8317-74eec3a457c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:52.309969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebac11-e18d-40ec-8317-74eec3a457c5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:52.310257 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebac11-e18d-40ec-8317-74eec3a457c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:52.310527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebac11-e18d-40ec-8317-74eec3a457c5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:52.311176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebac11-e18d-40ec-8317-74eec3a457c5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:52.312533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebac11-e18d-40ec-8317-74eec3a457c5 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-3cebac11-e18d-40ec-8317-74eec3a457c5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:52.324875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:52.325924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:52.325924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:52.325924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:52.325924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:52.325924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:52.325924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:52.325924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:52.325924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:52.325924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:52.325924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:52.325924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:52.325924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:52.325924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:52.325924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:52.325924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:52.325924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:52.326780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:52.326780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:52.326780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:52.326780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:52.326780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:52.326780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:52.326780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:52.326780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:52.326780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:52.326780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:52.326780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:52.326780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:52.326780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 14:44:52.326780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:52.326780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 505/999] 10.222.0.23 () {56 vars in 1126 bytes} [Thu Jun 16 14:44:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:52.332055 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd37b6-4149-48bc-92de-0b72a2d61f2c None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:52.378751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:52.432292 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd37b6-4149-48bc-92de-0b72a2d61f2c None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:52.467020 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fa758-983f-41da-b5cf-0ae06a933db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:52.467691 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fa758-983f-41da-b5cf-0ae06a933db7 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:52.467974 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fa758-983f-41da-b5cf-0ae06a933db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:52.468250 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fa758-983f-41da-b5cf-0ae06a933db7 None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:52.468952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fa758-983f-41da-b5cf-0ae06a933db7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:52.469290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fa758-983f-41da-b5cf-0ae06a933db7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:52.470655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fa758-983f-41da-b5cf-0ae06a933db7 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:52.480313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 495/1000] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:52.481294 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebac11-e18d-40ec-8317-74eec3a457c5 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:52.537349 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:52.582732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebac11-e18d-40ec-8317-74eec3a457c5 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:52.615871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928f209-1a60-4aae-80a7-ff98291c95b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:52.616533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928f209-1a60-4aae-80a7-ff98291c95b6 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:52.616815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928f209-1a60-4aae-80a7-ff98291c95b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:52.617086 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928f209-1a60-4aae-80a7-ff98291c95b6 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:52.617837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928f209-1a60-4aae-80a7-ff98291c95b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:52.618144 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928f209-1a60-4aae-80a7-ff98291c95b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:52.619502 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928f209-1a60-4aae-80a7-ff98291c95b6 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:52.624382 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 506/1001] 10.222.0.23 () {56 vars in 1122 bytes} [Thu Jun 16 14:44:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:52.630608 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fa758-983f-41da-b5cf-0ae06a933db7 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:52.730815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fa758-983f-41da-b5cf-0ae06a933db7 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:52.740279 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:52.769960 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f0849-8463-42f2-9d90-e92a385e678c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:52.770757 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f0849-8463-42f2-9d90-e92a385e678c None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:52.771045 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f0849-8463-42f2-9d90-e92a385e678c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:52.771322 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f0849-8463-42f2-9d90-e92a385e678c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:52.772068 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f0849-8463-42f2-9d90-e92a385e678c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:52.773515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f0849-8463-42f2-9d90-e92a385e678c None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:52.837269 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 496/1002] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 16 14:44:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:53.986752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae4f93-0dc3-4274-9d05-a19936042dae None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:53.987214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae4f93-0dc3-4274-9d05-a19936042dae None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:53.987499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae4f93-0dc3-4274-9d05-a19936042dae None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:53.989467 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 507/1003] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:53.994369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfff04d-5cfc-45e3-80e4-ddb14bb3305b None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:53.994762 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfff04d-5cfc-45e3-80e4-ddb14bb3305b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:53.994942 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfff04d-5cfc-45e3-80e4-ddb14bb3305b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.011522 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-9bfff04d-5cfc-45e3-80e4-ddb14bb3305b None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:54.012723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-9bfff04d-5cfc-45e3-80e4-ddb14bb3305b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:54.086893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 497/1004] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:54.109993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae4f93-0dc3-4274-9d05-a19936042dae None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:54.215485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae4f93-0dc3-4274-9d05-a19936042dae None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:54.233262 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:54.251939 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870f7ed-c2b4-4ae8-8ec0-b2e37314a330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:54.252878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870f7ed-c2b4-4ae8-8ec0-b2e37314a330 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.253305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870f7ed-c2b4-4ae8-8ec0-b2e37314a330 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.253582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870f7ed-c2b4-4ae8-8ec0-b2e37314a330 None admin] PATH_INFO: `/v3/services/image` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.254247 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870f7ed-c2b4-4ae8-8ec0-b2e37314a330 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:54.255651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870f7ed-c2b4-4ae8-8ec0-b2e37314a330 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-f870f7ed-c2b4-4ae8-8ec0-b2e37314a330 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:54.268281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:54.270078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:54.270078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:54.270078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:54.270078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:54.270078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:54.270078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:54.270078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:54.270078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:54.270078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:54.270078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:54.270078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:54.270078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:54.270078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:54.270078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:54.270078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:54.270078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:54.270971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:54.270971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:54.270971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:54.270971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:54.270971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:54.270971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:54.270971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:54.270971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:54.270971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:54.270971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:54.270971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:54.270971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:54.270971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:44:54.270971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:54.270971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 508/1005] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Jun 16 14:44:54 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:54.277744 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfff04d-5cfc-45e3-80e4-ddb14bb3305b None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:54.308557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9905439-c367-4693-be7c-80e9a2d6355d None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.308870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9905439-c367-4693-be7c-80e9a2d6355d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.309119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9905439-c367-4693-be7c-80e9a2d6355d None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.310483 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 509/1006] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:54.315352 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e817ea-0544-4a92-946c-50a89b132cc1 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.315647 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e817ea-0544-4a92-946c-50a89b132cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.315932 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e817ea-0544-4a92-946c-50a89b132cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.333624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-06e817ea-0544-4a92-946c-50a89b132cc1 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:54.334529 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-06e817ea-0544-4a92-946c-50a89b132cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:54.378251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:54.384606 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfff04d-5cfc-45e3-80e4-ddb14bb3305b None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:54.405914 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 510/1007] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:54.425444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400b6a0-fc14-47a8-8e73-eaf04a7c65fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:54.426178 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400b6a0-fc14-47a8-8e73-eaf04a7c65fb None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.426463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400b6a0-fc14-47a8-8e73-eaf04a7c65fb None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.426795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400b6a0-fc14-47a8-8e73-eaf04a7c65fb None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.427502 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400b6a0-fc14-47a8-8e73-eaf04a7c65fb None admin] RBAC: Adding query filter params (name=image) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:54.427860 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400b6a0-fc14-47a8-8e73-eaf04a7c65fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:54.429460 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400b6a0-fc14-47a8-8e73-eaf04a7c65fb None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:54.430674 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e817ea-0544-4a92-946c-50a89b132cc1 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:54.439849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 498/1008] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:54.441247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400b6a0-fc14-47a8-8e73-eaf04a7c65fb None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:54.551790 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e817ea-0544-4a92-946c-50a89b132cc1 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:54.552168 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400b6a0-fc14-47a8-8e73-eaf04a7c65fb None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:54.566668 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:54.589445 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38236f-e592-4e76-a37a-7de2445a2a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:54.589771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5baa6-8949-4558-be42-1ef4acea8570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:54.590250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38236f-e592-4e76-a37a-7de2445a2a23 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.590418 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5baa6-8949-4558-be42-1ef4acea8570 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.590514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38236f-e592-4e76-a37a-7de2445a2a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.590694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5baa6-8949-4558-be42-1ef4acea8570 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.590792 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38236f-e592-4e76-a37a-7de2445a2a23 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.590967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5baa6-8949-4558-be42-1ef4acea8570 None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.591423 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38236f-e592-4e76-a37a-7de2445a2a23 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:54.591766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5baa6-8949-4558-be42-1ef4acea8570 None admin] RBAC: Adding query filter params (type=image) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:54.592016 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5baa6-8949-4558-be42-1ef4acea8570 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:54.592806 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38236f-e592-4e76-a37a-7de2445a2a23 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:54.593408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5baa6-8949-4558-be42-1ef4acea8570 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:54.606385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 499/1009] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-ae38236f-e592-4e76-a37a-7de2445a2a23 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:54.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:54.607580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:54.607580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:54.607580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:54.607580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:54.607580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:54.607580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:54.607580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:54.607580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:54.607580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:54.607580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:54.607580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:54.607580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:54.607580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:54.607580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:54.607580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:54.607580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:54.608426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:54.608426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:54.608426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:54.608426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:54.608426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:54.608426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:54.608426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:54.608426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:54.608426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:54.608426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:54.608426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:54.608426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:54.608426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 14:44:54.608426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:54.608426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 511/1010] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:54.613583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5baa6-8949-4558-be42-1ef4acea8570 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:54.640236 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:54.722565 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5baa6-8949-4558-be42-1ef4acea8570 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:54.759710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d4b69-7b0f-43ed-a2d2-6c44543be18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:54.760399 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d4b69-7b0f-43ed-a2d2-6c44543be18c None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.760688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d4b69-7b0f-43ed-a2d2-6c44543be18c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.760967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d4b69-7b0f-43ed-a2d2-6c44543be18c None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.761766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d4b69-7b0f-43ed-a2d2-6c44543be18c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:54.762086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d4b69-7b0f-43ed-a2d2-6c44543be18c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:54.763473 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d4b69-7b0f-43ed-a2d2-6c44543be18c None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:54.769398 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 500/1011] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:54.774836 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38236f-e592-4e76-a37a-7de2445a2a23 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:54.880664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38236f-e592-4e76-a37a-7de2445a2a23 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:54.914391 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59c9f4-8e84-43b0-9cd6-206b64d078b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:54.915066 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59c9f4-8e84-43b0-9cd6-206b64d078b6 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.915355 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59c9f4-8e84-43b0-9cd6-206b64d078b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.915636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59c9f4-8e84-43b0-9cd6-206b64d078b6 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.916348 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59c9f4-8e84-43b0-9cd6-206b64d078b6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:54.916660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59c9f4-8e84-43b0-9cd6-206b64d078b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:54.918071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59c9f4-8e84-43b0-9cd6-206b64d078b6 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:54.923646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 512/1012] 10.222.0.23 () {56 vars in 1112 bytes} [Thu Jun 16 14:44:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:54.929973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d4b69-7b0f-43ed-a2d2-6c44543be18c None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:54.997892 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e3ef2-0e9e-45ac-953d-ab97ae281e83 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:54.998434 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e3ef2-0e9e-45ac-953d-ab97ae281e83 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:54.998434 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e3ef2-0e9e-45ac-953d-ab97ae281e83 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:54.999795 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 513/1013] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:55.005372 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f5422-55c2-41bb-9922-d0df6d49ca50 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:55.005667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f5422-55c2-41bb-9922-d0df6d49ca50 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:55.005947 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f5422-55c2-41bb-9922-d0df6d49ca50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:55.026028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-0b1f5422-55c2-41bb-9922-d0df6d49ca50 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:55.027969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0b1f5422-55c2-41bb-9922-d0df6d49ca50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:55.030296 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:55.045339 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d4b69-7b0f-43ed-a2d2-6c44543be18c None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:55.066601 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:55.081882 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496980e-8672-4661-be7c-048ca2079fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:55.082845 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496980e-8672-4661-be7c-048ca2079fd7 None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:55.083349 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496980e-8672-4661-be7c-048ca2079fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:55.083858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496980e-8672-4661-be7c-048ca2079fd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:55.084841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496980e-8672-4661-be7c-048ca2079fd7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:55.086466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496980e-8672-4661-be7c-048ca2079fd7 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:55.100028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 514/1014] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:55 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:55.124131 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f5422-55c2-41bb-9922-d0df6d49ca50 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:55.189181 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 501/1015] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 16 14:44:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:55.236769 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f5422-55c2-41bb-9922-d0df6d49ca50 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:55.285846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad33c62-7ba2-4ffd-b3bc-1ab1e6a1eefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:55.286667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33c62-7ba2-4ffd-b3bc-1ab1e6a1eefd None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:55.286954 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33c62-7ba2-4ffd-b3bc-1ab1e6a1eefd None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:55.287229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad33c62-7ba2-4ffd-b3bc-1ab1e6a1eefd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:55.288445 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad33c62-7ba2-4ffd-b3bc-1ab1e6a1eefd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:55.290017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad33c62-7ba2-4ffd-b3bc-1ab1e6a1eefd None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:55.296359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 515/1016] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:55.297681 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496980e-8672-4661-be7c-048ca2079fd7 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:55.405639 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496980e-8672-4661-be7c-048ca2079fd7 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:55.443361 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6a80b-b026-4d8c-9a4d-d3f480866b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:55.443949 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6a80b-b026-4d8c-9a4d-d3f480866b08 None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:55.444234 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6a80b-b026-4d8c-9a4d-d3f480866b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:55.444511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6a80b-b026-4d8c-9a4d-d3f480866b08 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:55.445261 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6a80b-b026-4d8c-9a4d-d3f480866b08 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:55.446678 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6a80b-b026-4d8c-9a4d-d3f480866b08 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:55.460874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:55.538934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 502/1017] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 16 14:44:55 2022] POST /identity/v3/projects => generated 311 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:56.770360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d307b-1cc8-4b6f-b186-9b4d4ceab087 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:56.770882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d307b-1cc8-4b6f-b186-9b4d4ceab087 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:56.770882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d307b-1cc8-4b6f-b186-9b4d4ceab087 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:56.772303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 516/1018] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:56.777399 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7a7a3-9cc8-4f5c-992f-b824cbc13571 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:56.777778 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7a7a3-9cc8-4f5c-992f-b824cbc13571 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:56.777971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7a7a3-9cc8-4f5c-992f-b824cbc13571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:56.794954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-59a7a7a3-9cc8-4f5c-992f-b824cbc13571 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:56.796161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-59a7a7a3-9cc8-4f5c-992f-b824cbc13571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:56.866217 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 503/1019] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:56 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:56.889009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d307b-1cc8-4b6f-b186-9b4d4ceab087 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:56.926176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:56.996952 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d307b-1cc8-4b6f-b186-9b4d4ceab087 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:57.032155 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2d845-cd56-4eed-9a64-29b5ad9a5885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:57.032756 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2d845-cd56-4eed-9a64-29b5ad9a5885 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:57.033113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2d845-cd56-4eed-9a64-29b5ad9a5885 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:57.033443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2d845-cd56-4eed-9a64-29b5ad9a5885 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:57.034181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2d845-cd56-4eed-9a64-29b5ad9a5885 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:57.035878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2d845-cd56-4eed-9a64-29b5ad9a5885 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:57.121163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 517/1020] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 16 14:44:56 2022] POST /identity/v3/services => generated 242 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:44:57.425373 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5c98-5b51-4475-b875-aa9799e79d6c None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:57.425700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5c98-5b51-4475-b875-aa9799e79d6c None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:57.425912 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5c98-5b51-4475-b875-aa9799e79d6c None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:57.427278 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 504/1021] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:57.432498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f5e06-d49a-4eaf-b9c0-a329cfe93318 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:57.432801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f5e06-d49a-4eaf-b9c0-a329cfe93318 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:57.433083 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f5e06-d49a-4eaf-b9c0-a329cfe93318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:57.450480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-f59f5e06-d49a-4eaf-b9c0-a329cfe93318 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:57.451665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-f59f5e06-d49a-4eaf-b9c0-a329cfe93318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:57.523712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 518/1022] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:44:57.547456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c5c98-5b51-4475-b875-aa9799e79d6c None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:57.656485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c5c98-5b51-4475-b875-aa9799e79d6c None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:57.684715 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:57.695520 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8831e-9d63-488c-85a9-594c52e68dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:57.696335 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8831e-9d63-488c-85a9-594c52e68dfb None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:57.696618 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8831e-9d63-488c-85a9-594c52e68dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:57.706031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8831e-9d63-488c-85a9-594c52e68dfb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:57.707126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8831e-9d63-488c-85a9-594c52e68dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:44:57.712710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24455b-825d-46da-adb5-8eceadae89b7 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:57.713007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24455b-825d-46da-adb5-8eceadae89b7 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:57.713326 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24455b-825d-46da-adb5-8eceadae89b7 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:57.714851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 519/1023] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:44:57.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-49a8831e-9d63-488c-85a9-594c52e68dfb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:57.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:57.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:57.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:57.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:57.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:57.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:57.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:57.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:57.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:57.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:57.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:57.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:44:57.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:44:57.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:44:57.715455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:44:57.716562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:44:57.716562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:44:57.716562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:44:57.716562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:44:57.716562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:57.716562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:57.716562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:57.716562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:57.716562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:57.716562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:57.716562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:57.716562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:57.716562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:57.716562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:57.716562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:57.716562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:57.722989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:57.722989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:57.722989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:57.722989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:57.722989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:44:57.722989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:44:57.722989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:44:57.722989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:44:57.722989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:44:57.722989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:44:57.722989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:44:57.722989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:57.722989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 505/1024] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jun 16 14:44:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:57.723684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ec057-c038-430e-852f-23b365dacbc4 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:57.723684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ec057-c038-430e-852f-23b365dacbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:57.723684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ec057-c038-430e-852f-23b365dacbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:57.725389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8831e-9d63-488c-85a9-594c52e68dfb None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:57.738972 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-860ec057-c038-430e-852f-23b365dacbc4 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:57.740178 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-860ec057-c038-430e-852f-23b365dacbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:57.755120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:57.814257 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 520/1025] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:57.834966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8831e-9d63-488c-85a9-594c52e68dfb None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:57.838808 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ec057-c038-430e-852f-23b365dacbc4 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:57.871814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93824dc5-df7f-42a4-bf7b-0f7777995ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:57.872486 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93824dc5-df7f-42a4-bf7b-0f7777995ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:57.872771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93824dc5-df7f-42a4-bf7b-0f7777995ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:57.873049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93824dc5-df7f-42a4-bf7b-0f7777995ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:57.873822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93824dc5-df7f-42a4-bf7b-0f7777995ae1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:57.874833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93824dc5-df7f-42a4-bf7b-0f7777995ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:57.875502 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93824dc5-df7f-42a4-bf7b-0f7777995ae1 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:57.883969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 506/1026] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jun 16 14:44:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:57.889315 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93824dc5-df7f-42a4-bf7b-0f7777995ae1 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:57.940463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:57.943076 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ec057-c038-430e-852f-23b365dacbc4 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:57.984599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713f5ba-8013-4394-a3f7-7f94521e8016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:57.985434 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713f5ba-8013-4394-a3f7-7f94521e8016 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:57.985719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713f5ba-8013-4394-a3f7-7f94521e8016 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:57.985999 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713f5ba-8013-4394-a3f7-7f94521e8016 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:57.987392 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713f5ba-8013-4394-a3f7-7f94521e8016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:57.988653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713f5ba-8013-4394-a3f7-7f94521e8016 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:57.990474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 521/1027] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:57.995742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713f5ba-8013-4394-a3f7-7f94521e8016 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:58.003512 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93824dc5-df7f-42a4-bf7b-0f7777995ae1 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:58.014936 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:58.041379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fcdae-12f1-4d43-b4f5-e1c85405e00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:58.042174 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fcdae-12f1-4d43-b4f5-e1c85405e00d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:58.042460 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fcdae-12f1-4d43-b4f5-e1c85405e00d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:58.042742 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fcdae-12f1-4d43-b4f5-e1c85405e00d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:58.054891 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fcdae-12f1-4d43-b4f5-e1c85405e00d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:58.056365 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fcdae-12f1-4d43-b4f5-e1c85405e00d None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:58.073682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-425fcdae-12f1-4d43-b4f5-e1c85405e00d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:58.073682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:58.073682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:58.073682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:58.073682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:58.073682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:58.073682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:58.073682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:58.073682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:58.073682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:58.073682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:58.073682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:58.073682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:58.073682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:58.073682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:58.074575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:58.076161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:58.076161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:58.076161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:58.076161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:58.076161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 507/1028] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:58.080465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fcdae-12f1-4d43-b4f5-e1c85405e00d None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:58.101899 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713f5ba-8013-4394-a3f7-7f94521e8016 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:58.137206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123748ff-0b49-4d77-bed6-62c9af460f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:58.137901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123748ff-0b49-4d77-bed6-62c9af460f7b None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:58.138184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123748ff-0b49-4d77-bed6-62c9af460f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:58.138462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123748ff-0b49-4d77-bed6-62c9af460f7b None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:58.139160 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123748ff-0b49-4d77-bed6-62c9af460f7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:58.140579 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123748ff-0b49-4d77-bed6-62c9af460f7b None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:58.178085 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:58.181989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fcdae-12f1-4d43-b4f5-e1c85405e00d None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:58.215101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7389c4-bc6e-4ff8-8e10-a0d55b8809db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:58.215740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7389c4-bc6e-4ff8-8e10-a0d55b8809db None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:58.216028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7389c4-bc6e-4ff8-8e10-a0d55b8809db None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:58.216310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7389c4-bc6e-4ff8-8e10-a0d55b8809db None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:58.217024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7389c4-bc6e-4ff8-8e10-a0d55b8809db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:58.217364 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7389c4-bc6e-4ff8-8e10-a0d55b8809db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:58.218731 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7389c4-bc6e-4ff8-8e10-a0d55b8809db None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:58.230269 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 508/1029] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:58.236815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7389c4-bc6e-4ff8-8e10-a0d55b8809db None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:58.240895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 522/1030] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:44:57 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:44:58.352899 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7389c4-bc6e-4ff8-8e10-a0d55b8809db None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:58.390520 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c00992-b0b6-4923-89eb-4c5f1783c413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:58.391338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c00992-b0b6-4923-89eb-4c5f1783c413 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:58.391632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c00992-b0b6-4923-89eb-4c5f1783c413 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:58.391909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c00992-b0b6-4923-89eb-4c5f1783c413 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:58.400544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c00992-b0b6-4923-89eb-4c5f1783c413 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:58.402025 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c00992-b0b6-4923-89eb-4c5f1783c413 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:58.416947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-19c00992-b0b6-4923-89eb-4c5f1783c413 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:58.416947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:58.416947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:58.416947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:58.416947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:58.416947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:58.416947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:58.416947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:58.416947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:58.416947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:58.416947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:58.416947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:58.416947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:44:58.416947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:44:58.416947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:44:58.416947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:58.417980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:58.418913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:58.418913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:58.418913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:44:58.418913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:44:58.418913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:44:58.418913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:44:58.418913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:44:58.418913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:44:58.418913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:44:58.418913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:44:58.418913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 509/1031] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 16 14:44:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:58.424057 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123748ff-0b49-4d77-bed6-62c9af460f7b None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:58.505027 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:58.528887 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123748ff-0b49-4d77-bed6-62c9af460f7b None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:58.563934 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375709a-d808-4e5f-b8f1-3677aede65d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:58.564662 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375709a-d808-4e5f-b8f1-3677aede65d8 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:58.564945 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375709a-d808-4e5f-b8f1-3677aede65d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:58.565249 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375709a-d808-4e5f-b8f1-3677aede65d8 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:58.566692 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375709a-d808-4e5f-b8f1-3677aede65d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:58.567005 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375709a-d808-4e5f-b8f1-3677aede65d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:58.568422 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375709a-d808-4e5f-b8f1-3677aede65d8 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:58.590680 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 523/1032] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 16 14:44:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:58.592221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c00992-b0b6-4923-89eb-4c5f1783c413 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:58.611119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:58.693442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c00992-b0b6-4923-89eb-4c5f1783c413 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:58.729014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8916d-2fb2-4f88-846e-4190becf79a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:58.729696 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8916d-2fb2-4f88-846e-4190becf79a5 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:58.729979 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8916d-2fb2-4f88-846e-4190becf79a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:58.730254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8916d-2fb2-4f88-846e-4190becf79a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:58.799885 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8916d-2fb2-4f88-846e-4190becf79a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:58.801821 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8916d-2fb2-4f88-846e-4190becf79a5 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:58.820580 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:58.907457 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 510/1033] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:44:58 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:44:58.910067 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375709a-d808-4e5f-b8f1-3677aede65d8 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:59.017632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375709a-d808-4e5f-b8f1-3677aede65d8 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:59.047685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:59.054037 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8a14a-e1e9-4f1d-9d82-17dc46f78bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:59.054783 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8a14a-e1e9-4f1d-9d82-17dc46f78bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:59.055072 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8a14a-e1e9-4f1d-9d82-17dc46f78bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:59.055441 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8a14a-e1e9-4f1d-9d82-17dc46f78bf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:59.065225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8a14a-e1e9-4f1d-9d82-17dc46f78bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:59.066731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8a14a-e1e9-4f1d-9d82-17dc46f78bf1 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:59.085161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-6bf8a14a-e1e9-4f1d-9d82-17dc46f78bf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:59.085161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:59.085161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:59.085161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:59.085161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:59.085161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:59.085161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:59.085161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:59.085161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:59.085161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:59.085161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:59.085161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:59.085161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:44:59.085161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:44:59.085161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:59.086139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:59.092026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:44:59.092026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:44:59.092026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:44:59.092026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:59.092026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 524/1034] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:59.093865 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8916d-2fb2-4f88-846e-4190becf79a5 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:59.194666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8916d-2fb2-4f88-846e-4190becf79a5 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:59.212433 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:59.229007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd1bae-9ce8-49a7-a4b1-9b6b73337414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:59.229816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd1bae-9ce8-49a7-a4b1-9b6b73337414 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:59.230123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd1bae-9ce8-49a7-a4b1-9b6b73337414 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:59.230398 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd1bae-9ce8-49a7-a4b1-9b6b73337414 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:59.231108 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd1bae-9ce8-49a7-a4b1-9b6b73337414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:59.231435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd1bae-9ce8-49a7-a4b1-9b6b73337414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:59.232927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd1bae-9ce8-49a7-a4b1-9b6b73337414 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:59.246420 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 511/1035] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:59.252654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8a14a-e1e9-4f1d-9d82-17dc46f78bf1 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:59.309588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9bef6-a376-4c4c-a76d-3d45bb2ac840 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:59.309875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9bef6-a376-4c4c-a76d-3d45bb2ac840 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:59.310098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9bef6-a376-4c4c-a76d-3d45bb2ac840 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:59.311913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 512/1036] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:44:59.318059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb60cbd-aca9-4dd3-910d-89bdb486c6d6 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:59.318355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb60cbd-aca9-4dd3-910d-89bdb486c6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:59.318636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb60cbd-aca9-4dd3-910d-89bdb486c6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:59.335968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-0fb60cbd-aca9-4dd3-910d-89bdb486c6d6 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:44:59.337306 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-0fb60cbd-aca9-4dd3-910d-89bdb486c6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:44:59.358053 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8a14a-e1e9-4f1d-9d82-17dc46f78bf1 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:59.397826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15426e1b-2464-4bfc-aea9-dabe9ff66764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:59.399153 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15426e1b-2464-4bfc-aea9-dabe9ff66764 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:59.399455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15426e1b-2464-4bfc-aea9-dabe9ff66764 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:59.399754 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15426e1b-2464-4bfc-aea9-dabe9ff66764 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:59.406834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15426e1b-2464-4bfc-aea9-dabe9ff66764 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:59.408375 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15426e1b-2464-4bfc-aea9-dabe9ff66764 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:59.411529 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 513/1037] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:44:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:44:59.423161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-15426e1b-2464-4bfc-aea9-dabe9ff66764 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:59.423161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:59.423161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:59.423161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:59.423161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:59.423161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:59.423161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:59.423161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:59.423161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:59.423161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:59.423161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:59.423161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:59.423161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:44:59.423161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:44:59.423161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:59.424077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:59.424993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:44:59.424993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:44:59.424993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:44:59.424993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:44:59.424993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:44:59.424993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:44:59.424993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:44:59.424993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:59.424993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 525/1038] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:44:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:44:59.430675 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb60cbd-aca9-4dd3-910d-89bdb486c6d6 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:59.435175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15426e1b-2464-4bfc-aea9-dabe9ff66764 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:59.488978 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:59.541934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb60cbd-aca9-4dd3-910d-89bdb486c6d6 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:59.544002 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15426e1b-2464-4bfc-aea9-dabe9ff66764 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:59.552535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:59.581019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34a1e0-709f-463f-be03-33a537ffcf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:59.581545 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce707a2-76b7-4c30-afd8-5b3a3ff718fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:59.582105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34a1e0-709f-463f-be03-33a537ffcf71 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:59.582397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce707a2-76b7-4c30-afd8-5b3a3ff718fa None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:59.582680 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce707a2-76b7-4c30-afd8-5b3a3ff718fa None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:59.582777 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34a1e0-709f-463f-be03-33a537ffcf71 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:59.582993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce707a2-76b7-4c30-afd8-5b3a3ff718fa None admin] PATH_INFO: `/v3/services/image` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:59.583089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34a1e0-709f-463f-be03-33a537ffcf71 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:59.583709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce707a2-76b7-4c30-afd8-5b3a3ff718fa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:59.583883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34a1e0-709f-463f-be03-33a537ffcf71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:59.584159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34a1e0-709f-463f-be03-33a537ffcf71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:59.585642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34a1e0-709f-463f-be03-33a537ffcf71 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:59.588971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce707a2-76b7-4c30-afd8-5b3a3ff718fa None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:59.608130 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 514/1039] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:44:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-6ce707a2-76b7-4c30-afd8-5b3a3ff718fa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:44:59.608341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:44:59.609311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:44:59.609311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:44:59.609311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:44:59.609311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:44:59.609311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:44:59.609311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:44:59.609311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:44:59.609311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:44:59.609311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:44:59.609311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:44:59.609311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:44:59.609311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:44:59.609311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:44:59.609311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:44:59.609311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:44:59.609311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:44:59.610168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:44:59.610168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:44:59.610168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:44:59.610168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:44:59.610168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:44:59.610168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:44:59.610168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:44:59.610168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:44:59.610168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:44:59.610168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:44:59.610168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:44:59.610168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:44:59.610168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:44:59.610168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:44:59.610903 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34a1e0-709f-463f-be03-33a537ffcf71 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:59.611658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 526/1040] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Jun 16 14:44:59 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:44:59.612139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce707a2-76b7-4c30-afd8-5b3a3ff718fa None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:59.719044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce707a2-76b7-4c30-afd8-5b3a3ff718fa None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:59.719646 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34a1e0-709f-463f-be03-33a537ffcf71 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:59.728317 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:44:59.753389 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c0c5c-b2be-4ff3-b4ec-f85568a4d83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:59.753833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c12b9d-35f2-4d14-9bd1-47220ae537ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:59.754100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c0c5c-b2be-4ff3-b4ec-f85568a4d83e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:59.754412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c0c5c-b2be-4ff3-b4ec-f85568a4d83e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:59.754521 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c12b9d-35f2-4d14-9bd1-47220ae537ce None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:59.754693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c0c5c-b2be-4ff3-b4ec-f85568a4d83e None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:59.754798 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c12b9d-35f2-4d14-9bd1-47220ae537ce None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:59.755026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c12b9d-35f2-4d14-9bd1-47220ae537ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:59.755391 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c0c5c-b2be-4ff3-b4ec-f85568a4d83e None admin] RBAC: Adding query filter params (name=image) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:59.755702 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c0c5c-b2be-4ff3-b4ec-f85568a4d83e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:59.755858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c12b9d-35f2-4d14-9bd1-47220ae537ce None admin] RBAC: Adding query filter params (role.id=53ff5be561de46ca931c143cf800c0f7, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=60c2f1c63a674e3195c490ab5ad1318f) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:59.756154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c12b9d-35f2-4d14-9bd1-47220ae537ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:59.757072 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c0c5c-b2be-4ff3-b4ec-f85568a4d83e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:59.757623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c12b9d-35f2-4d14-9bd1-47220ae537ce None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:59.767715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 527/1041] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:59.769265 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c0c5c-b2be-4ff3-b4ec-f85568a4d83e None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:59.769689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 515/1042] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:44:59 2022] GET /identity/v3/role_assignments?user.id=60c2f1c63a674e3195c490ab5ad1318f&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=53ff5be561de46ca931c143cf800c0f7 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:44:59.881289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c0c5c-b2be-4ff3-b4ec-f85568a4d83e None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:44:59.918257 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a9e90-e2ef-4d33-ab31-3e2ebf90b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:44:59.918901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a9e90-e2ef-4d33-ab31-3e2ebf90b6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:44:59.918901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a9e90-e2ef-4d33-ab31-3e2ebf90b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:44:59.918901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a9e90-e2ef-4d33-ab31-3e2ebf90b6f9 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:44:59.919627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a9e90-e2ef-4d33-ab31-3e2ebf90b6f9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:44:59.919936 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a9e90-e2ef-4d33-ab31-3e2ebf90b6f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:44:59.921415 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a9e90-e2ef-4d33-ab31-3e2ebf90b6f9 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:44:59.927412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 528/1043] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:44:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:44:59.933087 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c12b9d-35f2-4d14-9bd1-47220ae537ce None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:44:59.979203 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:00.056936 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c12b9d-35f2-4d14-9bd1-47220ae537ce None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:00.090428 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb4bdf-42bf-46c7-9fa7-ff69c9230571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:00.091098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb4bdf-42bf-46c7-9fa7-ff69c9230571 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:00.091384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb4bdf-42bf-46c7-9fa7-ff69c9230571 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:00.091662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb4bdf-42bf-46c7-9fa7-ff69c9230571 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:00.092728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb4bdf-42bf-46c7-9fa7-ff69c9230571 None admin] RBAC: Adding query filter params (interface=public, service_id=c16a7259e8eb40eb83f4244ad3271aca, region_id=RegionOne) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:00.093047 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb4bdf-42bf-46c7-9fa7-ff69c9230571 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:00.094709 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb4bdf-42bf-46c7-9fa7-ff69c9230571 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:00.100117 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 516/1044] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jun 16 14:44:59 2022] GET /identity/v3/endpoints?service_id=c16a7259e8eb40eb83f4244ad3271aca&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:00.105591 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a9e90-e2ef-4d33-ab31-3e2ebf90b6f9 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:00.141680 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:00.207021 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a9e90-e2ef-4d33-ab31-3e2ebf90b6f9 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:00.241229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ddc7b-3bfe-4687-85bc-a6c3ed69a042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:00.241906 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ddc7b-3bfe-4687-85bc-a6c3ed69a042 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:00.242189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ddc7b-3bfe-4687-85bc-a6c3ed69a042 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:00.242466 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ddc7b-3bfe-4687-85bc-a6c3ed69a042 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:00.243142 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ddc7b-3bfe-4687-85bc-a6c3ed69a042 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:00.244506 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ddc7b-3bfe-4687-85bc-a6c3ed69a042 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:00.251121 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 529/1045] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 16 14:45:00 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:45:00.518752 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ee8fe-bec3-44ec-a4ee-c57c2cc131d8 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:00.519105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ee8fe-bec3-44ec-a4ee-c57c2cc131d8 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:00.519353 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ee8fe-bec3-44ec-a4ee-c57c2cc131d8 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:00.521351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 517/1046] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:00.526683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc19a3c-c7b0-45c5-92c1-5eb629aa9118 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:00.526988 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc19a3c-c7b0-45c5-92c1-5eb629aa9118 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:00.527273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc19a3c-c7b0-45c5-92c1-5eb629aa9118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:00.544550 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-7fc19a3c-c7b0-45c5-92c1-5eb629aa9118 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:00.545785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-7fc19a3c-c7b0-45c5-92c1-5eb629aa9118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:00.612511 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 530/1047] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:45:00.635780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ee8fe-bec3-44ec-a4ee-c57c2cc131d8 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:00.742685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:00.749801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ee8fe-bec3-44ec-a4ee-c57c2cc131d8 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:00.784303 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cccaff-a347-4efd-ae81-79d7f5d08d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:00.785391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cccaff-a347-4efd-ae81-79d7f5d08d9d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:00.785629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cccaff-a347-4efd-ae81-79d7f5d08d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:00.785908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cccaff-a347-4efd-ae81-79d7f5d08d9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:00.795955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cccaff-a347-4efd-ae81-79d7f5d08d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:00.804189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-05cccaff-a347-4efd-ae81-79d7f5d08d9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:00.804189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:00.804189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:00.804189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:00.804189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:00.804189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:00.804189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:00.804189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:00.804189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:00.804189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:00.804189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:00.804189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:00.804189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:00.804189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:00.804189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:00.804189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:00.810819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:00.810819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:00.810819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:00.810819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:00.810819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:00.810819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:00.810819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:00.810819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:00.810819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:00.810819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:00.810819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:00.810819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:00.810819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:00.810819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:00.810819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:00.810819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:00.811654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:00.811654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:00.811654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:00.811654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:00.811654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:00.811654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:00.811654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:00.811654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:00.811654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:00.811654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:00.811654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:00.811654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:45:00.811654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 518/1048] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:45:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:00.812371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc19a3c-c7b0-45c5-92c1-5eb629aa9118 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:00.843168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:00.913476 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc19a3c-c7b0-45c5-92c1-5eb629aa9118 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:00.948216 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdb7ac-92e3-4756-8e58-8d6243110aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:00.949084 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdb7ac-92e3-4756-8e58-8d6243110aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:00.949322 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdb7ac-92e3-4756-8e58-8d6243110aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:00.949601 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdb7ac-92e3-4756-8e58-8d6243110aa1 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:00.950359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdb7ac-92e3-4756-8e58-8d6243110aa1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:00.950672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdb7ac-92e3-4756-8e58-8d6243110aa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:00.952069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdb7ac-92e3-4756-8e58-8d6243110aa1 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:00.965393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 531/1049] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:45:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:00.967153 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cccaff-a347-4efd-ae81-79d7f5d08d9d None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:01.070777 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cccaff-a347-4efd-ae81-79d7f5d08d9d None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:01.103248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba91e22-f3fa-491c-a17f-8e59e4ec7494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:01.104124 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba91e22-f3fa-491c-a17f-8e59e4ec7494 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:01.104415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba91e22-f3fa-491c-a17f-8e59e4ec7494 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:01.104698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba91e22-f3fa-491c-a17f-8e59e4ec7494 None admin] PATH_INFO: `/v3/users/5984b01a35994cb19dc513f6908636a1` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:01.118463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba91e22-f3fa-491c-a17f-8e59e4ec7494 None admin] RBAC: Authorizing `identity:get_user(user_id=5984b01a35994cb19dc513f6908636a1)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:01.119910 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba91e22-f3fa-491c-a17f-8e59e4ec7494 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:01.126376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 519/1050] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:00 2022] GET /identity/v3/users/5984b01a35994cb19dc513f6908636a1 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:01.127745 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdb7ac-92e3-4756-8e58-8d6243110aa1 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:01.221575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:01.230655 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdb7ac-92e3-4756-8e58-8d6243110aa1 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:01.263229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bf447-03ce-4280-a527-8a134a30afa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:01.264326 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bf447-03ce-4280-a527-8a134a30afa1 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:01.264856 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bf447-03ce-4280-a527-8a134a30afa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:01.265666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bf447-03ce-4280-a527-8a134a30afa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:01.333381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bf447-03ce-4280-a527-8a134a30afa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:01.334822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bf447-03ce-4280-a527-8a134a30afa1 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:01.428239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:01.438222 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 532/1051] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:45:01 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:45:01.443796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba91e22-f3fa-491c-a17f-8e59e4ec7494 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:01.460004 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:01.545051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba91e22-f3fa-491c-a17f-8e59e4ec7494 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:01.578155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e6927-9018-48e9-b618-69f605dc3d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:01.579025 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e6927-9018-48e9-b618-69f605dc3d60 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:01.579314 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e6927-9018-48e9-b618-69f605dc3d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:01.579593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e6927-9018-48e9-b618-69f605dc3d60 None admin] PATH_INFO: `/v3/projects/8267aabbce3b4dd483cf52be84f0d1a3` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:01.580777 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e6927-9018-48e9-b618-69f605dc3d60 None admin] RBAC: Authorizing `identity:get_project(project_id=8267aabbce3b4dd483cf52be84f0d1a3)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:01.582786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e6927-9018-48e9-b618-69f605dc3d60 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:01.584750 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 520/1052] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:45:01 2022] GET /identity/v3/projects/8267aabbce3b4dd483cf52be84f0d1a3 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:01.590433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bf447-03ce-4280-a527-8a134a30afa1 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:01.688272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bf447-03ce-4280-a527-8a134a30afa1 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:01.722369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346ee54-9276-455f-ac42-a628d08395a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:01.723591 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346ee54-9276-455f-ac42-a628d08395a5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:01.723878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346ee54-9276-455f-ac42-a628d08395a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:01.724151 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346ee54-9276-455f-ac42-a628d08395a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:01.724984 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346ee54-9276-455f-ac42-a628d08395a5 None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.project.id=8267aabbce3b4dd483cf52be84f0d1a3, user.id=5984b01a35994cb19dc513f6908636a1) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:01.725329 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346ee54-9276-455f-ac42-a628d08395a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:01.726909 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346ee54-9276-455f-ac42-a628d08395a5 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:01.733285 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 533/1053] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:45:01 2022] GET /identity/v3/role_assignments?user.id=5984b01a35994cb19dc513f6908636a1&scope.project.id=8267aabbce3b4dd483cf52be84f0d1a3&role.id=c865040abd6c4b099381557da21c471d => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:01.893856 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f661707-106d-40e5-9f45-c8c51c234a43 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:01.894161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f661707-106d-40e5-9f45-c8c51c234a43 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:01.894334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f661707-106d-40e5-9f45-c8c51c234a43 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:01.896316 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 521/1054] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:01.901912 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87c7ee-76d0-4318-a75d-22507ffc65ce None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:01.902204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87c7ee-76d0-4318-a75d-22507ffc65ce None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:01.902487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87c7ee-76d0-4318-a75d-22507ffc65ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:01.919961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-0a87c7ee-76d0-4318-a75d-22507ffc65ce None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:01.921206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0a87c7ee-76d0-4318-a75d-22507ffc65ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:01.975085 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:01.990622 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 534/1055] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:02.013166 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f661707-106d-40e5-9f45-c8c51c234a43 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:02.102619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:02.121654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f661707-106d-40e5-9f45-c8c51c234a43 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:02.157167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70937cb5-231c-4dc8-8f78-d865fe0f0680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:02.157919 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70937cb5-231c-4dc8-8f78-d865fe0f0680 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:02.158207 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70937cb5-231c-4dc8-8f78-d865fe0f0680 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:02.158505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70937cb5-231c-4dc8-8f78-d865fe0f0680 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:02.169081 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70937cb5-231c-4dc8-8f78-d865fe0f0680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:02.177635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-70937cb5-231c-4dc8-8f78-d865fe0f0680 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:45:02.177635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:02.177635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:02.177635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:02.177635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:02.177635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:02.177635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:02.177635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:02.177635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:02.177635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:02.177635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:02.177635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:02.177635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:02.177635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:02.177635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:02.177635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:02.178589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:02.178589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:02.178589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:02.178589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:02.178589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:02.178589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:02.178589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:02.178589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:02.178589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:02.178589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:02.178589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:02.178589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:02.178589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:02.178589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:02.178589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:02.178589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:02.179685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:02.179685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:02.179685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:02.179685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:02.179685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:02.179685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:02.179685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:02.179685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:02.179685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:02.179685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:02.179685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:45:02.179685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:45:02.179685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 522/1056] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jun 16 14:45:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:02.184888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87c7ee-76d0-4318-a75d-22507ffc65ce None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:02.285568 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87c7ee-76d0-4318-a75d-22507ffc65ce None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:02.320423 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf67a7-dd3e-426a-826b-4bfda7de5361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:02.321123 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf67a7-dd3e-426a-826b-4bfda7de5361 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:02.321434 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf67a7-dd3e-426a-826b-4bfda7de5361 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:02.321710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf67a7-dd3e-426a-826b-4bfda7de5361 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:02.322480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf67a7-dd3e-426a-826b-4bfda7de5361 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:02.322790 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf67a7-dd3e-426a-826b-4bfda7de5361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:02.324213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf67a7-dd3e-426a-826b-4bfda7de5361 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:02.337356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 535/1057] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jun 16 14:45:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:02.339670 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70937cb5-231c-4dc8-8f78-d865fe0f0680 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:02.391033 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b99d6b-5182-4163-b28c-0fb7b7781c6c None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:02.391334 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b99d6b-5182-4163-b28c-0fb7b7781c6c None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:02.391799 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b99d6b-5182-4163-b28c-0fb7b7781c6c None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:02.393426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 536/1058] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:02.399287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce9e82-eea7-4f22-b547-916b49d00aec None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:02.399584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce9e82-eea7-4f22-b547-916b49d00aec None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:02.399872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce9e82-eea7-4f22-b547-916b49d00aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:02.416743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-f2ce9e82-eea7-4f22-b547-916b49d00aec None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:02.417893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-f2ce9e82-eea7-4f22-b547-916b49d00aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:02.451390 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70937cb5-231c-4dc8-8f78-d865fe0f0680 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:02.464573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:02.486924 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3063cc-277f-481d-a6e5-1e0085e1c78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:02.487781 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3063cc-277f-481d-a6e5-1e0085e1c78f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:02.488067 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3063cc-277f-481d-a6e5-1e0085e1c78f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:02.488871 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3063cc-277f-481d-a6e5-1e0085e1c78f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:02.489472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 537/1059] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:45:02.499921 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3063cc-277f-481d-a6e5-1e0085e1c78f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:02.501398 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3063cc-277f-481d-a6e5-1e0085e1c78f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:02.503135 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:02.512269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce9e82-eea7-4f22-b547-916b49d00aec None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:02.521837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-5d3063cc-277f-481d-a6e5-1e0085e1c78f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:02.521837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:02.521837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:02.521837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:02.521837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:02.521837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:02.521837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:02.521837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:02.521837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:02.521837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:02.521837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:02.521837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:02.521837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:45:02.521837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:45:02.521837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:02.522745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:02.528597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:45:02.528597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:45:02.528597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:02.528597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:45:02.528597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 523/1060] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:02.529275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3063cc-277f-481d-a6e5-1e0085e1c78f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:02.615442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce9e82-eea7-4f22-b547-916b49d00aec None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:02.633460 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3063cc-277f-481d-a6e5-1e0085e1c78f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:02.651017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cee3f-7df2-4a04-8ee5-9d6466769271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:02.651806 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cee3f-7df2-4a04-8ee5-9d6466769271 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:02.652093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cee3f-7df2-4a04-8ee5-9d6466769271 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:02.652370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cee3f-7df2-4a04-8ee5-9d6466769271 None admin] PATH_INFO: `/v3/services/image` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:02.653023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7cee3f-7df2-4a04-8ee5-9d6466769271 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:02.654433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7cee3f-7df2-4a04-8ee5-9d6466769271 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-ac7cee3f-7df2-4a04-8ee5-9d6466769271 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:02.667254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:02.668223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:02.668223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:02.668223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:02.668223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:02.668223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:02.668223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:02.668223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:45:02.668223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:45:02.668223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:45:02.668223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:45:02.668223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:02.668223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:02.668223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:02.668223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:02.668223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:02.668223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:02.669711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:02.669711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:02.669711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:02.669711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:02.669711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:02.669711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:02.669711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:02.669711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:02.669711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:02.669711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:02.669711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:45:02.669711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:45:02.669711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 14:45:02.669711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:45:02.669711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 538/1061] 10.222.0.23 () {56 vars in 1105 bytes} [Thu Jun 16 14:45:02 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:45:02.671328 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57e7cb-c7ac-4bdf-a8dc-4dcf38dc420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:02.671989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57e7cb-c7ac-4bdf-a8dc-4dcf38dc420e None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:02.672276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57e7cb-c7ac-4bdf-a8dc-4dcf38dc420e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:02.672555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57e7cb-c7ac-4bdf-a8dc-4dcf38dc420e None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:02.673364 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57e7cb-c7ac-4bdf-a8dc-4dcf38dc420e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:02.673676 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57e7cb-c7ac-4bdf-a8dc-4dcf38dc420e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:02.674209 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cee3f-7df2-4a04-8ee5-9d6466769271 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:02.675146 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57e7cb-c7ac-4bdf-a8dc-4dcf38dc420e None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:02.689445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 524/1062] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:02.695035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57e7cb-c7ac-4bdf-a8dc-4dcf38dc420e None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:02.722213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:02.762327 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:02.781051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cee3f-7df2-4a04-8ee5-9d6466769271 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:02.809435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57e7cb-c7ac-4bdf-a8dc-4dcf38dc420e None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:02.817822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40359beb-72fa-4024-bb32-6d7d9b745935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:02.818409 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40359beb-72fa-4024-bb32-6d7d9b745935 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:02.818698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40359beb-72fa-4024-bb32-6d7d9b745935 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:02.818979 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40359beb-72fa-4024-bb32-6d7d9b745935 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:02.819690 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40359beb-72fa-4024-bb32-6d7d9b745935 None admin] RBAC: Adding query filter params (name=image) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:02.820002 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40359beb-72fa-4024-bb32-6d7d9b745935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:02.821412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40359beb-72fa-4024-bb32-6d7d9b745935 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:02.826764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 539/1063] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:02.833361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40359beb-72fa-4024-bb32-6d7d9b745935 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:02.855200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30e8ad-7d84-478c-a5b2-b7b5da2e44bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:02.856086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30e8ad-7d84-478c-a5b2-b7b5da2e44bd None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:02.856377 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30e8ad-7d84-478c-a5b2-b7b5da2e44bd None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:02.856658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30e8ad-7d84-478c-a5b2-b7b5da2e44bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:02.864884 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30e8ad-7d84-478c-a5b2-b7b5da2e44bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:02.866364 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30e8ad-7d84-478c-a5b2-b7b5da2e44bd None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:02.883786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-0b30e8ad-7d84-478c-a5b2-b7b5da2e44bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:45:02.883786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:02.883786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:02.883786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:02.883786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:02.883786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:02.883786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:02.883786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:02.883786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:02.883786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:02.883786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:02.883786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:02.883786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:45:02.883786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:45:02.883786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:45:02.883786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:02.884737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:02.885711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:02.885711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:02.885711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:45:02.885711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:45:02.885711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:45:02.885711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:45:02.885711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:45:02.885711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:45:02.885711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:45:02.885711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:45:02.885711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 525/1064] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 16 14:45:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:45:02.890563 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30e8ad-7d84-478c-a5b2-b7b5da2e44bd None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:02.945322 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40359beb-72fa-4024-bb32-6d7d9b745935 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:02.953643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:02.987879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bb38c-fa05-4d28-acfc-7360f042e4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:02.989472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bb38c-fa05-4d28-acfc-7360f042e4fc None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:02.990179 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bb38c-fa05-4d28-acfc-7360f042e4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:02.990739 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bb38c-fa05-4d28-acfc-7360f042e4fc None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:02.991737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bb38c-fa05-4d28-acfc-7360f042e4fc None admin] RBAC: Adding query filter params (type=image) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:02.992053 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bb38c-fa05-4d28-acfc-7360f042e4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:02.993463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bb38c-fa05-4d28-acfc-7360f042e4fc None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:02.999982 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30e8ad-7d84-478c-a5b2-b7b5da2e44bd None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:03.003062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 540/1065] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:03.003936 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bb38c-fa05-4d28-acfc-7360f042e4fc None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:03.015318 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:03.037594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d54af5-f213-4200-8c0f-944379c33921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:03.038270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d54af5-f213-4200-8c0f-944379c33921 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:03.038561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d54af5-f213-4200-8c0f-944379c33921 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:03.038841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d54af5-f213-4200-8c0f-944379c33921 None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:03.039752 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d54af5-f213-4200-8c0f-944379c33921 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:03.040153 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d54af5-f213-4200-8c0f-944379c33921 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:03.041614 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d54af5-f213-4200-8c0f-944379c33921 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:03.061049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 526/1066] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 16 14:45:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:03.066328 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d54af5-f213-4200-8c0f-944379c33921 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:03.110810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bb38c-fa05-4d28-acfc-7360f042e4fc None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:03.145312 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29303430-1b22-42d7-96a6-adf1af7788c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:03.145967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29303430-1b22-42d7-96a6-adf1af7788c9 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:03.146251 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29303430-1b22-42d7-96a6-adf1af7788c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:03.146527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29303430-1b22-42d7-96a6-adf1af7788c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:03.147257 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29303430-1b22-42d7-96a6-adf1af7788c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:03.148619 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29303430-1b22-42d7-96a6-adf1af7788c9 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:03.173236 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d54af5-f213-4200-8c0f-944379c33921 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:03.207107 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbac16a-9c68-441c-a8de-589235e3f04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:03.207862 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbac16a-9c68-441c-a8de-589235e3f04d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:03.208148 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbac16a-9c68-441c-a8de-589235e3f04d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:03.208425 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbac16a-9c68-441c-a8de-589235e3f04d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:03.219072 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbac16a-9c68-441c-a8de-589235e3f04d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:03.220580 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbac16a-9c68-441c-a8de-589235e3f04d None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:03.223514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 541/1067] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 16 14:45:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:45:03.239391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-cbbac16a-9c68-441c-a8de-589235e3f04d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:03.239391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:03.239391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:03.239391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:03.239391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:03.239391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:03.239391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:03.239391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:03.239391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:03.239391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:03.239391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:03.239391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:03.239391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:45:03.239391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:45:03.239391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:03.240376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:03.241584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:45:03.241584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:45:03.241584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:03.241584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:45:03.241584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 527/1068] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:03.246501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29303430-1b22-42d7-96a6-adf1af7788c9 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:03.278051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:03.364405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29303430-1b22-42d7-96a6-adf1af7788c9 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:03.402725 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fbb37-c905-48e5-a859-3afe03b793f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:03.403404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fbb37-c905-48e5-a859-3afe03b793f0 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:03.403692 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fbb37-c905-48e5-a859-3afe03b793f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:03.403969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fbb37-c905-48e5-a859-3afe03b793f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:03.404691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fbb37-c905-48e5-a859-3afe03b793f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:03.405004 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fbb37-c905-48e5-a859-3afe03b793f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:03.406412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fbb37-c905-48e5-a859-3afe03b793f0 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:03.420825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 542/1069] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:03.426790 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbac16a-9c68-441c-a8de-589235e3f04d None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:03.456013 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:03.531102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbac16a-9c68-441c-a8de-589235e3f04d None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:03.566381 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10694a18-697d-47d3-af7a-fb0342dfcb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:03.567363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10694a18-697d-47d3-af7a-fb0342dfcb40 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:03.567748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10694a18-697d-47d3-af7a-fb0342dfcb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:03.568129 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10694a18-697d-47d3-af7a-fb0342dfcb40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:03.574994 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10694a18-697d-47d3-af7a-fb0342dfcb40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:03.576531 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10694a18-697d-47d3-af7a-fb0342dfcb40 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:03.590495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-10694a18-697d-47d3-af7a-fb0342dfcb40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:45:03.590495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:03.590495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:03.590495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:03.590495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:03.590495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:03.590495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:03.590495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:03.590495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:03.590495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:03.590495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:03.590495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:03.590495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:45:03.590495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:45:03.590495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:03.591570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:03.592655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:45:03.592655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:45:03.592655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:45:03.592655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:45:03.592655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:45:03.592655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:45:03.592655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:45:03.592655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:45:03.599244 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 528/1070] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:03.600439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fbb37-c905-48e5-a859-3afe03b793f0 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:03.683146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:03.701223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fbb37-c905-48e5-a859-3afe03b793f0 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:03.736962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3a3d7-d2db-4568-9e16-371d4c5a620d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:03.737807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3a3d7-d2db-4568-9e16-371d4c5a620d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:03.738194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3a3d7-d2db-4568-9e16-371d4c5a620d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:03.739382 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3a3d7-d2db-4568-9e16-371d4c5a620d None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:03.740272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3a3d7-d2db-4568-9e16-371d4c5a620d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:03.740683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3a3d7-d2db-4568-9e16-371d4c5a620d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:03.742264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3a3d7-d2db-4568-9e16-371d4c5a620d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:03.758776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 543/1071] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:03.760002 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10694a18-697d-47d3-af7a-fb0342dfcb40 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:03.852085 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:03.869089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10694a18-697d-47d3-af7a-fb0342dfcb40 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:03.895810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584167d-c842-4a9b-aba1-3d33b4391dbd None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:03.896107 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584167d-c842-4a9b-aba1-3d33b4391dbd None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:03.896395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584167d-c842-4a9b-aba1-3d33b4391dbd None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:03.898065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 544/1072] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:45:03.902891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea2d5a-d00b-4e8f-bd8e-bbe11721b8f8 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:03.903188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea2d5a-d00b-4e8f-bd8e-bbe11721b8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:03.903473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea2d5a-d00b-4e8f-bd8e-bbe11721b8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:03.904075 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c9a70-e0fc-4153-b1d5-ac91928a9a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:03.905037 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c9a70-e0fc-4153-b1d5-ac91928a9a1e None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:03.905425 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c9a70-e0fc-4153-b1d5-ac91928a9a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:03.905835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c9a70-e0fc-4153-b1d5-ac91928a9a1e None admin] PATH_INFO: `/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/60c2f1c63a674e3195c490ab5ad1318f/roles/53ff5be561de46ca931c143cf800c0f7` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:03.908078 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c9a70-e0fc-4153-b1d5-ac91928a9a1e None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9e5996685142bb94c83c5403fbf17d, user_id=60c2f1c63a674e3195c490ab5ad1318f, role_id=53ff5be561de46ca931c143cf800c0f7)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:03.911125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c9a70-e0fc-4153-b1d5-ac91928a9a1e None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:03.921729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-f1ea2d5a-d00b-4e8f-bd8e-bbe11721b8f8 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:03.922994 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-f1ea2d5a-d00b-4e8f-bd8e-bbe11721b8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:03.985329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 529/1073] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:45:03 2022] PUT /identity/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/60c2f1c63a674e3195c490ab5ad1318f/roles/53ff5be561de46ca931c143cf800c0f7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:45:04.000603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 545/1074] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:45:04.024052 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c9a70-e0fc-4153-b1d5-ac91928a9a1e None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:04.141848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c9a70-e0fc-4153-b1d5-ac91928a9a1e None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:04.177464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e8d8d-6f0d-4d8f-b45c-88f4276b4d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:04.178270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e8d8d-6f0d-4d8f-b45c-88f4276b4d2e None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:04.178598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e8d8d-6f0d-4d8f-b45c-88f4276b4d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:04.178902 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e8d8d-6f0d-4d8f-b45c-88f4276b4d2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:04.189070 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e8d8d-6f0d-4d8f-b45c-88f4276b4d2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:04.197334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-948e8d8d-6f0d-4d8f-b45c-88f4276b4d2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:04.197334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:04.197334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:04.197334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:04.197334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:04.197334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:04.197334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:04.197334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:04.197334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:04.197334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:04.197334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:04.197334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:04.197334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:04.197334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:04.197334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:04.197334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:04.198277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:04.198277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:04.198277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:04.198277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:04.198277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:04.198277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:04.198277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:04.198277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:04.198277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:04.198277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:04.198277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:04.198277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:04.198277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:04.198277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:04.198277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:04.198277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:04.199254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:04.199254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:04.199254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:04.199254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:04.199254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:04.199254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:04.199254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:04.199254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:04.199254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:04.199254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:04.199254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:04.199254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:45:04.199254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 530/1075] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:45:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:04.204796 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea2d5a-d00b-4e8f-bd8e-bbe11721b8f8 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:04.275241 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:04.305708 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea2d5a-d00b-4e8f-bd8e-bbe11721b8f8 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:04.340691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6483a2-52e9-45f3-b570-b780499e2276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:04.341406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6483a2-52e9-45f3-b570-b780499e2276 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:04.341697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6483a2-52e9-45f3-b570-b780499e2276 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:04.341977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6483a2-52e9-45f3-b570-b780499e2276 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:04.342761 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6483a2-52e9-45f3-b570-b780499e2276 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:04.343073 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6483a2-52e9-45f3-b570-b780499e2276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:04.344442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6483a2-52e9-45f3-b570-b780499e2276 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:04.353936 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 546/1076] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:45:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:04.360085 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e8d8d-6f0d-4d8f-b45c-88f4276b4d2e None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:04.367603 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:04.465882 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e8d8d-6f0d-4d8f-b45c-88f4276b4d2e None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:04.501008 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99494c7c-df28-47a7-b0ca-4bb6199e7204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:04.501924 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99494c7c-df28-47a7-b0ca-4bb6199e7204 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:04.502213 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99494c7c-df28-47a7-b0ca-4bb6199e7204 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:04.502495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99494c7c-df28-47a7-b0ca-4bb6199e7204 None admin] PATH_INFO: `/v3/users/5984b01a35994cb19dc513f6908636a1` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:04.503697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99494c7c-df28-47a7-b0ca-4bb6199e7204 None admin] RBAC: Authorizing `identity:get_user(user_id=5984b01a35994cb19dc513f6908636a1)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:04.505195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99494c7c-df28-47a7-b0ca-4bb6199e7204 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:04.511512 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 531/1077] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:04 2022] GET /identity/v3/users/5984b01a35994cb19dc513f6908636a1 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:04.512486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6483a2-52e9-45f3-b570-b780499e2276 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:04.610876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6483a2-52e9-45f3-b570-b780499e2276 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:04.643250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba4c63-21e6-4883-bf9b-e70b5f621cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:04.644123 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4c63-21e6-4883-bf9b-e70b5f621cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:04.644407 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4c63-21e6-4883-bf9b-e70b5f621cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:04.644688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4c63-21e6-4883-bf9b-e70b5f621cf7 None admin] PATH_INFO: `/v3/projects/8267aabbce3b4dd483cf52be84f0d1a3` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:04.646469 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba4c63-21e6-4883-bf9b-e70b5f621cf7 None admin] RBAC: Authorizing `identity:get_project(project_id=8267aabbce3b4dd483cf52be84f0d1a3)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:04.647905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba4c63-21e6-4883-bf9b-e70b5f621cf7 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:04.654507 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 547/1078] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:45:04 2022] GET /identity/v3/projects/8267aabbce3b4dd483cf52be84f0d1a3 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:04.655615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99494c7c-df28-47a7-b0ca-4bb6199e7204 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:04.726491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:04.756777 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99494c7c-df28-47a7-b0ca-4bb6199e7204 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:04.791602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f38ace-a00c-471d-a816-636dbfded20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:04.792505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f38ace-a00c-471d-a816-636dbfded20a None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:04.792794 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f38ace-a00c-471d-a816-636dbfded20a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:04.793073 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f38ace-a00c-471d-a816-636dbfded20a None admin] PATH_INFO: `/v3/projects/8267aabbce3b4dd483cf52be84f0d1a3/users/5984b01a35994cb19dc513f6908636a1/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:04.795060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f38ace-a00c-471d-a816-636dbfded20a None admin] RBAC: Authorizing `identity:create_grant(project_id=8267aabbce3b4dd483cf52be84f0d1a3, user_id=5984b01a35994cb19dc513f6908636a1, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:04.796506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f38ace-a00c-471d-a816-636dbfded20a None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:04.881648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 532/1079] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:45:04 2022] PUT /identity/v3/projects/8267aabbce3b4dd483cf52be84f0d1a3/users/5984b01a35994cb19dc513f6908636a1/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:45:05.412857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78eaaf-7e14-4c95-8cb8-aadcc7776078 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:05.413402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78eaaf-7e14-4c95-8cb8-aadcc7776078 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:05.413480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78eaaf-7e14-4c95-8cb8-aadcc7776078 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:05.415044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 548/1080] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:05.420506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be3848-8687-4666-a140-bcc803faa779 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:05.420942 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be3848-8687-4666-a140-bcc803faa779 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:05.421110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be3848-8687-4666-a140-bcc803faa779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:05.437942 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-52be3848-8687-4666-a140-bcc803faa779 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:05.439224 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-52be3848-8687-4666-a140-bcc803faa779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:05.508118 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 533/1081] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:05.531226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78eaaf-7e14-4c95-8cb8-aadcc7776078 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:05.534154 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:05.633814 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78eaaf-7e14-4c95-8cb8-aadcc7776078 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:05.670550 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71e1c6-146c-4b9f-bdb1-0c59141a5c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:05.674363 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71e1c6-146c-4b9f-bdb1-0c59141a5c10 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:05.674659 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71e1c6-146c-4b9f-bdb1-0c59141a5c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:05.674943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71e1c6-146c-4b9f-bdb1-0c59141a5c10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:05.742572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71e1c6-146c-4b9f-bdb1-0c59141a5c10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:05.744022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71e1c6-146c-4b9f-bdb1-0c59141a5c10 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:05.745884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:05.844260 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 549/1082] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:45:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:45:05.850405 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be3848-8687-4666-a140-bcc803faa779 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:05.913039 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:05.952813 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be3848-8687-4666-a140-bcc803faa779 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:05.995105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb554a-b16f-4b71-a41f-091885342d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:05.995914 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb554a-b16f-4b71-a41f-091885342d3c None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:05.996203 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb554a-b16f-4b71-a41f-091885342d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:05.996484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb554a-b16f-4b71-a41f-091885342d3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:06.007172 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb554a-b16f-4b71-a41f-091885342d3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:06.008784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb554a-b16f-4b71-a41f-091885342d3c None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:06.027043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-21eb554a-b16f-4b71-a41f-091885342d3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:06.027043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:06.027043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:06.027043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:06.027043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:06.027043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:06.027043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:06.027043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:06.027043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:06.027043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:06.027043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:06.027043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:06.027043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:45:06.027043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:45:06.027043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:06.027969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:06.033961 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:45:06.033961 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:45:06.033961 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:06.033961 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:45:06.033961 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 534/1083] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:06.034250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71e1c6-146c-4b9f-bdb1-0c59141a5c10 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:06.124449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065386-453d-4bb8-aaa1-ffa4ad8c8675 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:06.124819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065386-453d-4bb8-aaa1-ffa4ad8c8675 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:06.125053 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065386-453d-4bb8-aaa1-ffa4ad8c8675 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:06.126514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 535/1084] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:45:06.131571 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a3ffd-db8b-40d0-88a5-aa83ca921d63 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:06.131864 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a3ffd-db8b-40d0-88a5-aa83ca921d63 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:06.132153 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a3ffd-db8b-40d0-88a5-aa83ca921d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:06.142183 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71e1c6-146c-4b9f-bdb1-0c59141a5c10 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:06.143940 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:06.148922 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-467a3ffd-db8b-40d0-88a5-aa83ca921d63 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:06.150132 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-467a3ffd-db8b-40d0-88a5-aa83ca921d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:06.182654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac31b4a-eb9d-4bb0-a331-cb4c56f2a6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:06.183320 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac31b4a-eb9d-4bb0-a331-cb4c56f2a6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:06.183612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac31b4a-eb9d-4bb0-a331-cb4c56f2a6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:06.183893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac31b4a-eb9d-4bb0-a331-cb4c56f2a6b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:06.184610 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac31b4a-eb9d-4bb0-a331-cb4c56f2a6b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:06.184918 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac31b4a-eb9d-4bb0-a331-cb4c56f2a6b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:06.186326 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac31b4a-eb9d-4bb0-a331-cb4c56f2a6b6 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:06.197671 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 550/1085] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:06.234464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 536/1086] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:45:06.260369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac31b4a-eb9d-4bb0-a331-cb4c56f2a6b6 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:06.370634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac31b4a-eb9d-4bb0-a331-cb4c56f2a6b6 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:06.406997 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af356eba-b649-406d-bcac-622a8330863f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:06.407837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af356eba-b649-406d-bcac-622a8330863f None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:06.408258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af356eba-b649-406d-bcac-622a8330863f None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:06.408557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af356eba-b649-406d-bcac-622a8330863f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:06.420821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af356eba-b649-406d-bcac-622a8330863f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:06.429771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-af356eba-b649-406d-bcac-622a8330863f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:45:06.429771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:06.429771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:06.429771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:06.429771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:06.429771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:06.429771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:06.429771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:06.429771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:06.429771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:06.429771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:06.429771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:06.429771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:06.429771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:06.429771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:06.429771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:06.430693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:06.430693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:06.430693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:06.430693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:06.430693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:06.430693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:06.430693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:06.430693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:06.430693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:06.430693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:06.430693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:06.430693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:06.430693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:06.430693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:06.430693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:06.430693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:06.431776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:06.431776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:06.431776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:06.431776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:06.431776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:06.431776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:06.431776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:06.431776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:06.431776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:06.431776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:06.431776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 14:45:06.431776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:45:06.431776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 551/1087] 10.222.0.23 () {56 vars in 1120 bytes} [Thu Jun 16 14:45:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:06.438667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a3ffd-db8b-40d0-88a5-aa83ca921d63 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:06.492674 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:06.545892 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a3ffd-db8b-40d0-88a5-aa83ca921d63 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:06.578983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216e90e-0343-4177-884c-2da28c0654e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:06.579654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216e90e-0343-4177-884c-2da28c0654e6 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:06.579939 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216e90e-0343-4177-884c-2da28c0654e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:06.580216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216e90e-0343-4177-884c-2da28c0654e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:06.580957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216e90e-0343-4177-884c-2da28c0654e6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:06.581335 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216e90e-0343-4177-884c-2da28c0654e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:06.582735 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216e90e-0343-4177-884c-2da28c0654e6 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:06.590461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 537/1088] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jun 16 14:45:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:06.596193 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af356eba-b649-406d-bcac-622a8330863f None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:06.622510 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:06.698857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af356eba-b649-406d-bcac-622a8330863f None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:06.745001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c969e-f5d3-4329-ba22-ba8c29f05c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:06.746146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c969e-f5d3-4329-ba22-ba8c29f05c48 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:06.746576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c969e-f5d3-4329-ba22-ba8c29f05c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:06.746992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c969e-f5d3-4329-ba22-ba8c29f05c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:06.760859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c969e-f5d3-4329-ba22-ba8c29f05c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:06.763194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c969e-f5d3-4329-ba22-ba8c29f05c48 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:06.782742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-b01c969e-f5d3-4329-ba22-ba8c29f05c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:06.782742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:06.782742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:06.782742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:06.782742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:06.782742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:06.782742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:06.782742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:06.782742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:06.782742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:06.782742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:06.782742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:06.782742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:45:06.782742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:45:06.782742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:06.783809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:06.784715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:45:06.784715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:45:06.784715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:06.784715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:45:06.784715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 552/1089] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:45:06.790510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216e90e-0343-4177-884c-2da28c0654e6 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:06.889188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216e90e-0343-4177-884c-2da28c0654e6 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:06.896718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:06.923358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854376d-9eb3-4553-8cc5-47b23c54b839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:06.924033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854376d-9eb3-4553-8cc5-47b23c54b839 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:06.924323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854376d-9eb3-4553-8cc5-47b23c54b839 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:06.924607 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854376d-9eb3-4553-8cc5-47b23c54b839 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:06.925395 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854376d-9eb3-4553-8cc5-47b23c54b839 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:06.925799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854376d-9eb3-4553-8cc5-47b23c54b839 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:06.927175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854376d-9eb3-4553-8cc5-47b23c54b839 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:06.941477 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 538/1090] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:06.947665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c969e-f5d3-4329-ba22-ba8c29f05c48 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:07.017503 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8085068-8219-408b-abac-85e21875c16e None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:07.017709 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8085068-8219-408b-abac-85e21875c16e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:07.017978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8085068-8219-408b-abac-85e21875c16e None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:07.019358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 539/1091] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:45:07.025392 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9749b-c3e1-41e1-b7d2-040f9c3d7f9a None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:07.025676 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9749b-c3e1-41e1-b7d2-040f9c3d7f9a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:07.025959 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9749b-c3e1-41e1-b7d2-040f9c3d7f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:07.043080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-6ac9749b-c3e1-41e1-b7d2-040f9c3d7f9a None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:07.043922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:07.044270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-6ac9749b-c3e1-41e1-b7d2-040f9c3d7f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:07.076408 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c969e-f5d3-4329-ba22-ba8c29f05c48 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:07.115535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 540/1092] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:45:07.121567 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4bce8-877d-42d3-a5a1-feece263e3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:07.122368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4bce8-877d-42d3-a5a1-feece263e3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:07.122658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4bce8-877d-42d3-a5a1-feece263e3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:07.122938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4bce8-877d-42d3-a5a1-feece263e3a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:07.130621 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4bce8-877d-42d3-a5a1-feece263e3a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:07.132068 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4bce8-877d-42d3-a5a1-feece263e3a3 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:07.138976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9749b-c3e1-41e1-b7d2-040f9c3d7f9a None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:07.146582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-6ff4bce8-877d-42d3-a5a1-feece263e3a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:45:07.146582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:07.146582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:07.146582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:07.146582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:07.146582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:07.146582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:07.146582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:07.146582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:07.146582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:07.146582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:07.146582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:07.146582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:45:07.146582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:45:07.146582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:45:07.146582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:07.147669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:07.148626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:07.148626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:07.148626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:45:07.148626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:45:07.148626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:45:07.148626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:45:07.148626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:45:07.148626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:45:07.148626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 14:45:07.148626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:45:07.148626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 553/1093] 10.222.0.23 () {56 vars in 1093 bytes} [Thu Jun 16 14:45:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:07.153564 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4bce8-877d-42d3-a5a1-feece263e3a3 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:07.233837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:07.239771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9749b-c3e1-41e1-b7d2-040f9c3d7f9a None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:07.256370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4bce8-877d-42d3-a5a1-feece263e3a3 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:07.274574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a797969-64e1-4f08-afd0-54fa3cf77e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:07.275391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a797969-64e1-4f08-afd0-54fa3cf77e06 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:07.275595 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a797969-64e1-4f08-afd0-54fa3cf77e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:07.275869 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a797969-64e1-4f08-afd0-54fa3cf77e06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:07.286566 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a797969-64e1-4f08-afd0-54fa3cf77e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:07.291588 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96506150-7b49-4f4b-9e32-e996d683540a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:07.292254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96506150-7b49-4f4b-9e32-e996d683540a None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:07.292538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96506150-7b49-4f4b-9e32-e996d683540a None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:07.292815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96506150-7b49-4f4b-9e32-e996d683540a None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:07.293771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96506150-7b49-4f4b-9e32-e996d683540a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:07.294081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96506150-7b49-4f4b-9e32-e996d683540a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:07.295256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-1a797969-64e1-4f08-afd0-54fa3cf77e06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:07.295256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:07.295256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:07.295256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:07.295256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:07.295256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:07.295256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:07.295256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:07.295256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:07.295256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:07.295256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:07.295256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:07.295256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:07.295256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:07.295256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:07.295256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:07.296317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:07.296317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:07.296317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:07.296317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:07.296317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:07.296317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:07.296317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:07.296317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:07.296317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:07.296317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:07.296317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:07.296317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:07.296317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:07.296317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:07.296317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:07.296317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:07.297519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:07.297519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:07.297519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:07.297519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:07.297519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:07.297519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:07.297519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:07.297519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:07.297519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:07.297519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:07.297519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:07.297519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:45:07.298383 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96506150-7b49-4f4b-9e32-e996d683540a None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:07.298479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 541/1094] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:45:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:45:07.298847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:07.303168 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a797969-64e1-4f08-afd0-54fa3cf77e06 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:07.315444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 554/1095] 10.222.0.23 () {56 vars in 1133 bytes} [Thu Jun 16 14:45:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:07.321398 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96506150-7b49-4f4b-9e32-e996d683540a None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:07.417270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a797969-64e1-4f08-afd0-54fa3cf77e06 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:07.426084 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96506150-7b49-4f4b-9e32-e996d683540a None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:07.451585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4e474-a5d8-4882-b5c4-9aef98c9cbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:07.452262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4e474-a5d8-4882-b5c4-9aef98c9cbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:07.452548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4e474-a5d8-4882-b5c4-9aef98c9cbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:07.452829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4e474-a5d8-4882-b5c4-9aef98c9cbc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:07.453613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4e474-a5d8-4882-b5c4-9aef98c9cbc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:07.453926 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4e474-a5d8-4882-b5c4-9aef98c9cbc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:07.455360 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4e474-a5d8-4882-b5c4-9aef98c9cbc5 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:07.462192 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3edef-407d-484c-8517-22f641013be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:07.463285 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3edef-407d-484c-8517-22f641013be4 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:07.463703 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3edef-407d-484c-8517-22f641013be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:07.463994 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3edef-407d-484c-8517-22f641013be4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:07.467111 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 542/1096] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:45:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:07.473061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4e474-a5d8-4882-b5c4-9aef98c9cbc5 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:07.493232 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:07.531484 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:07.541980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3edef-407d-484c-8517-22f641013be4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:07.543697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3edef-407d-484c-8517-22f641013be4 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:07.575337 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4e474-a5d8-4882-b5c4-9aef98c9cbc5 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:07.609789 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369488a-9a2c-4cdd-8738-4ec40fec21e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:07.610663 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369488a-9a2c-4cdd-8738-4ec40fec21e3 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:07.610952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369488a-9a2c-4cdd-8738-4ec40fec21e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:07.611241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369488a-9a2c-4cdd-8738-4ec40fec21e3 None admin] PATH_INFO: `/v3/users/5984b01a35994cb19dc513f6908636a1` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:07.612445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369488a-9a2c-4cdd-8738-4ec40fec21e3 None admin] RBAC: Authorizing `identity:get_user(user_id=5984b01a35994cb19dc513f6908636a1)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:07.613935 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369488a-9a2c-4cdd-8738-4ec40fec21e3 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:07.615849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 543/1097] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:07 2022] GET /identity/v3/users/5984b01a35994cb19dc513f6908636a1 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:07.621445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369488a-9a2c-4cdd-8738-4ec40fec21e3 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:07.648081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 555/1098] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:45:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:45:07.654080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3edef-407d-484c-8517-22f641013be4 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:07.706417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:07.721344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369488a-9a2c-4cdd-8738-4ec40fec21e3 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:07.748699 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:07.756021 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7790aea-9f78-42ad-8343-fc7f22445949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:07.756682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7790aea-9f78-42ad-8343-fc7f22445949 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:07.756973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7790aea-9f78-42ad-8343-fc7f22445949 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:07.757067 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3edef-407d-484c-8517-22f641013be4 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:07.757293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7790aea-9f78-42ad-8343-fc7f22445949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:07.792332 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d4c2c-63b8-473e-a3e8-05a52b2f202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:07.793554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d4c2c-63b8-473e-a3e8-05a52b2f202b None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:07.793554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d4c2c-63b8-473e-a3e8-05a52b2f202b None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:07.793818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d4c2c-63b8-473e-a3e8-05a52b2f202b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:07.804612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d4c2c-63b8-473e-a3e8-05a52b2f202b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:07.806092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d4c2c-63b8-473e-a3e8-05a52b2f202b None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:07.823289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-598d4c2c-63b8-473e-a3e8-05a52b2f202b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:07.823289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:07.823289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:07.823289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:07.823289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:07.823289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:07.823289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:07.823289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:07.823289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:07.823289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:07.823289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:07.823289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:07.823289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:45:07.823289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:45:07.823289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:07.824188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:07.825080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:45:07.825080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:45:07.825080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:45:07.825080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:45:07.825080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 556/1099] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:07.825641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7790aea-9f78-42ad-8343-fc7f22445949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:07.826321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7790aea-9f78-42ad-8343-fc7f22445949 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:07.830078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d4c2c-63b8-473e-a3e8-05a52b2f202b None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:07.912438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:07.927540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 544/1100] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:45:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:45:07.932683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d4c2c-63b8-473e-a3e8-05a52b2f202b None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:07.933344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7790aea-9f78-42ad-8343-fc7f22445949 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:07.967514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c662f-083f-4f78-b34d-f0823fecfc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:07.968184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c662f-083f-4f78-b34d-f0823fecfc0d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:07.968486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c662f-083f-4f78-b34d-f0823fecfc0d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:07.968764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c662f-083f-4f78-b34d-f0823fecfc0d None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:07.969530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c662f-083f-4f78-b34d-f0823fecfc0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:07.972103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c662f-083f-4f78-b34d-f0823fecfc0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:07.972103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c662f-083f-4f78-b34d-f0823fecfc0d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:07.983043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 557/1101] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:07.988577 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c662f-083f-4f78-b34d-f0823fecfc0d None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:07.992870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:08.032949 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7790aea-9f78-42ad-8343-fc7f22445949 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:08.066597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454da2f6-062e-4698-b2f8-e0a7fb333361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:08.067919 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454da2f6-062e-4698-b2f8-e0a7fb333361 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:08.068203 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454da2f6-062e-4698-b2f8-e0a7fb333361 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:08.068481 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454da2f6-062e-4698-b2f8-e0a7fb333361 None admin] PATH_INFO: `/v3/projects/8267aabbce3b4dd483cf52be84f0d1a3` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:08.069689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454da2f6-062e-4698-b2f8-e0a7fb333361 None admin] RBAC: Authorizing `identity:get_project(project_id=8267aabbce3b4dd483cf52be84f0d1a3)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:08.071115 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454da2f6-062e-4698-b2f8-e0a7fb333361 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:08.072810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 545/1102] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:45:07 2022] GET /identity/v3/projects/8267aabbce3b4dd483cf52be84f0d1a3 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:08.078679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454da2f6-062e-4698-b2f8-e0a7fb333361 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:08.088803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c662f-083f-4f78-b34d-f0823fecfc0d None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:08.120742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c6a58-9821-494d-bdce-3807c4ad2288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:08.121563 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c6a58-9821-494d-bdce-3807c4ad2288 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:08.121850 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c6a58-9821-494d-bdce-3807c4ad2288 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:08.122127 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c6a58-9821-494d-bdce-3807c4ad2288 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:08.128687 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c6a58-9821-494d-bdce-3807c4ad2288 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:08.130731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c6a58-9821-494d-bdce-3807c4ad2288 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:08.133719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:08.144547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-f49c6a58-9821-494d-bdce-3807c4ad2288 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:45:08.144547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:08.144547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:08.144547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:08.144547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:08.144547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:08.144547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:08.144547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:08.144547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:08.144547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:08.144547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:08.144547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:08.144547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:45:08.144547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:45:08.144547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:08.150670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:08.151576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:45:08.151576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:45:08.151576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:45:08.151576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:45:08.151576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:45:08.151576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:45:08.151576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:45:08.151576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:45:08.151576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 558/1103] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:45:08.152078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c6a58-9821-494d-bdce-3807c4ad2288 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:08.179461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454da2f6-062e-4698-b2f8-e0a7fb333361 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:08.213012 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:08.213417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8be1f6-11f2-48ef-96ad-6a1b6b308a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:08.214071 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8be1f6-11f2-48ef-96ad-6a1b6b308a70 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:08.214359 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8be1f6-11f2-48ef-96ad-6a1b6b308a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:08.214634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8be1f6-11f2-48ef-96ad-6a1b6b308a70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:08.215461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8be1f6-11f2-48ef-96ad-6a1b6b308a70 None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.project.id=8267aabbce3b4dd483cf52be84f0d1a3, user.id=5984b01a35994cb19dc513f6908636a1) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:08.215780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8be1f6-11f2-48ef-96ad-6a1b6b308a70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:08.217236 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8be1f6-11f2-48ef-96ad-6a1b6b308a70 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:08.223023 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 546/1104] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:45:08 2022] GET /identity/v3/role_assignments?user.id=5984b01a35994cb19dc513f6908636a1&scope.project.id=8267aabbce3b4dd483cf52be84f0d1a3&role.id=c865040abd6c4b099381557da21c471d => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:08.253879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c6a58-9821-494d-bdce-3807c4ad2288 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:08.292206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ca134-f616-4563-b2f0-96360efbb21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:08.292891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ca134-f616-4563-b2f0-96360efbb21a None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:08.293212 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ca134-f616-4563-b2f0-96360efbb21a None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:08.293496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ca134-f616-4563-b2f0-96360efbb21a None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:08.294299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ca134-f616-4563-b2f0-96360efbb21a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:08.294615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ca134-f616-4563-b2f0-96360efbb21a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:08.296090 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ca134-f616-4563-b2f0-96360efbb21a None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:08.309373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 559/1105] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:45:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:08.315626 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8be1f6-11f2-48ef-96ad-6a1b6b308a70 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:08.419601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8be1f6-11f2-48ef-96ad-6a1b6b308a70 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:08.437342 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:08.454633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b12d58-0ea4-4247-b598-0da7a33cd088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:08.455290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b12d58-0ea4-4247-b598-0da7a33cd088 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:08.455575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b12d58-0ea4-4247-b598-0da7a33cd088 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:08.455852 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b12d58-0ea4-4247-b598-0da7a33cd088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:08.456673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b12d58-0ea4-4247-b598-0da7a33cd088 None admin] RBAC: Adding query filter params (role.id=53ff5be561de46ca931c143cf800c0f7, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=60c2f1c63a674e3195c490ab5ad1318f) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:08.456990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b12d58-0ea4-4247-b598-0da7a33cd088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:08.458484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b12d58-0ea4-4247-b598-0da7a33cd088 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:08.464253 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 547/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:45:08 2022] GET /identity/v3/role_assignments?user.id=60c2f1c63a674e3195c490ab5ad1318f&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=53ff5be561de46ca931c143cf800c0f7 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:10.434617 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb8048-0b2f-4628-9547-fae78ac99eb4 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:10.435124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb8048-0b2f-4628-9547-fae78ac99eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:10.435216 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb8048-0b2f-4628-9547-fae78ac99eb4 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:10.436543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 560/1107] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:10.441685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9a1a-018e-4d41-bb23-066cfe2e5714 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:10.442069 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9a1a-018e-4d41-bb23-066cfe2e5714 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:10.442249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef9a1a-018e-4d41-bb23-066cfe2e5714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:10.458879 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-3cef9a1a-018e-4d41-bb23-066cfe2e5714 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:10.460209 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3cef9a1a-018e-4d41-bb23-066cfe2e5714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:10.525402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 548/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:10.550208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb8048-0b2f-4628-9547-fae78ac99eb4 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:10.650064 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb8048-0b2f-4628-9547-fae78ac99eb4 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:10.672694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:10.682812 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea14dfc-67d0-40c2-ad46-b6d9b9792d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:10.683600 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea14dfc-67d0-40c2-ad46-b6d9b9792d4a None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:10.689940 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea14dfc-67d0-40c2-ad46-b6d9b9792d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:10.689940 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea14dfc-67d0-40c2-ad46-b6d9b9792d4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:10.689940 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea14dfc-67d0-40c2-ad46-b6d9b9792d4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:10.689940 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea14dfc-67d0-40c2-ad46-b6d9b9792d4a None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:10.689940 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 561/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:10.694100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef9a1a-018e-4d41-bb23-066cfe2e5714 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:10.789600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef9a1a-018e-4d41-bb23-066cfe2e5714 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:10.801986 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:10.821763 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4648f-9ac7-42cc-82d2-f152ff23770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:10.822415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4648f-9ac7-42cc-82d2-f152ff23770b None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:10.822699 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4648f-9ac7-42cc-82d2-f152ff23770b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:10.822971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4648f-9ac7-42cc-82d2-f152ff23770b None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:10.823692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4648f-9ac7-42cc-82d2-f152ff23770b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:10.825100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4648f-9ac7-42cc-82d2-f152ff23770b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:11.098984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 549/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:45:10 2022] POST /identity/v3/users => generated 286 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:45:13.259626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a1fa8-ace9-46ee-967c-a5521d767cbf None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:13.260171 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a1fa8-ace9-46ee-967c-a5521d767cbf None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:13.260171 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a1fa8-ace9-46ee-967c-a5521d767cbf None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:13.261521 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 562/1111] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:13.266787 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22261ea8-b359-4022-8959-24701897deb1 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:13.267176 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22261ea8-b359-4022-8959-24701897deb1 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:13.267358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22261ea8-b359-4022-8959-24701897deb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:13.284354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-22261ea8-b359-4022-8959-24701897deb1 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:13.285585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-22261ea8-b359-4022-8959-24701897deb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:13.349676 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 550/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:13.373762 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a1fa8-ace9-46ee-967c-a5521d767cbf None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:13.470128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a1fa8-ace9-46ee-967c-a5521d767cbf None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:13.502562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e6d57-3d36-412b-8b2c-060b3c7081a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:13.503406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6d57-3d36-412b-8b2c-060b3c7081a1 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:13.503691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6d57-3d36-412b-8b2c-060b3c7081a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:13.503967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e6d57-3d36-412b-8b2c-060b3c7081a1 None admin] PATH_INFO: `/v3/roles/602eca0d730345ff8999a6bbd7124092` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:13.505472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e6d57-3d36-412b-8b2c-060b3c7081a1 None admin] RBAC: Authorizing `identity:get_role(role_id=602eca0d730345ff8999a6bbd7124092)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:13.506837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e6d57-3d36-412b-8b2c-060b3c7081a1 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:13.508178 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 563/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:13 2022] GET /identity/v3/roles/602eca0d730345ff8999a6bbd7124092 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:13.513976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22261ea8-b359-4022-8959-24701897deb1 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:13.608401 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:13.612119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22261ea8-b359-4022-8959-24701897deb1 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:13.643888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f05a1-f263-43c0-97cb-3e9b8d988f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:13.644745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f05a1-f263-43c0-97cb-3e9b8d988f79 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:13.645035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f05a1-f263-43c0-97cb-3e9b8d988f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:13.645347 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f05a1-f263-43c0-97cb-3e9b8d988f79 None admin] PATH_INFO: `/v3/users/a54b19e1bc7b4693817a1d8c1cb8811a` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:13.658790 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f05a1-f263-43c0-97cb-3e9b8d988f79 None admin] RBAC: Authorizing `identity:get_user(user_id=a54b19e1bc7b4693817a1d8c1cb8811a)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:13.664082 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f05a1-f263-43c0-97cb-3e9b8d988f79 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:13.664082 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 551/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:13 2022] GET /identity/v3/users/a54b19e1bc7b4693817a1d8c1cb8811a => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:13.668441 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e6d57-3d36-412b-8b2c-060b3c7081a1 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:13.725816 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:13.764983 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e6d57-3d36-412b-8b2c-060b3c7081a1 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:13.797847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0fb47-6f70-4bac-9d17-470d2c93a5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:13.798481 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0fb47-6f70-4bac-9d17-470d2c93a5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:13.798770 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0fb47-6f70-4bac-9d17-470d2c93a5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:13.799050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0fb47-6f70-4bac-9d17-470d2c93a5d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:13.863519 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0fb47-6f70-4bac-9d17-470d2c93a5d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:13.865016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0fb47-6f70-4bac-9d17-470d2c93a5d7 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:13.920131 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:13.959997 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 564/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:45:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:45:13.966341 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f05a1-f263-43c0-97cb-3e9b8d988f79 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:14.062769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f05a1-f263-43c0-97cb-3e9b8d988f79 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:14.097482 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae334a-bd08-4ff7-a109-4e9e13188344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:14.098336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae334a-bd08-4ff7-a109-4e9e13188344 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:14.098624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae334a-bd08-4ff7-a109-4e9e13188344 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:14.098903 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae334a-bd08-4ff7-a109-4e9e13188344 None admin] PATH_INFO: `/v3/projects/8267aabbce3b4dd483cf52be84f0d1a3` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:14.100165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae334a-bd08-4ff7-a109-4e9e13188344 None admin] RBAC: Authorizing `identity:get_project(project_id=8267aabbce3b4dd483cf52be84f0d1a3)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:14.101618 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae334a-bd08-4ff7-a109-4e9e13188344 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:14.103313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 552/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:45:13 2022] GET /identity/v3/projects/8267aabbce3b4dd483cf52be84f0d1a3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:14.109529 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0fb47-6f70-4bac-9d17-470d2c93a5d7 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:14.213637 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0fb47-6f70-4bac-9d17-470d2c93a5d7 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:14.245699 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c254a-5efb-468a-8542-da257de29629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:14.246342 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c254a-5efb-468a-8542-da257de29629 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:14.246628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c254a-5efb-468a-8542-da257de29629 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:14.246904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c254a-5efb-468a-8542-da257de29629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:14.247731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c254a-5efb-468a-8542-da257de29629 None admin] RBAC: Adding query filter params (role.id=602eca0d730345ff8999a6bbd7124092, scope.project.id=8267aabbce3b4dd483cf52be84f0d1a3, user.id=a54b19e1bc7b4693817a1d8c1cb8811a) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:14.248045 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c254a-5efb-468a-8542-da257de29629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:14.249496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c254a-5efb-468a-8542-da257de29629 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:14.254737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 565/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:45:14 2022] GET /identity/v3/role_assignments?user.id=a54b19e1bc7b4693817a1d8c1cb8811a&scope.project.id=8267aabbce3b4dd483cf52be84f0d1a3&role.id=602eca0d730345ff8999a6bbd7124092 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:16.351363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4eac2-287a-4c38-95b1-f0b4646e5144 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:16.351878 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4eac2-287a-4c38-95b1-f0b4646e5144 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:16.351878 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4eac2-287a-4c38-95b1-f0b4646e5144 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:16.353323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 553/1118] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:16.358398 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7319c-be5c-4066-b3de-459a4d7db533 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:16.358786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7319c-be5c-4066-b3de-459a4d7db533 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:16.358952 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7319c-be5c-4066-b3de-459a4d7db533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:16.375155 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-c4c7319c-be5c-4066-b3de-459a4d7db533 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:16.376336 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c4c7319c-be5c-4066-b3de-459a4d7db533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:16.393542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:16.443705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 566/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:16.466477 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4eac2-287a-4c38-95b1-f0b4646e5144 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:16.490892 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:16.582065 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4eac2-287a-4c38-95b1-f0b4646e5144 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:16.613968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190b964-d2c9-438a-bd19-f8a8fdb59ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:16.614763 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190b964-d2c9-438a-bd19-f8a8fdb59ece None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:16.615573 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190b964-d2c9-438a-bd19-f8a8fdb59ece None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:16.615851 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190b964-d2c9-438a-bd19-f8a8fdb59ece None admin] PATH_INFO: `/v3/roles/602eca0d730345ff8999a6bbd7124092` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:16.617343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190b964-d2c9-438a-bd19-f8a8fdb59ece None admin] RBAC: Authorizing `identity:get_role(role_id=602eca0d730345ff8999a6bbd7124092)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:16.618709 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190b964-d2c9-438a-bd19-f8a8fdb59ece None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:16.620070 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 554/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:16 2022] GET /identity/v3/roles/602eca0d730345ff8999a6bbd7124092 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:16.625999 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7319c-be5c-4066-b3de-459a4d7db533 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:16.719892 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7319c-be5c-4066-b3de-459a4d7db533 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:16.752063 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bb579-ac62-4dc1-bb52-dbf8f8175b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:16.752930 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bb579-ac62-4dc1-bb52-dbf8f8175b49 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:16.753240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bb579-ac62-4dc1-bb52-dbf8f8175b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:16.753522 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bb579-ac62-4dc1-bb52-dbf8f8175b49 None admin] PATH_INFO: `/v3/users/a54b19e1bc7b4693817a1d8c1cb8811a` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:16.754703 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bb579-ac62-4dc1-bb52-dbf8f8175b49 None admin] RBAC: Authorizing `identity:get_user(user_id=a54b19e1bc7b4693817a1d8c1cb8811a)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:16.756704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bb579-ac62-4dc1-bb52-dbf8f8175b49 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:16.758331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 567/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:16 2022] GET /identity/v3/users/a54b19e1bc7b4693817a1d8c1cb8811a => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:16.763865 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190b964-d2c9-438a-bd19-f8a8fdb59ece None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:16.851454 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:16.859909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190b964-d2c9-438a-bd19-f8a8fdb59ece None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:16.892922 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b830788-a21f-4304-a1c9-cda1d97a3a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:16.893836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b830788-a21f-4304-a1c9-cda1d97a3a28 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:16.894123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b830788-a21f-4304-a1c9-cda1d97a3a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:16.894400 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b830788-a21f-4304-a1c9-cda1d97a3a28 None admin] PATH_INFO: `/v3/projects/8267aabbce3b4dd483cf52be84f0d1a3` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:16.895650 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b830788-a21f-4304-a1c9-cda1d97a3a28 None admin] RBAC: Authorizing `identity:get_project(project_id=8267aabbce3b4dd483cf52be84f0d1a3)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:16.897084 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b830788-a21f-4304-a1c9-cda1d97a3a28 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:16.899234 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 555/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:45:16 2022] GET /identity/v3/projects/8267aabbce3b4dd483cf52be84f0d1a3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:16.904593 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bb579-ac62-4dc1-bb52-dbf8f8175b49 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:16.928660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:17.001278 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bb579-ac62-4dc1-bb52-dbf8f8175b49 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:17.033066 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f78ed-b808-40aa-ad0a-ea75eeac113d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:17.033965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f78ed-b808-40aa-ad0a-ea75eeac113d None admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:17.034248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f78ed-b808-40aa-ad0a-ea75eeac113d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:17.034523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f78ed-b808-40aa-ad0a-ea75eeac113d None admin] PATH_INFO: `/v3/projects/8267aabbce3b4dd483cf52be84f0d1a3/users/a54b19e1bc7b4693817a1d8c1cb8811a/roles/602eca0d730345ff8999a6bbd7124092` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:17.036691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f78ed-b808-40aa-ad0a-ea75eeac113d None admin] RBAC: Authorizing `identity:create_grant(project_id=8267aabbce3b4dd483cf52be84f0d1a3, user_id=a54b19e1bc7b4693817a1d8c1cb8811a, role_id=602eca0d730345ff8999a6bbd7124092)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:17.038723 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f78ed-b808-40aa-ad0a-ea75eeac113d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:17.116573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 568/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:45:16 2022] PUT /identity/v3/projects/8267aabbce3b4dd483cf52be84f0d1a3/users/a54b19e1bc7b4693817a1d8c1cb8811a/roles/602eca0d730345ff8999a6bbd7124092 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:45:19.177403 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83099d-d8f6-415a-b15e-a9d6aa411399 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:19.178449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83099d-d8f6-415a-b15e-a9d6aa411399 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:19.178449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83099d-d8f6-415a-b15e-a9d6aa411399 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:19.179832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 556/1124] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:19.184936 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b6a4-e77b-4185-a287-5e192ecec9f1 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:19.185317 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b6a4-e77b-4185-a287-5e192ecec9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:19.185550 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b6a4-e77b-4185-a287-5e192ecec9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:19.202298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-0d19b6a4-e77b-4185-a287-5e192ecec9f1 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:19.203475 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0d19b6a4-e77b-4185-a287-5e192ecec9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:19.266762 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 569/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:19.289796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83099d-d8f6-415a-b15e-a9d6aa411399 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:19.387569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83099d-d8f6-415a-b15e-a9d6aa411399 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:19.420831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f4b78-c32a-495f-907d-c90869e412ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:19.421703 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f4b78-c32a-495f-907d-c90869e412ed None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:19.421993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f4b78-c32a-495f-907d-c90869e412ed None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:19.422271 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f4b78-c32a-495f-907d-c90869e412ed None admin] PATH_INFO: `/v3/roles/602eca0d730345ff8999a6bbd7124092` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:19.423742 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f4b78-c32a-495f-907d-c90869e412ed None admin] RBAC: Authorizing `identity:get_role(role_id=602eca0d730345ff8999a6bbd7124092)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:19.425101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f4b78-c32a-495f-907d-c90869e412ed None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:19.426466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 557/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:19 2022] GET /identity/v3/roles/602eca0d730345ff8999a6bbd7124092 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:19.432582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19b6a4-e77b-4185-a287-5e192ecec9f1 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:19.446124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:19.526940 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19b6a4-e77b-4185-a287-5e192ecec9f1 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:19.562740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df535a-a99f-4951-a69c-6102c67217b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:19.563618 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df535a-a99f-4951-a69c-6102c67217b1 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:19.563905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df535a-a99f-4951-a69c-6102c67217b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:19.564182 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df535a-a99f-4951-a69c-6102c67217b1 None admin] PATH_INFO: `/v3/users/a54b19e1bc7b4693817a1d8c1cb8811a` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:19.565381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df535a-a99f-4951-a69c-6102c67217b1 None admin] RBAC: Authorizing `identity:get_user(user_id=a54b19e1bc7b4693817a1d8c1cb8811a)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:19.566819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df535a-a99f-4951-a69c-6102c67217b1 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:19.570126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 570/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:19 2022] GET /identity/v3/users/a54b19e1bc7b4693817a1d8c1cb8811a => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:19.576977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f4b78-c32a-495f-907d-c90869e412ed None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:19.610984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:19.680375 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f4b78-c32a-495f-907d-c90869e412ed None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:19.712612 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eadbe1-7634-46db-a5d9-8d41378eec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:19.713291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eadbe1-7634-46db-a5d9-8d41378eec17 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:19.713581 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eadbe1-7634-46db-a5d9-8d41378eec17 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:19.713859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eadbe1-7634-46db-a5d9-8d41378eec17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:19.777975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eadbe1-7634-46db-a5d9-8d41378eec17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:19.779343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eadbe1-7634-46db-a5d9-8d41378eec17 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:19.805182 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:19.877239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 558/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:45:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:45:19.883457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df535a-a99f-4951-a69c-6102c67217b1 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:19.961810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:19.980056 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df535a-a99f-4951-a69c-6102c67217b1 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:20.013512 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f396a1-e1f0-4120-a3d6-37b331ad37f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:20.014379 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f396a1-e1f0-4120-a3d6-37b331ad37f4 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:20.014663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f396a1-e1f0-4120-a3d6-37b331ad37f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:20.014938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f396a1-e1f0-4120-a3d6-37b331ad37f4 None admin] PATH_INFO: `/v3/projects/8267aabbce3b4dd483cf52be84f0d1a3` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:20.016116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f396a1-e1f0-4120-a3d6-37b331ad37f4 None admin] RBAC: Authorizing `identity:get_project(project_id=8267aabbce3b4dd483cf52be84f0d1a3)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:20.017589 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f396a1-e1f0-4120-a3d6-37b331ad37f4 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:20.019252 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 571/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:45:19 2022] GET /identity/v3/projects/8267aabbce3b4dd483cf52be84f0d1a3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:20.026283 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eadbe1-7634-46db-a5d9-8d41378eec17 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:20.120583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eadbe1-7634-46db-a5d9-8d41378eec17 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:20.145684 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:20.153662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a172e-f1f9-4acc-bd51-5884c20e63ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:20.154306 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a172e-f1f9-4acc-bd51-5884c20e63ea None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:20.154591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a172e-f1f9-4acc-bd51-5884c20e63ea None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:20.154868 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a172e-f1f9-4acc-bd51-5884c20e63ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:20.155684 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a172e-f1f9-4acc-bd51-5884c20e63ea None admin] RBAC: Adding query filter params (role.id=602eca0d730345ff8999a6bbd7124092, scope.project.id=8267aabbce3b4dd483cf52be84f0d1a3, user.id=a54b19e1bc7b4693817a1d8c1cb8811a) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:20.155999 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a172e-f1f9-4acc-bd51-5884c20e63ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:20.157446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a172e-f1f9-4acc-bd51-5884c20e63ea None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:20.163476 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 559/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:45:20 2022] GET /identity/v3/role_assignments?user.id=a54b19e1bc7b4693817a1d8c1cb8811a&scope.project.id=8267aabbce3b4dd483cf52be84f0d1a3&role.id=602eca0d730345ff8999a6bbd7124092 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:22.265690 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f959e6-d49f-4d59-967e-ba706fcf511d None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:22.266190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f959e6-d49f-4d59-967e-ba706fcf511d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:22.266190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f959e6-d49f-4d59-967e-ba706fcf511d None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:22.267529 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 572/1131] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:22.273662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cbf90-45a2-4242-9c7b-873251415696 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:22.274421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cbf90-45a2-4242-9c7b-873251415696 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:22.274705 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cbf90-45a2-4242-9c7b-873251415696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:22.291123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-357cbf90-45a2-4242-9c7b-873251415696 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:22.292304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-357cbf90-45a2-4242-9c7b-873251415696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:22.355363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 560/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:22.378186 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f959e6-d49f-4d59-967e-ba706fcf511d None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:22.475677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f959e6-d49f-4d59-967e-ba706fcf511d None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:22.508436 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d736c15-b59e-4f1e-88bb-435075a29537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:22.509246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d736c15-b59e-4f1e-88bb-435075a29537 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:22.509532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d736c15-b59e-4f1e-88bb-435075a29537 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:22.509807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d736c15-b59e-4f1e-88bb-435075a29537 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:22.510976 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d736c15-b59e-4f1e-88bb-435075a29537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:22.512414 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d736c15-b59e-4f1e-88bb-435075a29537 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:22.514022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 573/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:45:22.519887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cbf90-45a2-4242-9c7b-873251415696 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:22.619460 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cbf90-45a2-4242-9c7b-873251415696 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:22.641458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:22.652561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8693f3d-6422-457e-b13f-80ad10f7c195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:22.666994 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8693f3d-6422-457e-b13f-80ad10f7c195 None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:22.666994 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8693f3d-6422-457e-b13f-80ad10f7c195 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:22.666994 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8693f3d-6422-457e-b13f-80ad10f7c195 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:22.666994 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8693f3d-6422-457e-b13f-80ad10f7c195 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:22.666994 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8693f3d-6422-457e-b13f-80ad10f7c195 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:22.780232 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 561/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 16 14:45:22 2022] POST /identity/v3/projects => generated 311 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:45:25.020718 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7b544-e693-4a7b-a06b-285c117e85e1 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:25.021225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7b544-e693-4a7b-a06b-285c117e85e1 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:25.021306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7b544-e693-4a7b-a06b-285c117e85e1 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:25.022674 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 574/1135] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:25.027857 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d2147-a55c-49e7-b956-b09ff2cca796 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:25.028251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d2147-a55c-49e7-b956-b09ff2cca796 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:25.028427 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d2147-a55c-49e7-b956-b09ff2cca796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:25.045643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-7c8d2147-a55c-49e7-b956-b09ff2cca796 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:25.046859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-7c8d2147-a55c-49e7-b956-b09ff2cca796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:25.110607 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 562/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:25.135949 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7b544-e693-4a7b-a06b-285c117e85e1 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:25.153369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:25.233013 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7b544-e693-4a7b-a06b-285c117e85e1 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:25.265148 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b23f8-c8aa-4ce9-98e6-7b86e86330e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:25.265940 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b23f8-c8aa-4ce9-98e6-7b86e86330e2 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:25.266242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b23f8-c8aa-4ce9-98e6-7b86e86330e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:25.266530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b23f8-c8aa-4ce9-98e6-7b86e86330e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:25.267690 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b23f8-c8aa-4ce9-98e6-7b86e86330e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:25.269109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b23f8-c8aa-4ce9-98e6-7b86e86330e2 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:25.270756 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 575/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:45:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:25.276561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d2147-a55c-49e7-b956-b09ff2cca796 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:25.384521 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d2147-a55c-49e7-b956-b09ff2cca796 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:25.386822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:25.416923 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb8e88-4bea-4d2d-8755-24dc58089bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:25.417619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb8e88-4bea-4d2d-8755-24dc58089bc8 None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:25.417914 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb8e88-4bea-4d2d-8755-24dc58089bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:25.418193 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb8e88-4bea-4d2d-8755-24dc58089bc8 None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:25.418899 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb8e88-4bea-4d2d-8755-24dc58089bc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:25.420703 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb8e88-4bea-4d2d-8755-24dc58089bc8 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:25.516952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 563/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:45:25 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:45:27.645105 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab3482-cc2d-4b70-aba8-cd0596a1e4bf None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:27.645656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab3482-cc2d-4b70-aba8-cd0596a1e4bf None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:27.645772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab3482-cc2d-4b70-aba8-cd0596a1e4bf None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:27.647043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 576/1139] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:27.652652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0de8-5b53-4c5d-85ee-b97bf5ccf99b None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:27.653056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0de8-5b53-4c5d-85ee-b97bf5ccf99b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:27.653242 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0de8-5b53-4c5d-85ee-b97bf5ccf99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:27.669934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-843d0de8-5b53-4c5d-85ee-b97bf5ccf99b None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:27.671107 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-843d0de8-5b53-4c5d-85ee-b97bf5ccf99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:27.739117 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 564/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:27.762687 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab3482-cc2d-4b70-aba8-cd0596a1e4bf None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:27.845348 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:27.861698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab3482-cc2d-4b70-aba8-cd0596a1e4bf None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:27.894311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba61026-bf70-4b04-942b-dac9daa869bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:27.895101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba61026-bf70-4b04-942b-dac9daa869bc None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:27.895440 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba61026-bf70-4b04-942b-dac9daa869bc None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:27.895668 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba61026-bf70-4b04-942b-dac9daa869bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:27.906366 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba61026-bf70-4b04-942b-dac9daa869bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:27.914578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-9ba61026-bf70-4b04-942b-dac9daa869bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:27.914578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:27.914578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:27.914578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:27.914578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:27.914578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:27.914578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:27.914578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:27.914578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:27.914578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:27.914578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:27.914578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:27.914578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:27.914578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:27.914578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:27.914578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:27.915715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:27.915715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:27.915715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:27.915715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:27.915715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:27.915715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:27.915715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:27.915715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:27.915715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:27.915715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:27.915715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:27.915715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:27.915715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:27.915715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:27.915715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:27.915715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:27.916847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:27.916847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:27.916847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:27.916847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:27.916847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:27.916847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:27.916847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:27.916847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:27.916847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:27.916847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:27.916847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:27.916847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:45:27.916847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 577/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:45:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:27.921806 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d0de8-5b53-4c5d-85ee-b97bf5ccf99b None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:28.007543 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:28.016673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d0de8-5b53-4c5d-85ee-b97bf5ccf99b None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:28.049997 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5f3fe-51ad-42ec-9a07-fed1875447af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:28.050708 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5f3fe-51ad-42ec-9a07-fed1875447af None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:28.051021 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5f3fe-51ad-42ec-9a07-fed1875447af None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:28.051302 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5f3fe-51ad-42ec-9a07-fed1875447af None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:28.052047 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5f3fe-51ad-42ec-9a07-fed1875447af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:28.052362 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5f3fe-51ad-42ec-9a07-fed1875447af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:28.053769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5f3fe-51ad-42ec-9a07-fed1875447af None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:28.061600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 565/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:45:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:28.067442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba61026-bf70-4b04-942b-dac9daa869bc None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:28.163385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba61026-bf70-4b04-942b-dac9daa869bc None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:28.196865 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4583eee-09a1-4f3b-a149-d8d5920f7971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:28.197767 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4583eee-09a1-4f3b-a149-d8d5920f7971 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:28.198053 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4583eee-09a1-4f3b-a149-d8d5920f7971 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:28.198330 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4583eee-09a1-4f3b-a149-d8d5920f7971 None admin] PATH_INFO: `/v3/users/e494dce008e541ffaf545b84da9b22f5` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:28.211607 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4583eee-09a1-4f3b-a149-d8d5920f7971 None admin] RBAC: Authorizing `identity:get_user(user_id=e494dce008e541ffaf545b84da9b22f5)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:28.213042 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4583eee-09a1-4f3b-a149-d8d5920f7971 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:28.214683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 578/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:28 2022] GET /identity/v3/users/e494dce008e541ffaf545b84da9b22f5 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:28.220401 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5f3fe-51ad-42ec-9a07-fed1875447af None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:28.316441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5f3fe-51ad-42ec-9a07-fed1875447af None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:28.349533 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c081a-db21-4820-8636-5491ce245e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:28.350173 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c081a-db21-4820-8636-5491ce245e6d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:28.350461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c081a-db21-4820-8636-5491ce245e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:28.350743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c081a-db21-4820-8636-5491ce245e6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:28.371031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:28.416061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c081a-db21-4820-8636-5491ce245e6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:28.417471 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c081a-db21-4820-8636-5491ce245e6d None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:28.511847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 566/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:45:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:45:28.517703 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4583eee-09a1-4f3b-a149-d8d5920f7971 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:28.520531 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:28.613147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4583eee-09a1-4f3b-a149-d8d5920f7971 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:28.645892 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008097d-4346-4339-a2ca-bcfa163352ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:28.646738 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008097d-4346-4339-a2ca-bcfa163352ee None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:28.647022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008097d-4346-4339-a2ca-bcfa163352ee None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:28.647299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008097d-4346-4339-a2ca-bcfa163352ee None admin] PATH_INFO: `/v3/projects/4af24b6bfb4448d3a215a19de383df28` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:28.648522 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008097d-4346-4339-a2ca-bcfa163352ee None admin] RBAC: Authorizing `identity:get_project(project_id=4af24b6bfb4448d3a215a19de383df28)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:28.649979 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008097d-4346-4339-a2ca-bcfa163352ee None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:28.651628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 579/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:45:28 2022] GET /identity/v3/projects/4af24b6bfb4448d3a215a19de383df28 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:28.657592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c081a-db21-4820-8636-5491ce245e6d None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:28.709032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:28.755932 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c081a-db21-4820-8636-5491ce245e6d None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:28.789143 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3def69-f4f8-4b33-a3af-101d466afec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:28.789809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3def69-f4f8-4b33-a3af-101d466afec6 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:28.790096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3def69-f4f8-4b33-a3af-101d466afec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:28.790375 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3def69-f4f8-4b33-a3af-101d466afec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:28.791197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3def69-f4f8-4b33-a3af-101d466afec6 None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.project.id=4af24b6bfb4448d3a215a19de383df28, user.id=e494dce008e541ffaf545b84da9b22f5) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:28.791509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3def69-f4f8-4b33-a3af-101d466afec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:28.792930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3def69-f4f8-4b33-a3af-101d466afec6 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:28.798216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 567/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:45:28 2022] GET /identity/v3/role_assignments?user.id=e494dce008e541ffaf545b84da9b22f5&scope.project.id=4af24b6bfb4448d3a215a19de383df28&role.id=c865040abd6c4b099381557da21c471d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:30.895215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519fcef-da5c-4a53-a3c7-2f81e9117781 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:30.895771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519fcef-da5c-4a53-a3c7-2f81e9117781 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:30.895771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519fcef-da5c-4a53-a3c7-2f81e9117781 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:30.897117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 580/1147] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:30.902768 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c32291-c09b-456e-ae6a-d784057a9dd8 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:30.903138 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c32291-c09b-456e-ae6a-d784057a9dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:30.903320 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c32291-c09b-456e-ae6a-d784057a9dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:30.920299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-64c32291-c09b-456e-ae6a-d784057a9dd8 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:30.921511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-64c32291-c09b-456e-ae6a-d784057a9dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:30.985997 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 568/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:31.008604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519fcef-da5c-4a53-a3c7-2f81e9117781 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:31.075718 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:31.106163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519fcef-da5c-4a53-a3c7-2f81e9117781 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:31.138514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4c2ad-0620-4783-bf7c-53a516fa6c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:31.139380 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4c2ad-0620-4783-bf7c-53a516fa6c8f None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:31.139771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4c2ad-0620-4783-bf7c-53a516fa6c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:31.140130 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4c2ad-0620-4783-bf7c-53a516fa6c8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:31.150636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4c2ad-0620-4783-bf7c-53a516fa6c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:31.158145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-05c4c2ad-0620-4783-bf7c-53a516fa6c8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:31.158145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:31.158145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:31.158145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:31.158145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:31.158145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:31.158145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:31.158145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:31.158145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:31.158145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:31.158145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:31.158145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:31.158145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:31.158145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:31.158145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:31.158145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:31.159259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:31.159259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:31.159259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:31.159259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:31.159259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:31.159259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:31.159259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:31.159259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:31.159259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:31.159259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:31.159259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:31.159259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:31.159259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:31.159259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:31.159259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:31.159259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:31.160295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:31.160295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:31.160295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:31.160295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:31.160295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:31.160295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:31.160295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:31.160295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:31.160295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:31.160295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:31.160295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:31.160295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:45:31.160295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 581/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:45:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:31.166197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c32291-c09b-456e-ae6a-d784057a9dd8 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:31.209968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:31.260723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c32291-c09b-456e-ae6a-d784057a9dd8 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:31.293618 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c3f2f-6c4a-4c73-86ac-a3b05d0c0b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:31.294272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c3f2f-6c4a-4c73-86ac-a3b05d0c0b34 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:31.294567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c3f2f-6c4a-4c73-86ac-a3b05d0c0b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:31.294847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c3f2f-6c4a-4c73-86ac-a3b05d0c0b34 None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:31.295589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c3f2f-6c4a-4c73-86ac-a3b05d0c0b34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:31.295901 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c3f2f-6c4a-4c73-86ac-a3b05d0c0b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:31.297295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c3f2f-6c4a-4c73-86ac-a3b05d0c0b34 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:31.305049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 569/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:45:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:31.310685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4c2ad-0620-4783-bf7c-53a516fa6c8f None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:31.407593 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4c2ad-0620-4783-bf7c-53a516fa6c8f None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:31.434449 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:31.440340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5af400-582a-4658-babe-93d7255f7639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:31.441247 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5af400-582a-4658-babe-93d7255f7639 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:31.441534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5af400-582a-4658-babe-93d7255f7639 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:31.441812 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5af400-582a-4658-babe-93d7255f7639 None admin] PATH_INFO: `/v3/users/e494dce008e541ffaf545b84da9b22f5` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:31.443007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5af400-582a-4658-babe-93d7255f7639 None admin] RBAC: Authorizing `identity:get_user(user_id=e494dce008e541ffaf545b84da9b22f5)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:31.444436 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5af400-582a-4658-babe-93d7255f7639 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:31.446619 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 582/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:31 2022] GET /identity/v3/users/e494dce008e541ffaf545b84da9b22f5 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:31.452509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c3f2f-6c4a-4c73-86ac-a3b05d0c0b34 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:31.549783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c3f2f-6c4a-4c73-86ac-a3b05d0c0b34 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:31.558692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:31.582447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a51bfa-1f45-44c6-bd8f-982b1deae34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:31.583301 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a51bfa-1f45-44c6-bd8f-982b1deae34a None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:31.583588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a51bfa-1f45-44c6-bd8f-982b1deae34a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:31.583874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a51bfa-1f45-44c6-bd8f-982b1deae34a None admin] PATH_INFO: `/v3/projects/4af24b6bfb4448d3a215a19de383df28` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:31.585051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a51bfa-1f45-44c6-bd8f-982b1deae34a None admin] RBAC: Authorizing `identity:get_project(project_id=4af24b6bfb4448d3a215a19de383df28)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:31.587284 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a51bfa-1f45-44c6-bd8f-982b1deae34a None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:31.589235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 570/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:45:31 2022] GET /identity/v3/projects/4af24b6bfb4448d3a215a19de383df28 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:31.595204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5af400-582a-4658-babe-93d7255f7639 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:31.689938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5af400-582a-4658-babe-93d7255f7639 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:31.724861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df45bec-1b3c-46b7-aeb2-3cfd49c0982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:31.725764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df45bec-1b3c-46b7-aeb2-3cfd49c0982e None admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:31.726047 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df45bec-1b3c-46b7-aeb2-3cfd49c0982e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:31.726947 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df45bec-1b3c-46b7-aeb2-3cfd49c0982e None admin] PATH_INFO: `/v3/projects/4af24b6bfb4448d3a215a19de383df28/users/e494dce008e541ffaf545b84da9b22f5/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:31.728915 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df45bec-1b3c-46b7-aeb2-3cfd49c0982e None admin] RBAC: Authorizing `identity:create_grant(project_id=4af24b6bfb4448d3a215a19de383df28, user_id=e494dce008e541ffaf545b84da9b22f5, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:31.730384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df45bec-1b3c-46b7-aeb2-3cfd49c0982e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:31.815937 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 583/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:45:31 2022] PUT /identity/v3/projects/4af24b6bfb4448d3a215a19de383df28/users/e494dce008e541ffaf545b84da9b22f5/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:45:33.908803 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49869c43-d1c0-4545-8868-00eeb1d362b0 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:33.909363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49869c43-d1c0-4545-8868-00eeb1d362b0 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:33.909486 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49869c43-d1c0-4545-8868-00eeb1d362b0 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:33.910756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 571/1154] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:33.916204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bfece-28ff-490e-893a-3f8eebfe722f None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:33.916629 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bfece-28ff-490e-893a-3f8eebfe722f None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:33.916766 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9bfece-28ff-490e-893a-3f8eebfe722f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:33.933600 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-8a9bfece-28ff-490e-893a-3f8eebfe722f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:33.934782 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-8a9bfece-28ff-490e-893a-3f8eebfe722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:33.986772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:34.000391 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 584/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:34.024393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49869c43-d1c0-4545-8868-00eeb1d362b0 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:34.123009 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49869c43-d1c0-4545-8868-00eeb1d362b0 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:34.158601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53055f2-f69d-4735-a971-608c80ffddc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:34.159442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53055f2-f69d-4735-a971-608c80ffddc5 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:34.159680 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53055f2-f69d-4735-a971-608c80ffddc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:34.159961 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53055f2-f69d-4735-a971-608c80ffddc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:34.170982 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53055f2-f69d-4735-a971-608c80ffddc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:34.178636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-b53055f2-f69d-4735-a971-608c80ffddc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:34.178636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:34.178636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:34.178636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:34.178636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:34.178636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:34.178636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:34.178636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:34.178636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:34.178636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:34.178636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:34.178636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:34.178636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:34.178636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:34.178636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:34.178636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:34.180276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:34.180276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:34.180276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:34.180276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:34.180276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:34.180276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:34.180276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:34.180276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:34.180276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:34.180276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:34.180276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:34.180276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:34.180276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:34.180276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:34.180276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:34.180276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:34.181194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:34.181194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:34.181194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:34.181194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:34.181194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:34.181194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:34.181194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:34.181194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:34.181194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:34.181194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:34.181194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:34.181194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:45:34.181194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 572/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:45:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:34.186391 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bfece-28ff-490e-893a-3f8eebfe722f None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:34.281906 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9bfece-28ff-490e-893a-3f8eebfe722f None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:34.315116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac25327-5757-4b9c-b550-69f41a8ef19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:34.315774 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac25327-5757-4b9c-b550-69f41a8ef19e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:34.316059 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac25327-5757-4b9c-b550-69f41a8ef19e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:34.316339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac25327-5757-4b9c-b550-69f41a8ef19e None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:34.317076 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac25327-5757-4b9c-b550-69f41a8ef19e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:34.317417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac25327-5757-4b9c-b550-69f41a8ef19e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:34.318784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac25327-5757-4b9c-b550-69f41a8ef19e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:34.326650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 585/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:45:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:34.332378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53055f2-f69d-4735-a971-608c80ffddc5 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:34.366231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:34.429540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53055f2-f69d-4735-a971-608c80ffddc5 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:34.464576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c0499-a810-4969-93fc-2bf9c73aab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:34.465476 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c0499-a810-4969-93fc-2bf9c73aab9b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:34.465760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c0499-a810-4969-93fc-2bf9c73aab9b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:34.466037 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c0499-a810-4969-93fc-2bf9c73aab9b None admin] PATH_INFO: `/v3/users/e494dce008e541ffaf545b84da9b22f5` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:34.467220 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c0499-a810-4969-93fc-2bf9c73aab9b None admin] RBAC: Authorizing `identity:get_user(user_id=e494dce008e541ffaf545b84da9b22f5)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:34.468654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c0499-a810-4969-93fc-2bf9c73aab9b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:34.470307 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 573/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:34 2022] GET /identity/v3/users/e494dce008e541ffaf545b84da9b22f5 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:34.476351 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac25327-5757-4b9c-b550-69f41a8ef19e None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:34.524228 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:34.572342 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac25327-5757-4b9c-b550-69f41a8ef19e None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:34.604645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fae945-710d-4e28-8daa-18892da6fe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:34.605307 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fae945-710d-4e28-8daa-18892da6fe8f None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:34.605594 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fae945-710d-4e28-8daa-18892da6fe8f None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:34.605870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fae945-710d-4e28-8daa-18892da6fe8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:34.669374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fae945-710d-4e28-8daa-18892da6fe8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:34.670808 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fae945-710d-4e28-8daa-18892da6fe8f None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:34.716181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:34.765926 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 586/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:45:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:45:34.771803 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c0499-a810-4969-93fc-2bf9c73aab9b None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:34.867989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c0499-a810-4969-93fc-2bf9c73aab9b None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:34.870276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:34.900413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096aa79-45fc-454f-b232-df35530f86e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:34.901476 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096aa79-45fc-454f-b232-df35530f86e1 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:34.901990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096aa79-45fc-454f-b232-df35530f86e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:34.902327 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096aa79-45fc-454f-b232-df35530f86e1 None admin] PATH_INFO: `/v3/projects/4af24b6bfb4448d3a215a19de383df28` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:34.903838 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096aa79-45fc-454f-b232-df35530f86e1 None admin] RBAC: Authorizing `identity:get_project(project_id=4af24b6bfb4448d3a215a19de383df28)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:34.905374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096aa79-45fc-454f-b232-df35530f86e1 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:34.907066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 574/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:45:34 2022] GET /identity/v3/projects/4af24b6bfb4448d3a215a19de383df28 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:34.912943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fae945-710d-4e28-8daa-18892da6fe8f None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:35.007781 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fae945-710d-4e28-8daa-18892da6fe8f None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:35.041329 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523cc6b-c222-4c84-8a5b-f5d523a710a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:35.041987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523cc6b-c222-4c84-8a5b-f5d523a710a8 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:35.042272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523cc6b-c222-4c84-8a5b-f5d523a710a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:35.042550 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523cc6b-c222-4c84-8a5b-f5d523a710a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:35.043369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523cc6b-c222-4c84-8a5b-f5d523a710a8 None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.project.id=4af24b6bfb4448d3a215a19de383df28, user.id=e494dce008e541ffaf545b84da9b22f5) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:35.043684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523cc6b-c222-4c84-8a5b-f5d523a710a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:35.045108 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523cc6b-c222-4c84-8a5b-f5d523a710a8 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:35.050803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 587/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:45:34 2022] GET /identity/v3/role_assignments?user.id=e494dce008e541ffaf545b84da9b22f5&scope.project.id=4af24b6bfb4448d3a215a19de383df28&role.id=c865040abd6c4b099381557da21c471d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:37.180070 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a143d-b23d-4e89-985b-2517df7cb22e None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:37.180622 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a143d-b23d-4e89-985b-2517df7cb22e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:37.180622 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a143d-b23d-4e89-985b-2517df7cb22e None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:37.182045 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 575/1162] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:37.187104 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412aa0-2913-4200-842d-4cce2536c2d0 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:37.187481 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412aa0-2913-4200-842d-4cce2536c2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:37.187670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412aa0-2913-4200-842d-4cce2536c2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:37.204410 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-61412aa0-2913-4200-842d-4cce2536c2d0 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:37.205638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-61412aa0-2913-4200-842d-4cce2536c2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:37.215216 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:37.270031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 588/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:37.292850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a143d-b23d-4e89-985b-2517df7cb22e None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:37.389638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a143d-b23d-4e89-985b-2517df7cb22e None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:37.422130 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bc342-3db7-4310-97f1-6c06bb4f65f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:37.422773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bc342-3db7-4310-97f1-6c06bb4f65f5 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:37.423063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bc342-3db7-4310-97f1-6c06bb4f65f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:37.423345 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bc342-3db7-4310-97f1-6c06bb4f65f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:37.463053 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:37.487872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bc342-3db7-4310-97f1-6c06bb4f65f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:37.489340 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bc342-3db7-4310-97f1-6c06bb4f65f5 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:37.584526 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 576/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:45:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:45:37.590330 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61412aa0-2913-4200-842d-4cce2536c2d0 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:37.683983 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61412aa0-2913-4200-842d-4cce2536c2d0 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:37.716396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d11158-7448-4ead-99c6-cf569af337bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:37.717201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d11158-7448-4ead-99c6-cf569af337bf None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:37.717491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d11158-7448-4ead-99c6-cf569af337bf None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:37.717770 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d11158-7448-4ead-99c6-cf569af337bf None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:37.724194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d11158-7448-4ead-99c6-cf569af337bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:37.725749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d11158-7448-4ead-99c6-cf569af337bf None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-d8d11158-7448-4ead-99c6-cf569af337bf None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:37.739541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:37.740719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:37.740719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:37.740719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:37.740719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:37.740719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:37.740719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:37.740719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:45:37.740719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:45:37.740719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:45:37.740719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:45:37.740719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:37.740719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:37.740719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:37.740719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:37.740719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:37.740719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:37.741869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:37.741869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:37.741869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:37.741869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:37.741869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:37.741869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:37.741869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:37.741869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:37.741869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:37.741869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:37.741869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 16 14:45:37.741869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:45:37.741869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 14:45:37.741869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:45:37.741869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 589/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 16 14:45:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:37.748211 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bc342-3db7-4310-97f1-6c06bb4f65f5 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:37.821761 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:37.848557 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bc342-3db7-4310-97f1-6c06bb4f65f5 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:37.881478 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f431031-766e-4f2b-a007-bd609caf2348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:37.882135 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f431031-766e-4f2b-a007-bd609caf2348 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:37.882501 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f431031-766e-4f2b-a007-bd609caf2348 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:37.882782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f431031-766e-4f2b-a007-bd609caf2348 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:37.884201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f431031-766e-4f2b-a007-bd609caf2348 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:37.884514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f431031-766e-4f2b-a007-bd609caf2348 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:37.885926 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f431031-766e-4f2b-a007-bd609caf2348 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:37.892809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 577/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Thu Jun 16 14:45:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:40.087018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345e0bd-afd2-4474-9586-9b1a8882e5ca None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:40.087599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345e0bd-afd2-4474-9586-9b1a8882e5ca None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:40.087599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345e0bd-afd2-4474-9586-9b1a8882e5ca None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:40.088973 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 590/1167] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:40.094064 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727c870-311a-4246-9946-a14712d1a459 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:40.094461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727c870-311a-4246-9946-a14712d1a459 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:40.094699 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727c870-311a-4246-9946-a14712d1a459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:40.110848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-0727c870-311a-4246-9946-a14712d1a459 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:40.112028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-0727c870-311a-4246-9946-a14712d1a459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:40.177735 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 578/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:45:40.200771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345e0bd-afd2-4474-9586-9b1a8882e5ca None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:40.205211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:40.301898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345e0bd-afd2-4474-9586-9b1a8882e5ca None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:40.334220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950da4e1-b190-4d3c-844a-4f4cb89d09ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:40.334875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950da4e1-b190-4d3c-844a-4f4cb89d09ec None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:40.335166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950da4e1-b190-4d3c-844a-4f4cb89d09ec None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:40.335448 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950da4e1-b190-4d3c-844a-4f4cb89d09ec None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:40.336183 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950da4e1-b190-4d3c-844a-4f4cb89d09ec None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:40.337612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950da4e1-b190-4d3c-844a-4f4cb89d09ec None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:40.417016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 591/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Thu Jun 16 14:45:40 2022] POST /identity/v3/domains => generated 267 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:45:42.581646 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efcff7-215f-44ed-ad40-036cca1f8658 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:42.582231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efcff7-215f-44ed-ad40-036cca1f8658 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:42.582231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efcff7-215f-44ed-ad40-036cca1f8658 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:42.583573 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 579/1170] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:42.588724 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72cb6-65ac-48e7-bafe-be3b1eaddc1b None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:42.589730 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72cb6-65ac-48e7-bafe-be3b1eaddc1b None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:42.589853 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba72cb6-65ac-48e7-bafe-be3b1eaddc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:42.606135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-fba72cb6-65ac-48e7-bafe-be3b1eaddc1b None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:42.607313 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fba72cb6-65ac-48e7-bafe-be3b1eaddc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:42.663155 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:42.671109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 592/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:42.694226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efcff7-215f-44ed-ad40-036cca1f8658 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:42.759195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:42.793434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efcff7-215f-44ed-ad40-036cca1f8658 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:42.826830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579195ee-12fc-4413-9f22-297bb9b64425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:42.827677 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579195ee-12fc-4413-9f22-297bb9b64425 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:42.827962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579195ee-12fc-4413-9f22-297bb9b64425 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:42.828239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579195ee-12fc-4413-9f22-297bb9b64425 None admin] PATH_INFO: `/v3/domains/d9d42bbac4b04b88af1615d86af63e16` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:42.838311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579195ee-12fc-4413-9f22-297bb9b64425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d9d42bbac4b04b88af1615d86af63e16)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:42.839724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579195ee-12fc-4413-9f22-297bb9b64425 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:42.841634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 580/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Thu Jun 16 14:45:42 2022] GET /identity/v3/domains/d9d42bbac4b04b88af1615d86af63e16 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:42.847132 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba72cb6-65ac-48e7-bafe-be3b1eaddc1b None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:42.941339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba72cb6-65ac-48e7-bafe-be3b1eaddc1b None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:42.977645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862ec21-0278-4432-9a19-03135797dbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:42.978323 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862ec21-0278-4432-9a19-03135797dbdd None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:42.978605 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862ec21-0278-4432-9a19-03135797dbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:42.978882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862ec21-0278-4432-9a19-03135797dbdd None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:42.979578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862ec21-0278-4432-9a19-03135797dbdd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:42.981011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862ec21-0278-4432-9a19-03135797dbdd None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:43.069117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 593/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 16 14:45:42 2022] POST /identity/v3/projects => generated 361 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:45:45.227463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a38eb-9512-4b9e-a630-bf5f22f60451 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:45.227977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a38eb-9512-4b9e-a630-bf5f22f60451 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:45.227977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a38eb-9512-4b9e-a630-bf5f22f60451 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:45.229341 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 581/1174] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:45.235152 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309d41a-5ed4-4a31-9528-398f18d3fc16 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:45.235520 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309d41a-5ed4-4a31-9528-398f18d3fc16 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:45.235720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309d41a-5ed4-4a31-9528-398f18d3fc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:45.252000 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-b309d41a-5ed4-4a31-9528-398f18d3fc16 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:45.253187 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b309d41a-5ed4-4a31-9528-398f18d3fc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:45.297940 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:45.324973 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 594/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:45.350573 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a38eb-9512-4b9e-a630-bf5f22f60451 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:45.453583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a38eb-9512-4b9e-a630-bf5f22f60451 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:45.477240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:45.488370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a0628-bcd3-4f28-9d76-f23c5a723721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:45.488370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a0628-bcd3-4f28-9d76-f23c5a723721 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:45.488370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a0628-bcd3-4f28-9d76-f23c5a723721 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:45.488370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a0628-bcd3-4f28-9d76-f23c5a723721 None admin] PATH_INFO: `/v3/domains/d9d42bbac4b04b88af1615d86af63e16` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:45.488757 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a0628-bcd3-4f28-9d76-f23c5a723721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d9d42bbac4b04b88af1615d86af63e16)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:45.490114 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a0628-bcd3-4f28-9d76-f23c5a723721 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:45.491723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 582/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Thu Jun 16 14:45:45 2022] GET /identity/v3/domains/d9d42bbac4b04b88af1615d86af63e16 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:45.498262 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309d41a-5ed4-4a31-9528-398f18d3fc16 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:45.593295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309d41a-5ed4-4a31-9528-398f18d3fc16 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:45.627456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23ad03-955b-493e-abf9-c8daa3c36a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:45.628431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23ad03-955b-493e-abf9-c8daa3c36a37 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:45.628855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23ad03-955b-493e-abf9-c8daa3c36a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:45.629303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23ad03-955b-493e-abf9-c8daa3c36a37 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:45.630382 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23ad03-955b-493e-abf9-c8daa3c36a37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:45.632691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23ad03-955b-493e-abf9-c8daa3c36a37 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:45.783785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 595/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:45:45 2022] POST /identity/v3/users => generated 311 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:45:47.958129 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7c9f4-5a46-4933-98a0-bc868b23aa6a None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:47.958690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7c9f4-5a46-4933-98a0-bc868b23aa6a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:47.958690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7c9f4-5a46-4933-98a0-bc868b23aa6a None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:47.960066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 583/1178] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:47.965924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f15db-f65a-458f-a8e4-feca120fe2b2 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:47.966350 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f15db-f65a-458f-a8e4-feca120fe2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:47.966482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f15db-f65a-458f-a8e4-feca120fe2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:47.982839 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-974f15db-f65a-458f-a8e4-feca120fe2b2 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:47.984026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-974f15db-f65a-458f-a8e4-feca120fe2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:48.009060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:48.050037 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 596/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:48.073423 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7c9f4-5a46-4933-98a0-bc868b23aa6a None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:48.172211 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7c9f4-5a46-4933-98a0-bc868b23aa6a None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:48.204796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6192b-9cc2-4e7c-8c72-a0eebd03de4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:48.205619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6192b-9cc2-4e7c-8c72-a0eebd03de4a None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:48.205962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6192b-9cc2-4e7c-8c72-a0eebd03de4a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:48.206241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6192b-9cc2-4e7c-8c72-a0eebd03de4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:48.216816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6192b-9cc2-4e7c-8c72-a0eebd03de4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:48.224442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-b7e6192b-9cc2-4e7c-8c72-a0eebd03de4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:48.224442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:48.224442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:48.224442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:48.224442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:48.224442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:48.224442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:48.224442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:48.224442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:48.224442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:48.224442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:48.224442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:48.224442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:48.224442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:48.224442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:48.224442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:48.225662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:48.225662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:48.225662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:48.225662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:48.225662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:48.225662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:48.225662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:48.225662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:48.225662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:48.225662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:48.225662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:48.225662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:48.225662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:48.225662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:48.225662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:48.225662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:48.226740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:48.226740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:48.226740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:48.226740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:48.226740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:48.226740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:48.226740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:48.226740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:48.226740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:48.226740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:48.226740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:48.226740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:45:48.226740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 584/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:45:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:48.231613 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f15db-f65a-458f-a8e4-feca120fe2b2 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:48.327062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f15db-f65a-458f-a8e4-feca120fe2b2 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:48.360013 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390eb5b-78df-4fcd-bec2-8d329ae9822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:48.360674 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390eb5b-78df-4fcd-bec2-8d329ae9822e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:48.360960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390eb5b-78df-4fcd-bec2-8d329ae9822e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:48.361271 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390eb5b-78df-4fcd-bec2-8d329ae9822e None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:48.362014 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390eb5b-78df-4fcd-bec2-8d329ae9822e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:48.362325 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390eb5b-78df-4fcd-bec2-8d329ae9822e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:48.363689 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390eb5b-78df-4fcd-bec2-8d329ae9822e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:48.371974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 597/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:45:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:48.377628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6192b-9cc2-4e7c-8c72-a0eebd03de4a None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:48.431557 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:48.474533 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6192b-9cc2-4e7c-8c72-a0eebd03de4a None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:48.507340 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4381f-d02a-427b-b651-b971fc33c976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:48.508224 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4381f-d02a-427b-b651-b971fc33c976 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:48.508506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4381f-d02a-427b-b651-b971fc33c976 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:48.508813 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4381f-d02a-427b-b651-b971fc33c976 None admin] PATH_INFO: `/v3/users/64314f167e504311b02934617a143886` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:48.521306 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4381f-d02a-427b-b651-b971fc33c976 None admin] RBAC: Authorizing `identity:get_user(user_id=64314f167e504311b02934617a143886)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:48.522742 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4381f-d02a-427b-b651-b971fc33c976 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:48.524349 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 585/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:48 2022] GET /identity/v3/users/64314f167e504311b02934617a143886 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:48.529971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390eb5b-78df-4fcd-bec2-8d329ae9822e None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:48.555170 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:48.628588 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390eb5b-78df-4fcd-bec2-8d329ae9822e None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:48.661987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff1188-26fe-490a-969c-ad4d42b5e165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:48.662621 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff1188-26fe-490a-969c-ad4d42b5e165 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:48.662904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff1188-26fe-490a-969c-ad4d42b5e165 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:48.663178 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff1188-26fe-490a-969c-ad4d42b5e165 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:48.730645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff1188-26fe-490a-969c-ad4d42b5e165 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:48.732050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff1188-26fe-490a-969c-ad4d42b5e165 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:48.755177 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:48.828332 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 598/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:45:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:45:48.834150 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4381f-d02a-427b-b651-b971fc33c976 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:48.929954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4381f-d02a-427b-b651-b971fc33c976 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:48.943654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:48.963824 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed576f-46cc-4c4f-b11f-383a7049a248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:48.964837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed576f-46cc-4c4f-b11f-383a7049a248 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:48.965206 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed576f-46cc-4c4f-b11f-383a7049a248 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:48.965493 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed576f-46cc-4c4f-b11f-383a7049a248 None admin] PATH_INFO: `/v3/projects/18ebdc84e45c4cd9a1e1e8426ad8c924` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:48.966686 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed576f-46cc-4c4f-b11f-383a7049a248 None admin] RBAC: Authorizing `identity:get_project(project_id=18ebdc84e45c4cd9a1e1e8426ad8c924)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:48.968104 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed576f-46cc-4c4f-b11f-383a7049a248 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:48.969830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 586/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:45:48 2022] GET /identity/v3/projects/18ebdc84e45c4cd9a1e1e8426ad8c924 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:48.975897 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff1188-26fe-490a-969c-ad4d42b5e165 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:49.071153 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff1188-26fe-490a-969c-ad4d42b5e165 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:49.094007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:49.104094 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53ede6-0e18-4059-bf76-a9d51f8c3022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:49.108080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53ede6-0e18-4059-bf76-a9d51f8c3022 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:49.108080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53ede6-0e18-4059-bf76-a9d51f8c3022 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:49.108080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53ede6-0e18-4059-bf76-a9d51f8c3022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:49.108080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53ede6-0e18-4059-bf76-a9d51f8c3022 None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.project.id=18ebdc84e45c4cd9a1e1e8426ad8c924, user.id=64314f167e504311b02934617a143886) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:49.108080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53ede6-0e18-4059-bf76-a9d51f8c3022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:49.108559 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53ede6-0e18-4059-bf76-a9d51f8c3022 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:49.113751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 599/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:45:48 2022] GET /identity/v3/role_assignments?user.id=64314f167e504311b02934617a143886&scope.project.id=18ebdc84e45c4cd9a1e1e8426ad8c924&role.id=c865040abd6c4b099381557da21c471d => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:51.182434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c3b32-7e9a-42aa-b2e9-06327a7cac37 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:51.182965 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c3b32-7e9a-42aa-b2e9-06327a7cac37 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:51.182965 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c3b32-7e9a-42aa-b2e9-06327a7cac37 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:51.184868 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 587/1186] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:51.189958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678846f-7438-4051-9da4-70f778cfaaa1 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:51.190373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678846f-7438-4051-9da4-70f778cfaaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:51.190519 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678846f-7438-4051-9da4-70f778cfaaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:51.207424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-2678846f-7438-4051-9da4-70f778cfaaa1 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:51.208604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2678846f-7438-4051-9da4-70f778cfaaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:51.272093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 600/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:45:51.294080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c3b32-7e9a-42aa-b2e9-06327a7cac37 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:51.391877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c3b32-7e9a-42aa-b2e9-06327a7cac37 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:51.424477 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b89eb4-14b1-4f1a-8bbe-f4efc9c701a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:51.425279 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b89eb4-14b1-4f1a-8bbe-f4efc9c701a7 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:51.425564 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b89eb4-14b1-4f1a-8bbe-f4efc9c701a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:51.425842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b89eb4-14b1-4f1a-8bbe-f4efc9c701a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:51.436187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b89eb4-14b1-4f1a-8bbe-f4efc9c701a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:51.443733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-63b89eb4-14b1-4f1a-8bbe-f4efc9c701a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:51.443733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:51.443733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:51.443733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:51.443733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:51.443733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:51.443733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:51.443733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:51.443733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:51.443733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:51.443733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:51.443733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:51.443733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:51.443733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:51.443733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:51.443733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:51.444836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:51.444836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:51.444836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:51.444836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:51.444836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:51.444836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:51.444836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:51.444836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:51.444836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:51.444836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:51.444836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:51.444836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:51.444836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:51.444836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:51.444836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:51.444836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:51.445783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:51.445783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:51.445783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:51.445783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:51.445783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:51.445783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:51.445783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:51.445783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:51.445783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:51.445783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:51.445783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:51.445783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:45:51.445783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 588/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:45:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:51.450993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678846f-7438-4051-9da4-70f778cfaaa1 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:51.546170 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678846f-7438-4051-9da4-70f778cfaaa1 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:51.562922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:51.578765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74349576-bfa1-40ad-88ff-83de19aaa679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:51.579478 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74349576-bfa1-40ad-88ff-83de19aaa679 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:51.579764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74349576-bfa1-40ad-88ff-83de19aaa679 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:51.580044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74349576-bfa1-40ad-88ff-83de19aaa679 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:51.580793 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74349576-bfa1-40ad-88ff-83de19aaa679 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:51.581102 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74349576-bfa1-40ad-88ff-83de19aaa679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:51.582551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74349576-bfa1-40ad-88ff-83de19aaa679 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:51.590276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 601/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:45:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:51.595873 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b89eb4-14b1-4f1a-8bbe-f4efc9c701a7 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:51.637543 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:51.693099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b89eb4-14b1-4f1a-8bbe-f4efc9c701a7 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:51.725663 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc654ea6-fd63-40b0-b42c-1a5cf78948d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:51.726526 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc654ea6-fd63-40b0-b42c-1a5cf78948d4 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:51.726812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc654ea6-fd63-40b0-b42c-1a5cf78948d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:51.727087 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc654ea6-fd63-40b0-b42c-1a5cf78948d4 None admin] PATH_INFO: `/v3/users/64314f167e504311b02934617a143886` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:51.728260 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc654ea6-fd63-40b0-b42c-1a5cf78948d4 None admin] RBAC: Authorizing `identity:get_user(user_id=64314f167e504311b02934617a143886)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:51.729714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc654ea6-fd63-40b0-b42c-1a5cf78948d4 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:51.731358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 589/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:51 2022] GET /identity/v3/users/64314f167e504311b02934617a143886 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:51.737417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74349576-bfa1-40ad-88ff-83de19aaa679 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:51.834666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74349576-bfa1-40ad-88ff-83de19aaa679 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:51.866453 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260d362-3111-443b-a2d5-f0529fa05d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:51.867306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260d362-3111-443b-a2d5-f0529fa05d2a None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:51.867595 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260d362-3111-443b-a2d5-f0529fa05d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:51.867875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260d362-3111-443b-a2d5-f0529fa05d2a None admin] PATH_INFO: `/v3/projects/18ebdc84e45c4cd9a1e1e8426ad8c924` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:51.869048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260d362-3111-443b-a2d5-f0529fa05d2a None admin] RBAC: Authorizing `identity:get_project(project_id=18ebdc84e45c4cd9a1e1e8426ad8c924)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:51.870579 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260d362-3111-443b-a2d5-f0529fa05d2a None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:51.872704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 602/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:45:51 2022] GET /identity/v3/projects/18ebdc84e45c4cd9a1e1e8426ad8c924 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:51.878636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc654ea6-fd63-40b0-b42c-1a5cf78948d4 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:51.978245 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc654ea6-fd63-40b0-b42c-1a5cf78948d4 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:51.986913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:52.010629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcde44c-1d07-45c1-a651-b4b672e8f1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:52.011513 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcde44c-1d07-45c1-a651-b4b672e8f1da None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:52.011811 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcde44c-1d07-45c1-a651-b4b672e8f1da None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:52.012914 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcde44c-1d07-45c1-a651-b4b672e8f1da None admin] PATH_INFO: `/v3/projects/18ebdc84e45c4cd9a1e1e8426ad8c924/users/64314f167e504311b02934617a143886/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:52.016419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcde44c-1d07-45c1-a651-b4b672e8f1da None admin] RBAC: Authorizing `identity:create_grant(project_id=18ebdc84e45c4cd9a1e1e8426ad8c924, user_id=64314f167e504311b02934617a143886, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:52.018875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcde44c-1d07-45c1-a651-b4b672e8f1da None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:52.092076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 590/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:45:51 2022] PUT /identity/v3/projects/18ebdc84e45c4cd9a1e1e8426ad8c924/users/64314f167e504311b02934617a143886/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:45:54.196057 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d97d5-48a9-41a5-88a2-1afaf205c0e6 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:54.196611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d97d5-48a9-41a5-88a2-1afaf205c0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:54.196611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d97d5-48a9-41a5-88a2-1afaf205c0e6 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:54.198007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 603/1193] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:45:54.203690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eda38-f9c9-4315-b543-b3d2a9c99058 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:54.204081 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eda38-f9c9-4315-b543-b3d2a9c99058 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:54.204255 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eda38-f9c9-4315-b543-b3d2a9c99058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:54.220512 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-3c0eda38-f9c9-4315-b543-b3d2a9c99058 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:45:54.221725 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3c0eda38-f9c9-4315-b543-b3d2a9c99058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:45:54.286219 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 591/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:45:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:45:54.310379 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d97d5-48a9-41a5-88a2-1afaf205c0e6 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:54.359024 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:54.407735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d97d5-48a9-41a5-88a2-1afaf205c0e6 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:54.439970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fcd32-4a62-4352-8441-105b91e74e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:54.440753 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fcd32-4a62-4352-8441-105b91e74e82 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:54.441036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fcd32-4a62-4352-8441-105b91e74e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:54.441339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fcd32-4a62-4352-8441-105b91e74e82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:54.452625 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fcd32-4a62-4352-8441-105b91e74e82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:45:54.460250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-0a0fcd32-4a62-4352-8441-105b91e74e82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:54.460250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:45:54.460250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:45:54.460250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:45:54.460250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:45:54.460250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:45:54.460250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:45:54.460250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:45:54.460250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:45:54.460250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:45:54.460250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:45:54.460250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:45:54.460250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:45:54.460250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:45:54.460250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:45:54.460250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:45:54.461374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:45:54.461374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:45:54.461374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:45:54.461374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:45:54.461374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:45:54.461374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:45:54.461374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:45:54.461374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:45:54.461374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:45:54.461374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:45:54.461374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:45:54.461374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:45:54.461374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:45:54.461374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:45:54.461374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:45:54.461374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:45:54.462426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:45:54.462426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:45:54.462426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:45:54.462426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:45:54.462426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:45:54.462426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:45:54.462426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:45:54.462426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:45:54.462426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:45:54.462426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:45:54.462426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:45:54.462426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:45:54.462426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 604/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:45:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:45:54.468610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0eda38-f9c9-4315-b543-b3d2a9c99058 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:54.559908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:54.563506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0eda38-f9c9-4315-b543-b3d2a9c99058 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:54.596843 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb2f49-9487-4892-8598-5eba8480772f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:54.597559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb2f49-9487-4892-8598-5eba8480772f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:54.597848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb2f49-9487-4892-8598-5eba8480772f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:54.598136 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb2f49-9487-4892-8598-5eba8480772f None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:54.598916 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb2f49-9487-4892-8598-5eba8480772f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:54.599224 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb2f49-9487-4892-8598-5eba8480772f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:54.600589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb2f49-9487-4892-8598-5eba8480772f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:54.608667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 592/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:45:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:54.614566 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fcd32-4a62-4352-8441-105b91e74e82 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:54.717736 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fcd32-4a62-4352-8441-105b91e74e82 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:54.726809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:54.750249 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc6301-d53a-4063-a95f-8645dd2546cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:54.751106 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc6301-d53a-4063-a95f-8645dd2546cb None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:54.751386 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc6301-d53a-4063-a95f-8645dd2546cb None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:54.751663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc6301-d53a-4063-a95f-8645dd2546cb None admin] PATH_INFO: `/v3/users/64314f167e504311b02934617a143886` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:54.752859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc6301-d53a-4063-a95f-8645dd2546cb None admin] RBAC: Authorizing `identity:get_user(user_id=64314f167e504311b02934617a143886)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:54.754308 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc6301-d53a-4063-a95f-8645dd2546cb None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:54.755939 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 605/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Thu Jun 16 14:45:54 2022] GET /identity/v3/users/64314f167e504311b02934617a143886 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:54.762005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb2f49-9487-4892-8598-5eba8480772f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:54.859690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb2f49-9487-4892-8598-5eba8480772f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:54.892957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd42c26-9a45-4788-b656-36a72f5174b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:54.893632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd42c26-9a45-4788-b656-36a72f5174b0 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:54.893923 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd42c26-9a45-4788-b656-36a72f5174b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:54.894205 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd42c26-9a45-4788-b656-36a72f5174b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:54.921365 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:54.972129 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd42c26-9a45-4788-b656-36a72f5174b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:54.973675 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd42c26-9a45-4788-b656-36a72f5174b0 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:55.070872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 593/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:45:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:45:55.077546 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc6301-d53a-4063-a95f-8645dd2546cb None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:55.173302 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc6301-d53a-4063-a95f-8645dd2546cb None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:55.205700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccc89d-c7f2-4a6f-934f-eb88b7962257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:55.206551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccc89d-c7f2-4a6f-934f-eb88b7962257 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:55.206837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccc89d-c7f2-4a6f-934f-eb88b7962257 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:55.207114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccc89d-c7f2-4a6f-934f-eb88b7962257 None admin] PATH_INFO: `/v3/projects/18ebdc84e45c4cd9a1e1e8426ad8c924` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:55.208314 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccc89d-c7f2-4a6f-934f-eb88b7962257 None admin] RBAC: Authorizing `identity:get_project(project_id=18ebdc84e45c4cd9a1e1e8426ad8c924)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:55.209789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccc89d-c7f2-4a6f-934f-eb88b7962257 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:55.211446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 606/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Thu Jun 16 14:45:55 2022] GET /identity/v3/projects/18ebdc84e45c4cd9a1e1e8426ad8c924 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:45:55.217361 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd42c26-9a45-4788-b656-36a72f5174b0 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:45:55.273514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:45:55.312978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd42c26-9a45-4788-b656-36a72f5174b0 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:45:55.345091 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54450783-c31f-4173-a04d-b389251b451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:45:55.345770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54450783-c31f-4173-a04d-b389251b451b None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:45:55.346059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54450783-c31f-4173-a04d-b389251b451b None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:45:55.346339 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54450783-c31f-4173-a04d-b389251b451b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:45:55.347156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54450783-c31f-4173-a04d-b389251b451b None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.project.id=18ebdc84e45c4cd9a1e1e8426ad8c924, user.id=64314f167e504311b02934617a143886) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:45:55.347470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54450783-c31f-4173-a04d-b389251b451b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:45:55.348882 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54450783-c31f-4173-a04d-b389251b451b None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:45:55.354546 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 594/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:45:55 2022] GET /identity/v3/role_assignments?user.id=64314f167e504311b02934617a143886&scope.project.id=18ebdc84e45c4cd9a1e1e8426ad8c924&role.id=c865040abd6c4b099381557da21c471d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:46:05.201903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=78 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:46:05.352009 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=38 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:14.442381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159aea8-a1f6-4aea-b5bd-17993f376060 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:14.442989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159aea8-a1f6-4aea-b5bd-17993f376060 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:14.442989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159aea8-a1f6-4aea-b5bd-17993f376060 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:14.444290 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 607/1201] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:14.450041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d48385-0286-4368-9bd8-009b0ed449b2 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:14.450466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d48385-0286-4368-9bd8-009b0ed449b2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:14.450607 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d48385-0286-4368-9bd8-009b0ed449b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:14.467515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-97d48385-0286-4368-9bd8-009b0ed449b2 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:14.468705 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-97d48385-0286-4368-9bd8-009b0ed449b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:14.533291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 595/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:47:14.558042 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159aea8-a1f6-4aea-b5bd-17993f376060 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:14.657865 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159aea8-a1f6-4aea-b5bd-17993f376060 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:14.691426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa7a4d-95bc-4e5d-a2b0-2e5682f2ccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:14.692206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa7a4d-95bc-4e5d-a2b0-2e5682f2ccf5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:14.692535 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa7a4d-95bc-4e5d-a2b0-2e5682f2ccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:14.692760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa7a4d-95bc-4e5d-a2b0-2e5682f2ccf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:14.703015 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa7a4d-95bc-4e5d-a2b0-2e5682f2ccf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:14.704451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa7a4d-95bc-4e5d-a2b0-2e5682f2ccf5 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:14.721273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-e4aa7a4d-95bc-4e5d-a2b0-2e5682f2ccf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:14.721273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:14.721273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:14.721273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:14.721273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:14.721273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:14.721273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:14.721273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:14.721273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:14.721273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:14.721273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:14.721273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:14.721273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:47:14.721273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:47:14.721273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:14.722378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:14.723498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:47:14.723498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:47:14.723498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:14.723498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:47:14.723498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 608/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:14.728779 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d48385-0286-4368-9bd8-009b0ed449b2 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:14.826913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d48385-0286-4368-9bd8-009b0ed449b2 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:14.854465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:14.860186 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469a484-f73b-4339-b341-cde2d312c3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:14.860849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469a484-f73b-4339-b341-cde2d312c3eb None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:14.861152 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469a484-f73b-4339-b341-cde2d312c3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:14.861439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469a484-f73b-4339-b341-cde2d312c3eb None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:14.862209 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469a484-f73b-4339-b341-cde2d312c3eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:14.862520 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469a484-f73b-4339-b341-cde2d312c3eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:14.863891 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469a484-f73b-4339-b341-cde2d312c3eb None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:14.875366 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 596/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:14.881253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa7a4d-95bc-4e5d-a2b0-2e5682f2ccf5 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:14.936009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:14.985120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa7a4d-95bc-4e5d-a2b0-2e5682f2ccf5 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:15.022739 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c32ed-e781-420b-be3e-79fb08d38662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:15.023435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c32ed-e781-420b-be3e-79fb08d38662 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:15.023721 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c32ed-e781-420b-be3e-79fb08d38662 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:15.023995 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c32ed-e781-420b-be3e-79fb08d38662 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:15.024737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c32ed-e781-420b-be3e-79fb08d38662 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:15.026303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c32ed-e781-420b-be3e-79fb08d38662 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:15.213360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 609/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Thu Jun 16 14:47:14 2022] POST /identity/v3/users => generated 251 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 14:47:17.363080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bc40f-d011-4b6f-b3cd-5d56310768b6 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:17.363600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bc40f-d011-4b6f-b3cd-5d56310768b6 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:17.363600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bc40f-d011-4b6f-b3cd-5d56310768b6 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:17.364934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 597/1206] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:17.370075 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084f5eb-b522-4d7f-bbdd-3facfba860b3 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:17.376626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084f5eb-b522-4d7f-bbdd-3facfba860b3 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:17.376626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084f5eb-b522-4d7f-bbdd-3facfba860b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:17.387664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-0084f5eb-b522-4d7f-bbdd-3facfba860b3 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:17.388855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0084f5eb-b522-4d7f-bbdd-3facfba860b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:17.453982 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 610/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:47:17.477305 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bc40f-d011-4b6f-b3cd-5d56310768b6 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:17.576550 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bc40f-d011-4b6f-b3cd-5d56310768b6 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:17.608675 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d056da-69ca-4615-b956-45239e2db639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:17.609493 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d056da-69ca-4615-b956-45239e2db639 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:17.609781 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d056da-69ca-4615-b956-45239e2db639 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:17.610060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d056da-69ca-4615-b956-45239e2db639 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:17.623418 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d056da-69ca-4615-b956-45239e2db639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:47:17.629441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-02d056da-69ca-4615-b956-45239e2db639 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:47:17.629441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:17.629441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:17.629441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:17.629441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:17.629441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:17.629441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:17.629441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:17.629441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:17.629441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:17.629441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:17.629441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:17.629441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:47:17.629441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:47:17.629441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:47:17.629441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:47:17.630589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:47:17.630589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:47:17.630589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:47:17.630589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:47:17.630589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:17.630589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:17.630589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:17.630589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:17.630589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:17.630589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:17.630589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:17.630589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:17.630589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:17.630589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:17.630589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:17.630589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:17.631667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:17.631667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:17.631667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:17.631667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:17.631667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:47:17.631667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:47:17.631667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:47:17.631667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:47:17.631667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:47:17.631667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:47:17.631667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:47:17.631667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:17.631667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 598/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:47:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:47:17.636525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084f5eb-b522-4d7f-bbdd-3facfba860b3 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:17.675722 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:17.733545 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084f5eb-b522-4d7f-bbdd-3facfba860b3 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:17.766433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ec458-55a0-45c1-9124-9a4d3acec544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:17.767105 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ec458-55a0-45c1-9124-9a4d3acec544 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:17.767417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ec458-55a0-45c1-9124-9a4d3acec544 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:17.767697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ec458-55a0-45c1-9124-9a4d3acec544 None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:17.768446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ec458-55a0-45c1-9124-9a4d3acec544 None admin] RBAC: Adding query filter params (name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:17.768759 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ec458-55a0-45c1-9124-9a4d3acec544 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:17.770176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ec458-55a0-45c1-9124-9a4d3acec544 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:17.778135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 611/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:47:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:17.784010 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d056da-69ca-4615-b956-45239e2db639 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:17.834246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:17.881262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d056da-69ca-4615-b956-45239e2db639 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:17.914071 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad43cfc-df5c-4e7a-bbe0-7fdfcd69c0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:17.914858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad43cfc-df5c-4e7a-bbe0-7fdfcd69c0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:17.915144 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad43cfc-df5c-4e7a-bbe0-7fdfcd69c0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:17.915420 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad43cfc-df5c-4e7a-bbe0-7fdfcd69c0d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:17.925525 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad43cfc-df5c-4e7a-bbe0-7fdfcd69c0d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:17.926978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad43cfc-df5c-4e7a-bbe0-7fdfcd69c0d9 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:17.944719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-fad43cfc-df5c-4e7a-bbe0-7fdfcd69c0d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:17.944719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:17.944719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:17.944719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:17.944719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:17.944719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:17.944719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:17.944719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:17.944719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:17.944719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:17.944719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:17.944719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:17.944719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:47:17.944719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:47:17.944719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:17.945749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:17.946651 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:47:17.946651 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:47:17.946651 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:17.946651 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:17.946651 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 599/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:17.952587 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ec458-55a0-45c1-9124-9a4d3acec544 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:18.049864 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:18.052998 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ec458-55a0-45c1-9124-9a4d3acec544 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:18.086104 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65edba-46b9-4b15-b2b9-cf99d3475e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:18.086820 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65edba-46b9-4b15-b2b9-cf99d3475e47 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:18.087104 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65edba-46b9-4b15-b2b9-cf99d3475e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:18.087409 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65edba-46b9-4b15-b2b9-cf99d3475e47 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:18.088121 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65edba-46b9-4b15-b2b9-cf99d3475e47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:18.088435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65edba-46b9-4b15-b2b9-cf99d3475e47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:18.089829 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65edba-46b9-4b15-b2b9-cf99d3475e47 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:18.101042 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 612/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:18.107268 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad43cfc-df5c-4e7a-bbe0-7fdfcd69c0d9 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:18.204581 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad43cfc-df5c-4e7a-bbe0-7fdfcd69c0d9 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:18.206148 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:18.237689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278f85e-72f3-4dfc-850d-3670d2bc2a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:18.238484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278f85e-72f3-4dfc-850d-3670d2bc2a21 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:18.238765 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278f85e-72f3-4dfc-850d-3670d2bc2a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:18.239042 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278f85e-72f3-4dfc-850d-3670d2bc2a21 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:18.245955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278f85e-72f3-4dfc-850d-3670d2bc2a21 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:18.248023 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278f85e-72f3-4dfc-850d-3670d2bc2a21 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:18.262872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-2278f85e-72f3-4dfc-850d-3670d2bc2a21 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:47:18.262872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:18.262872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:18.262872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:18.262872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:18.262872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:18.262872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:18.262872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:18.262872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:18.262872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:18.262872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:18.262872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:18.262872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:47:18.262872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:47:18.262872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:47:18.262872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:18.263973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:18.265030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:18.265030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:18.265030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:47:18.265030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:47:18.265030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:47:18.265030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:47:18.265030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:47:18.265030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:47:18.265030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:47:18.265030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:18.265030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 600/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:18.270117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65edba-46b9-4b15-b2b9-cf99d3475e47 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:18.384185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65edba-46b9-4b15-b2b9-cf99d3475e47 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:18.417294 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c85300-a2c2-43f7-a406-1d6b13006386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:18.417955 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c85300-a2c2-43f7-a406-1d6b13006386 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:18.418278 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c85300-a2c2-43f7-a406-1d6b13006386 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:18.419109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c85300-a2c2-43f7-a406-1d6b13006386 None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:18.419944 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c85300-a2c2-43f7-a406-1d6b13006386 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:18.420256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c85300-a2c2-43f7-a406-1d6b13006386 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:18.421708 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c85300-a2c2-43f7-a406-1d6b13006386 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:18.438334 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 613/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jun 16 14:47:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:18.444112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278f85e-72f3-4dfc-850d-3670d2bc2a21 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:18.541177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278f85e-72f3-4dfc-850d-3670d2bc2a21 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:18.574604 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3ffd7-6715-41f7-9e66-941823aa25a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:18.575247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3ffd7-6715-41f7-9e66-941823aa25a8 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:18.575534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3ffd7-6715-41f7-9e66-941823aa25a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:18.575815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3ffd7-6715-41f7-9e66-941823aa25a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:18.604611 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:18.640642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3ffd7-6715-41f7-9e66-941823aa25a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:18.642139 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3ffd7-6715-41f7-9e66-941823aa25a8 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:18.747592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 601/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:47:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:47:18.753533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c85300-a2c2-43f7-a406-1d6b13006386 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:18.772349 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:18.849244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c85300-a2c2-43f7-a406-1d6b13006386 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:18.882550 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f089c2d-224a-4e96-ad83-8275cd50b36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:18.883333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f089c2d-224a-4e96-ad83-8275cd50b36b None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:18.883620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f089c2d-224a-4e96-ad83-8275cd50b36b None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:18.883898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f089c2d-224a-4e96-ad83-8275cd50b36b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:18.894113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f089c2d-224a-4e96-ad83-8275cd50b36b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:18.895556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f089c2d-224a-4e96-ad83-8275cd50b36b None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:18.913556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-6f089c2d-224a-4e96-ad83-8275cd50b36b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:18.913556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:18.913556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:18.913556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:18.913556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:18.913556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:18.913556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:18.913556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:18.913556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:18.913556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:18.913556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:18.913556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:18.913556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:47:18.913556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:47:18.913556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:18.916772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:18.917935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:47:18.917935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:47:18.917935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:18.917935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:47:18.917935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 614/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:18.920687 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3ffd7-6715-41f7-9e66-941823aa25a8 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:18.987588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:19.024327 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3ffd7-6715-41f7-9e66-941823aa25a8 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:19.057230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb6f33-2c8a-4eeb-aa4d-72f7f26c1631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:19.057883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb6f33-2c8a-4eeb-aa4d-72f7f26c1631 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:19.058162 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb6f33-2c8a-4eeb-aa4d-72f7f26c1631 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:19.058435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb6f33-2c8a-4eeb-aa4d-72f7f26c1631 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:19.059164 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb6f33-2c8a-4eeb-aa4d-72f7f26c1631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:19.059470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb6f33-2c8a-4eeb-aa4d-72f7f26c1631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:19.060840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb6f33-2c8a-4eeb-aa4d-72f7f26c1631 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:19.073005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 602/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:19.079303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f089c2d-224a-4e96-ad83-8275cd50b36b None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:19.147765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:19.176777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f089c2d-224a-4e96-ad83-8275cd50b36b None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:19.210754 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62dd28-b1e0-4508-8cea-e4a512731834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:19.211538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62dd28-b1e0-4508-8cea-e4a512731834 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:19.211822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62dd28-b1e0-4508-8cea-e4a512731834 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:19.212096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62dd28-b1e0-4508-8cea-e4a512731834 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:19.218503 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62dd28-b1e0-4508-8cea-e4a512731834 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:19.219942 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62dd28-b1e0-4508-8cea-e4a512731834 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:19.233888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-9e62dd28-b1e0-4508-8cea-e4a512731834 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:47:19.233888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:19.233888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:19.233888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:19.233888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:19.233888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:19.233888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:19.233888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:19.233888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:19.233888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:19.233888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:19.233888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:19.233888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:47:19.233888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:47:19.233888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:19.234908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:19.235826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:47:19.235826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:47:19.235826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:47:19.235826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:47:19.235826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:47:19.235826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:47:19.235826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:47:19.235826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:47:19.235826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 615/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:47:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:19.240896 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb6f33-2c8a-4eeb-aa4d-72f7f26c1631 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:19.337814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb6f33-2c8a-4eeb-aa4d-72f7f26c1631 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:19.359467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:19.370906 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276448a-7b28-42c6-91a6-9ae849ba1557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:19.372097 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276448a-7b28-42c6-91a6-9ae849ba1557 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:19.372387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276448a-7b28-42c6-91a6-9ae849ba1557 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:19.372667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276448a-7b28-42c6-91a6-9ae849ba1557 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:19.373489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276448a-7b28-42c6-91a6-9ae849ba1557 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:19.373804 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276448a-7b28-42c6-91a6-9ae849ba1557 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:19.375242 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276448a-7b28-42c6-91a6-9ae849ba1557 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:19.386955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 603/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:47:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:19.393626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62dd28-b1e0-4508-8cea-e4a512731834 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:19.492395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62dd28-b1e0-4508-8cea-e4a512731834 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:19.519989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:19.525664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4887fe-0920-4423-9c76-042c4b89b650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:19.526335 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4887fe-0920-4423-9c76-042c4b89b650 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:19.526618 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4887fe-0920-4423-9c76-042c4b89b650 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:19.526891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4887fe-0920-4423-9c76-042c4b89b650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:19.527722 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4887fe-0920-4423-9c76-042c4b89b650 None admin] RBAC: Adding query filter params (role.id=037df45eceeb4cb7aec314c290fa7820, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=534035b2e8cf4f769e3dbbaabc0f6ee7) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:19.528035 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4887fe-0920-4423-9c76-042c4b89b650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:19.529482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4887fe-0920-4423-9c76-042c4b89b650 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:19.534836 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 616/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:47:19 2022] GET /identity/v3/role_assignments?user.id=534035b2e8cf4f769e3dbbaabc0f6ee7&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=037df45eceeb4cb7aec314c290fa7820 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:21.638619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5267c8-0cbf-481c-a63f-026ba3b817fc None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:21.639282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5267c8-0cbf-481c-a63f-026ba3b817fc None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:21.639282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5267c8-0cbf-481c-a63f-026ba3b817fc None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:21.640538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 604/1220] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:21.645696 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5593b0d-5836-4a91-aaee-f296406e2118 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:21.647412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5593b0d-5836-4a91-aaee-f296406e2118 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:21.647412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5593b0d-5836-4a91-aaee-f296406e2118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:21.663576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-e5593b0d-5836-4a91-aaee-f296406e2118 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:21.664763 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e5593b0d-5836-4a91-aaee-f296406e2118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:21.730439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 617/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 14:47:21.752492 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5267c8-0cbf-481c-a63f-026ba3b817fc None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:21.852250 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5267c8-0cbf-481c-a63f-026ba3b817fc None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:21.890508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fee465-eab3-4fd9-8a5f-0224a02b3e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:21.891226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fee465-eab3-4fd9-8a5f-0224a02b3e2d None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:21.891549 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fee465-eab3-4fd9-8a5f-0224a02b3e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:21.891825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fee465-eab3-4fd9-8a5f-0224a02b3e2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:21.901773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fee465-eab3-4fd9-8a5f-0224a02b3e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:47:21.910710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-92fee465-eab3-4fd9-8a5f-0224a02b3e2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:47:21.910710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:21.910710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:21.910710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:21.910710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:21.910710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:21.910710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:21.910710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:21.910710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:21.910710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:21.910710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:21.910710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:21.910710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:47:21.910710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:47:21.910710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:47:21.910710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:47:21.911970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:47:21.911970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:47:21.911970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:47:21.911970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:47:21.911970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:21.911970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:21.911970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:21.911970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:21.911970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:21.911970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:21.911970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:21.911970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:21.911970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:21.911970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:21.911970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:21.911970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:21.913159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:21.913159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:21.913159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:21.913159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:21.913159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:47:21.913159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:47:21.913159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:47:21.913159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:47:21.913159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:47:21.913159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:47:21.913159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:47:21.913159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:21.913159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 605/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:47:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:21.917684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5593b0d-5836-4a91-aaee-f296406e2118 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:22.016667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5593b0d-5836-4a91-aaee-f296406e2118 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:22.040003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:22.050447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5c80e-2048-426b-b0a1-1b39793cf0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:22.051123 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5c80e-2048-426b-b0a1-1b39793cf0ec None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:22.051439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5c80e-2048-426b-b0a1-1b39793cf0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:22.051722 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5c80e-2048-426b-b0a1-1b39793cf0ec None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:22.052518 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5c80e-2048-426b-b0a1-1b39793cf0ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:22.052828 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5c80e-2048-426b-b0a1-1b39793cf0ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:22.054546 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5c80e-2048-426b-b0a1-1b39793cf0ec None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:22.063003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 618/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:47:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:22.068864 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fee465-eab3-4fd9-8a5f-0224a02b3e2d None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:22.112092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:22.168000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fee465-eab3-4fd9-8a5f-0224a02b3e2d None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:22.199990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d36be-f2e1-4a24-a7fc-b5fcbfc934ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:22.200777 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d36be-f2e1-4a24-a7fc-b5fcbfc934ee None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:22.201062 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d36be-f2e1-4a24-a7fc-b5fcbfc934ee None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:22.201367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d36be-f2e1-4a24-a7fc-b5fcbfc934ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:22.212141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d36be-f2e1-4a24-a7fc-b5fcbfc934ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:22.213611 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d36be-f2e1-4a24-a7fc-b5fcbfc934ee None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:22.229971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-4b8d36be-f2e1-4a24-a7fc-b5fcbfc934ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:22.229971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:22.229971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:22.229971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:22.229971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:22.229971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:22.229971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:22.229971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:22.229971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:22.229971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:22.229971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:22.229971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:22.229971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:47:22.229971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:47:22.229971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:22.231035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:22.231989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:47:22.231989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:47:22.231989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:22.231989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:22.231989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 606/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:22.236895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5c80e-2048-426b-b0a1-1b39793cf0ec None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:22.336421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5c80e-2048-426b-b0a1-1b39793cf0ec None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:22.368626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058f74e-769b-4800-ab88-62f7a528ee52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:22.369353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058f74e-769b-4800-ab88-62f7a528ee52 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:22.369641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058f74e-769b-4800-ab88-62f7a528ee52 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:22.369920 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058f74e-769b-4800-ab88-62f7a528ee52 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:22.370634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058f74e-769b-4800-ab88-62f7a528ee52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:22.370945 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058f74e-769b-4800-ab88-62f7a528ee52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:22.372327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058f74e-769b-4800-ab88-62f7a528ee52 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:22.384148 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 619/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:22.390573 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d36be-f2e1-4a24-a7fc-b5fcbfc934ee None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:22.482629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:22.489653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d36be-f2e1-4a24-a7fc-b5fcbfc934ee None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:22.522937 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e896cfd-9249-4a2e-8ce8-be9dc4dc39f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:22.523725 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e896cfd-9249-4a2e-8ce8-be9dc4dc39f6 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:22.524009 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e896cfd-9249-4a2e-8ce8-be9dc4dc39f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:22.524284 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e896cfd-9249-4a2e-8ce8-be9dc4dc39f6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:22.530979 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e896cfd-9249-4a2e-8ce8-be9dc4dc39f6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:22.532405 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e896cfd-9249-4a2e-8ce8-be9dc4dc39f6 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:22.547267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-3e896cfd-9249-4a2e-8ce8-be9dc4dc39f6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:47:22.547267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:22.547267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:22.547267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:22.547267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:22.547267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:22.547267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:22.547267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:22.547267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:22.547267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:22.547267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:22.547267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:22.547267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:47:22.547267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:47:22.547267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:47:22.547267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:22.548409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:22.549415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:22.549415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:22.549415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:47:22.549415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:47:22.549415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:47:22.549415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:47:22.549415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:47:22.549415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:47:22.549415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:47:22.549415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:22.549415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 607/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:22.554611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058f74e-769b-4800-ab88-62f7a528ee52 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:22.600316 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:22.652262 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058f74e-769b-4800-ab88-62f7a528ee52 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:22.686935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb76b5e-f267-42f3-93a8-c11ff09c3beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:22.687596 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb76b5e-f267-42f3-93a8-c11ff09c3beb None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:22.687883 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb76b5e-f267-42f3-93a8-c11ff09c3beb None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:22.688160 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb76b5e-f267-42f3-93a8-c11ff09c3beb None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:22.688989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb76b5e-f267-42f3-93a8-c11ff09c3beb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:22.689340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb76b5e-f267-42f3-93a8-c11ff09c3beb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:22.690827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb76b5e-f267-42f3-93a8-c11ff09c3beb None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:22.707948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 620/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jun 16 14:47:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:22.713907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e896cfd-9249-4a2e-8ce8-be9dc4dc39f6 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:22.812372 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e896cfd-9249-4a2e-8ce8-be9dc4dc39f6 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:22.845024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c97c1-9b8b-4802-8ae0-cfc3f7c51897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:22.845840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c97c1-9b8b-4802-8ae0-cfc3f7c51897 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:22.846121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c97c1-9b8b-4802-8ae0-cfc3f7c51897 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:22.846390 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c97c1-9b8b-4802-8ae0-cfc3f7c51897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:22.856582 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c97c1-9b8b-4802-8ae0-cfc3f7c51897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:22.858657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c97c1-9b8b-4802-8ae0-cfc3f7c51897 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:22.875552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-d90c97c1-9b8b-4802-8ae0-cfc3f7c51897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:22.875552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:22.875552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:22.875552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:22.875552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:22.875552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:22.875552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:22.875552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:22.875552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:22.875552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:22.875552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:22.875552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:22.875552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:47:22.875552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:47:22.875552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:22.876665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:22.877953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:47:22.877953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:47:22.877953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:22.877953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:22.877953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 608/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 14:47:22.882461 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb76b5e-f267-42f3-93a8-c11ff09c3beb None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:22.982783 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb76b5e-f267-42f3-93a8-c11ff09c3beb None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:22.985865 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:23.021080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91967418-d0e0-47a5-8cc4-e87e7ffbe442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:23.021777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91967418-d0e0-47a5-8cc4-e87e7ffbe442 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:23.022063 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91967418-d0e0-47a5-8cc4-e87e7ffbe442 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:23.022370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91967418-d0e0-47a5-8cc4-e87e7ffbe442 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:23.023087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91967418-d0e0-47a5-8cc4-e87e7ffbe442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:23.023394 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91967418-d0e0-47a5-8cc4-e87e7ffbe442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:23.024768 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91967418-d0e0-47a5-8cc4-e87e7ffbe442 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:23.036127 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 621/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:23.041882 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c97c1-9b8b-4802-8ae0-cfc3f7c51897 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:23.051338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:23.140356 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c97c1-9b8b-4802-8ae0-cfc3f7c51897 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:23.174598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb0764-5236-4049-88dd-441c9b295061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:23.175389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb0764-5236-4049-88dd-441c9b295061 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:23.175675 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb0764-5236-4049-88dd-441c9b295061 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:23.175953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb0764-5236-4049-88dd-441c9b295061 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:23.182696 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb0764-5236-4049-88dd-441c9b295061 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:23.184190 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb0764-5236-4049-88dd-441c9b295061 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:23.197927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-40eb0764-5236-4049-88dd-441c9b295061 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:47:23.197927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:23.197927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:23.197927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:23.197927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:23.197927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:23.197927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:23.197927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:23.197927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:23.197927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:23.197927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:23.197927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:23.197927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:47:23.197927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:47:23.197927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:23.198951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:23.200193 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:47:23.200193 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:47:23.200193 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:47:23.200193 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:47:23.200193 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:47:23.200193 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:47:23.200193 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:47:23.200193 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:23.200193 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 609/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:47:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:23.205502 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91967418-d0e0-47a5-8cc4-e87e7ffbe442 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:23.306308 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91967418-d0e0-47a5-8cc4-e87e7ffbe442 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:23.339629 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924e614-57c0-40bb-a5b7-7a2ea958054d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:23.340287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924e614-57c0-40bb-a5b7-7a2ea958054d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:23.340573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924e614-57c0-40bb-a5b7-7a2ea958054d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:23.340853 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924e614-57c0-40bb-a5b7-7a2ea958054d None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:23.341669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924e614-57c0-40bb-a5b7-7a2ea958054d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:23.341984 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924e614-57c0-40bb-a5b7-7a2ea958054d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:23.344079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924e614-57c0-40bb-a5b7-7a2ea958054d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:23.355631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 622/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:47:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:23.361643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb0764-5236-4049-88dd-441c9b295061 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:23.425336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:23.458515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb0764-5236-4049-88dd-441c9b295061 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:23.490243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba0547-1209-4300-ab78-8605a6183c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:23.491123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba0547-1209-4300-ab78-8605a6183c0e None admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:23.491410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba0547-1209-4300-ab78-8605a6183c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:23.491687 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba0547-1209-4300-ab78-8605a6183c0e None admin] PATH_INFO: `/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/534035b2e8cf4f769e3dbbaabc0f6ee7/roles/037df45eceeb4cb7aec314c290fa7820` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:23.505380 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba0547-1209-4300-ab78-8605a6183c0e None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9e5996685142bb94c83c5403fbf17d, user_id=534035b2e8cf4f769e3dbbaabc0f6ee7, role_id=037df45eceeb4cb7aec314c290fa7820)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:23.506813 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba0547-1209-4300-ab78-8605a6183c0e None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:23.579230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 610/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:47:23 2022] PUT /identity/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/534035b2e8cf4f769e3dbbaabc0f6ee7/roles/037df45eceeb4cb7aec314c290fa7820 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:47:25.681943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a5a4c-24da-472b-80c2-562723590eab None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:25.682469 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a5a4c-24da-472b-80c2-562723590eab None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:25.682607 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a5a4c-24da-472b-80c2-562723590eab None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:25.683860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 623/1233] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:25.689606 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce5f63-b228-4d8e-9bf0-ef8d3b8fd05f None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:25.690023 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce5f63-b228-4d8e-9bf0-ef8d3b8fd05f None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:25.690177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce5f63-b228-4d8e-9bf0-ef8d3b8fd05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:25.706037 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-29ce5f63-b228-4d8e-9bf0-ef8d3b8fd05f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:25.707229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-29ce5f63-b228-4d8e-9bf0-ef8d3b8fd05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:25.773024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 611/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:47:25.797578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a5a4c-24da-472b-80c2-562723590eab None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:25.822525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:25.896474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a5a4c-24da-472b-80c2-562723590eab None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:25.930539 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77166ba-6cf9-4d6d-8427-219d9b70f28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:25.931315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77166ba-6cf9-4d6d-8427-219d9b70f28e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:25.931597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77166ba-6cf9-4d6d-8427-219d9b70f28e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:25.931873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77166ba-6cf9-4d6d-8427-219d9b70f28e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:25.941682 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77166ba-6cf9-4d6d-8427-219d9b70f28e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:47:25.949455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-e77166ba-6cf9-4d6d-8427-219d9b70f28e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:47:25.949455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:25.949455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:25.949455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:25.949455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:25.949455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:25.949455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:25.949455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:25.949455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:25.949455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:25.949455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:25.949455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:25.949455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:47:25.949455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:47:25.949455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:47:25.949455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:47:25.950543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:47:25.950543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:47:25.950543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:47:25.950543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:47:25.950543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:25.950543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:25.950543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:25.950543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:25.950543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:25.950543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:25.950543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:25.950543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:25.950543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:25.950543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:25.950543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:25.950543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:25.951575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:25.951575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:25.951575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:25.951575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:25.951575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:47:25.951575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:47:25.951575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:47:25.951575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:47:25.951575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:47:25.951575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:47:25.951575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 14:47:25.951575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:47:25.951575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 624/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Thu Jun 16 14:47:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:25.956848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce5f63-b228-4d8e-9bf0-ef8d3b8fd05f None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:26.002718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:26.054888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce5f63-b228-4d8e-9bf0-ef8d3b8fd05f None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:26.087658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63010ee-6b2b-48ff-9b2e-07860cc2084a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:26.090823 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63010ee-6b2b-48ff-9b2e-07860cc2084a None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:26.090823 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63010ee-6b2b-48ff-9b2e-07860cc2084a None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:26.090823 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63010ee-6b2b-48ff-9b2e-07860cc2084a None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:26.090823 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63010ee-6b2b-48ff-9b2e-07860cc2084a None admin] RBAC: Adding query filter params (name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:26.090823 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63010ee-6b2b-48ff-9b2e-07860cc2084a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:26.091349 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63010ee-6b2b-48ff-9b2e-07860cc2084a None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:26.100014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 612/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Thu Jun 16 14:47:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:26.105750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77166ba-6cf9-4d6d-8427-219d9b70f28e None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:26.189460 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:26.204813 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77166ba-6cf9-4d6d-8427-219d9b70f28e None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:26.236818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd7663-b97b-4962-b012-4cbd85098738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:26.237642 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd7663-b97b-4962-b012-4cbd85098738 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:26.237932 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd7663-b97b-4962-b012-4cbd85098738 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:26.238212 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd7663-b97b-4962-b012-4cbd85098738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:26.248351 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd7663-b97b-4962-b012-4cbd85098738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:26.249829 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd7663-b97b-4962-b012-4cbd85098738 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:26.266962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-ffcd7663-b97b-4962-b012-4cbd85098738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:26.266962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:26.266962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:26.266962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:26.266962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:26.266962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:26.266962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:26.266962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:26.266962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:26.266962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:26.266962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:26.266962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:26.266962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:47:26.266962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:47:26.266962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:26.267970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:26.273659 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:47:26.273659 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:47:26.273659 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:26.273659 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:47:26.273659 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 625/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:26.274171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63010ee-6b2b-48ff-9b2e-07860cc2084a None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:26.383591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63010ee-6b2b-48ff-9b2e-07860cc2084a None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:26.395325 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:26.420417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69138757-131a-4cbf-879a-b8d85a4a0fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:26.421076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69138757-131a-4cbf-879a-b8d85a4a0fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:26.421384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69138757-131a-4cbf-879a-b8d85a4a0fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:26.421697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69138757-131a-4cbf-879a-b8d85a4a0fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:26.422405 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69138757-131a-4cbf-879a-b8d85a4a0fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:26.427772 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69138757-131a-4cbf-879a-b8d85a4a0fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:26.427772 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69138757-131a-4cbf-879a-b8d85a4a0fc2 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:26.435248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 613/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 14:47:26.440903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd7663-b97b-4962-b012-4cbd85098738 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:26.540573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd7663-b97b-4962-b012-4cbd85098738 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:26.573706 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c371b99-be63-40d7-afb6-06ffe8fd314e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:26.574502 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c371b99-be63-40d7-afb6-06ffe8fd314e None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:26.574787 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c371b99-be63-40d7-afb6-06ffe8fd314e None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:26.575065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c371b99-be63-40d7-afb6-06ffe8fd314e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:26.578421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:26.583230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c371b99-be63-40d7-afb6-06ffe8fd314e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:26.584715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c371b99-be63-40d7-afb6-06ffe8fd314e None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:26.598644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-4c371b99-be63-40d7-afb6-06ffe8fd314e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:47:26.598644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:26.598644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:26.598644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:26.598644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:26.598644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:26.598644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:26.598644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:26.598644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:26.598644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:26.598644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:26.598644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:26.598644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:47:26.598644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:47:26.598644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:47:26.598644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:26.599728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:26.600802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:26.600802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:26.600802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:47:26.600802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:47:26.600802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:47:26.600802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:47:26.600802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:47:26.600802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:47:26.600802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:47:26.600802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:47:26.600802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 626/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:26.605894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69138757-131a-4cbf-879a-b8d85a4a0fc2 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:26.707137 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69138757-131a-4cbf-879a-b8d85a4a0fc2 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:26.740768 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fd08a-f45e-4dc6-b8da-ac9c8d19eba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:26.741486 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd08a-f45e-4dc6-b8da-ac9c8d19eba7 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:26.741821 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd08a-f45e-4dc6-b8da-ac9c8d19eba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:26.742108 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd08a-f45e-4dc6-b8da-ac9c8d19eba7 None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:26.742948 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fd08a-f45e-4dc6-b8da-ac9c8d19eba7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:26.743265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fd08a-f45e-4dc6-b8da-ac9c8d19eba7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:26.744698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fd08a-f45e-4dc6-b8da-ac9c8d19eba7 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:26.762254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 614/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jun 16 14:47:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:26.768771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c371b99-be63-40d7-afb6-06ffe8fd314e None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:26.866874 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c371b99-be63-40d7-afb6-06ffe8fd314e None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:26.899852 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db74233-4ca7-4daa-b265-59b84091a21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:26.902018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db74233-4ca7-4daa-b265-59b84091a21d None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:26.902018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db74233-4ca7-4daa-b265-59b84091a21d None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:26.902018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db74233-4ca7-4daa-b265-59b84091a21d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:26.960564 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:26.966964 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db74233-4ca7-4daa-b265-59b84091a21d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:26.968412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db74233-4ca7-4daa-b265-59b84091a21d None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:27.069020 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 627/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:47:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:47:27.074808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fd08a-f45e-4dc6-b8da-ac9c8d19eba7 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:27.101011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:27.173584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fd08a-f45e-4dc6-b8da-ac9c8d19eba7 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:27.206710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671826b-dd85-4280-af88-af7402e3a052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:27.207409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671826b-dd85-4280-af88-af7402e3a052 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:27.209537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671826b-dd85-4280-af88-af7402e3a052 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:27.209537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671826b-dd85-4280-af88-af7402e3a052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:27.217922 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671826b-dd85-4280-af88-af7402e3a052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:27.219389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671826b-dd85-4280-af88-af7402e3a052 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:27.237171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-e671826b-dd85-4280-af88-af7402e3a052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:27.237171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:27.237171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:27.237171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:27.237171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:27.237171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:27.237171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:27.237171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:27.237171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:27.237171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:27.237171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:27.237171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:27.237171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:47:27.237171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:47:27.237171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:27.238216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:27.239179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:47:27.239179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:47:27.239179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:27.239179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:27.239179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 615/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:27.244092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db74233-4ca7-4daa-b265-59b84091a21d None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:27.345232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:27.350876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db74233-4ca7-4daa-b265-59b84091a21d None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:27.383761 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4764fa4-ccb3-4308-954d-fa695da2902f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:27.384418 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4764fa4-ccb3-4308-954d-fa695da2902f None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:27.384706 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4764fa4-ccb3-4308-954d-fa695da2902f None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:27.384982 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4764fa4-ccb3-4308-954d-fa695da2902f None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:27.385733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4764fa4-ccb3-4308-954d-fa695da2902f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:27.386069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4764fa4-ccb3-4308-954d-fa695da2902f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:27.387431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4764fa4-ccb3-4308-954d-fa695da2902f None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:27.398142 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 628/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:27.403792 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671826b-dd85-4280-af88-af7402e3a052 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:27.480448 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:27.501156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671826b-dd85-4280-af88-af7402e3a052 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:27.533565 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fecde6-506f-4517-b5a4-055ef00d2c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:27.534347 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fecde6-506f-4517-b5a4-055ef00d2c02 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:27.534631 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fecde6-506f-4517-b5a4-055ef00d2c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:27.534909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fecde6-506f-4517-b5a4-055ef00d2c02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:27.541456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fecde6-506f-4517-b5a4-055ef00d2c02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:27.542896 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fecde6-506f-4517-b5a4-055ef00d2c02 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:27.557424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-d7fecde6-506f-4517-b5a4-055ef00d2c02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:47:27.557424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:27.557424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:27.557424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:27.557424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:27.557424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:27.557424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:27.557424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:27.557424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:27.557424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:27.557424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:27.557424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:27.557424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:47:27.557424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:47:27.557424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:27.558489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:27.559588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:47:27.559588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:47:27.559588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:47:27.559588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:47:27.559588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:47:27.559588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:47:27.559588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:47:27.559588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:27.559588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 616/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:27.564463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4764fa4-ccb3-4308-954d-fa695da2902f None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:27.662357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4764fa4-ccb3-4308-954d-fa695da2902f None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:27.702398 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e85cb-6461-4aef-9d02-d9292e854793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:27.703759 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e85cb-6461-4aef-9d02-d9292e854793 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:27.704042 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e85cb-6461-4aef-9d02-d9292e854793 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:27.704314 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e85cb-6461-4aef-9d02-d9292e854793 None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:27.705091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e85cb-6461-4aef-9d02-d9292e854793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:27.705444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e85cb-6461-4aef-9d02-d9292e854793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:27.706923 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e85cb-6461-4aef-9d02-d9292e854793 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:27.720060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 629/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:47:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:27.726216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fecde6-506f-4517-b5a4-055ef00d2c02 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:27.824856 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fecde6-506f-4517-b5a4-055ef00d2c02 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:27.857435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bd3d7-aeda-47cb-901e-0ebf81133b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:27.858081 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bd3d7-aeda-47cb-901e-0ebf81133b20 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:27.858363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bd3d7-aeda-47cb-901e-0ebf81133b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:27.858642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bd3d7-aeda-47cb-901e-0ebf81133b20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:27.859452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8bd3d7-aeda-47cb-901e-0ebf81133b20 None admin] RBAC: Adding query filter params (role.id=037df45eceeb4cb7aec314c290fa7820, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=534035b2e8cf4f769e3dbbaabc0f6ee7) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:27.859761 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8bd3d7-aeda-47cb-901e-0ebf81133b20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:27.861192 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8bd3d7-aeda-47cb-901e-0ebf81133b20 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:27.866924 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 617/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:47:27 2022] GET /identity/v3/role_assignments?user.id=534035b2e8cf4f769e3dbbaabc0f6ee7&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=037df45eceeb4cb7aec314c290fa7820 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:30.233008 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247001c-8cb1-4b08-bb22-d24d62bac167 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:30.233570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247001c-8cb1-4b08-bb22-d24d62bac167 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:30.233570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247001c-8cb1-4b08-bb22-d24d62bac167 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:30.234892 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 630/1247] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:30.240003 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af739b-5a46-4399-a910-3489a86fbc0f None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:30.240399 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af739b-5a46-4399-a910-3489a86fbc0f None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:30.240562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af739b-5a46-4399-a910-3489a86fbc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:30.245692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:30.257625 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-44af739b-5a46-4399-a910-3489a86fbc0f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:30.258886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-44af739b-5a46-4399-a910-3489a86fbc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:30.324462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 618/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:47:30.348411 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247001c-8cb1-4b08-bb22-d24d62bac167 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:30.366898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:30.447743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247001c-8cb1-4b08-bb22-d24d62bac167 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:30.480954 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6502b-7717-4df8-aaca-2cede6e8998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:30.481804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6502b-7717-4df8-aaca-2cede6e8998c None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:30.482077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6502b-7717-4df8-aaca-2cede6e8998c None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:30.482348 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6502b-7717-4df8-aaca-2cede6e8998c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:30.492606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6502b-7717-4df8-aaca-2cede6e8998c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:47:30.500760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-3cc6502b-7717-4df8-aaca-2cede6e8998c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:47:30.500760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:30.500760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:30.500760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:30.500760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:30.500760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:30.500760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:30.500760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:30.500760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:30.500760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:30.500760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:30.500760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:30.500760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:47:30.500760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:47:30.500760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:47:30.500760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:47:30.501907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:47:30.501907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:47:30.501907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:47:30.501907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:47:30.501907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:30.501907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:30.501907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:30.501907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:30.501907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:30.501907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:30.501907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:30.501907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:30.501907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:30.501907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:30.501907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:30.501907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:30.503093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:30.503093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:30.503093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:30.503093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:30.503093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:47:30.503093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:47:30.503093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:47:30.503093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:47:30.503093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:47:30.503093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:47:30.503093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:47:30.503093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:47:30.503093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 631/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:47:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:30.507989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af739b-5a46-4399-a910-3489a86fbc0f None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:30.606317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af739b-5a46-4399-a910-3489a86fbc0f None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:30.635161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:30.639882 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904926d-d161-4150-b859-2443cdbfc30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:30.641174 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904926d-d161-4150-b859-2443cdbfc30e None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:30.641466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904926d-d161-4150-b859-2443cdbfc30e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:30.641743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904926d-d161-4150-b859-2443cdbfc30e None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:30.642485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904926d-d161-4150-b859-2443cdbfc30e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:30.642795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904926d-d161-4150-b859-2443cdbfc30e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:30.644161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904926d-d161-4150-b859-2443cdbfc30e None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:30.651932 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 619/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:47:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:30.657842 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6502b-7717-4df8-aaca-2cede6e8998c None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:30.735858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:30.758614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6502b-7717-4df8-aaca-2cede6e8998c None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:30.790985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14b1de-6db2-4ad7-a134-2aeff32c2446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:30.791917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14b1de-6db2-4ad7-a134-2aeff32c2446 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:30.792199 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14b1de-6db2-4ad7-a134-2aeff32c2446 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:30.792473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14b1de-6db2-4ad7-a134-2aeff32c2446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:30.803733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14b1de-6db2-4ad7-a134-2aeff32c2446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:30.805213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14b1de-6db2-4ad7-a134-2aeff32c2446 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:30.823237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-bf14b1de-6db2-4ad7-a134-2aeff32c2446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:30.823237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:30.823237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:30.823237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:30.823237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:30.823237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:30.823237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:30.823237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:30.823237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:30.823237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:30.823237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:30.823237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:30.823237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:47:30.823237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:47:30.823237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:30.824232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:30.825742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:47:30.825742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:47:30.825742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:30.825742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:47:30.829308 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 632/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:30.830631 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904926d-d161-4150-b859-2443cdbfc30e None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:30.931641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904926d-d161-4150-b859-2443cdbfc30e None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:30.966778 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0147e3c-1a47-40d9-badb-8044e22127d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:30.967495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147e3c-1a47-40d9-badb-8044e22127d0 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:30.967790 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147e3c-1a47-40d9-badb-8044e22127d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:30.968071 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147e3c-1a47-40d9-badb-8044e22127d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:30.968825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0147e3c-1a47-40d9-badb-8044e22127d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:30.969159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0147e3c-1a47-40d9-badb-8044e22127d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:30.970552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0147e3c-1a47-40d9-badb-8044e22127d0 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:30.982651 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 620/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:30.988822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14b1de-6db2-4ad7-a134-2aeff32c2446 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:31.097078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14b1de-6db2-4ad7-a134-2aeff32c2446 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:31.123666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:31.131310 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c28987-2934-4842-9e8c-8763a17b62d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:31.132121 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c28987-2934-4842-9e8c-8763a17b62d8 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:31.132409 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c28987-2934-4842-9e8c-8763a17b62d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:31.132717 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c28987-2934-4842-9e8c-8763a17b62d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:31.140188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c28987-2934-4842-9e8c-8763a17b62d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:31.141696 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c28987-2934-4842-9e8c-8763a17b62d8 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:31.155867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-33c28987-2934-4842-9e8c-8763a17b62d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:47:31.155867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:31.155867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:31.155867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:31.155867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:31.155867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:31.155867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:31.155867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:31.155867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:31.155867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:31.155867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:31.155867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:31.155867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:47:31.155867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:47:31.155867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:47:31.155867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:31.157541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:31.158716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:31.158716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:31.158716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:47:31.158716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:47:31.158716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:47:31.158716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:47:31.158716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:47:31.158716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:47:31.158716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:47:31.158716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:47:31.158716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 633/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:31.163613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0147e3c-1a47-40d9-badb-8044e22127d0 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:31.218164 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:31.270311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0147e3c-1a47-40d9-badb-8044e22127d0 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:31.311156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da77d01-a3eb-4f03-b739-784b7dec113e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:31.311824 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da77d01-a3eb-4f03-b739-784b7dec113e None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:31.312113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da77d01-a3eb-4f03-b739-784b7dec113e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:31.312397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da77d01-a3eb-4f03-b739-784b7dec113e None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:31.313323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da77d01-a3eb-4f03-b739-784b7dec113e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:31.313641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da77d01-a3eb-4f03-b739-784b7dec113e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:31.315065 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da77d01-a3eb-4f03-b739-784b7dec113e None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:31.331822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 621/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jun 16 14:47:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:31.337570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c28987-2934-4842-9e8c-8763a17b62d8 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:31.435604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c28987-2934-4842-9e8c-8763a17b62d8 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:31.467766 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb2b53-d9b9-4b34-ac5e-1039a2338ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:31.468406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb2b53-d9b9-4b34-ac5e-1039a2338ddd None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:31.468743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb2b53-d9b9-4b34-ac5e-1039a2338ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:31.469559 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb2b53-d9b9-4b34-ac5e-1039a2338ddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:31.522230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:31.534523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb2b53-d9b9-4b34-ac5e-1039a2338ddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:31.535992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb2b53-d9b9-4b34-ac5e-1039a2338ddd None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:31.639094 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 634/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:47:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 14:47:31.643525 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da77d01-a3eb-4f03-b739-784b7dec113e None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:31.740170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da77d01-a3eb-4f03-b739-784b7dec113e None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:31.752471 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:31.772925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a599bd-6280-458b-88a4-805f496fb8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:31.773722 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a599bd-6280-458b-88a4-805f496fb8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:31.774006 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a599bd-6280-458b-88a4-805f496fb8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:31.774284 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a599bd-6280-458b-88a4-805f496fb8b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:31.784615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a599bd-6280-458b-88a4-805f496fb8b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:31.786079 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a599bd-6280-458b-88a4-805f496fb8b7 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:31.802888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-c3a599bd-6280-458b-88a4-805f496fb8b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:31.802888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:31.802888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:31.802888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:31.802888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:31.802888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:31.802888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:31.802888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:31.802888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:31.802888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:31.802888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:31.802888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:31.802888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:47:31.802888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:47:31.802888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:31.808226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:31.809458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:47:31.809458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:47:31.809458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:31.809458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:31.809458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 622/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:31.810117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb2b53-d9b9-4b34-ac5e-1039a2338ddd None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:31.897022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:31.908842 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb2b53-d9b9-4b34-ac5e-1039a2338ddd None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:31.942507 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61942af1-436d-429f-a248-eb78b46a14f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:31.945116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61942af1-436d-429f-a248-eb78b46a14f3 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:31.945116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61942af1-436d-429f-a248-eb78b46a14f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:31.945116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61942af1-436d-429f-a248-eb78b46a14f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:31.945116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61942af1-436d-429f-a248-eb78b46a14f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:31.945116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61942af1-436d-429f-a248-eb78b46a14f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:31.946078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61942af1-436d-429f-a248-eb78b46a14f3 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:31.957560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 635/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:31.963333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a599bd-6280-458b-88a4-805f496fb8b7 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:32.060859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a599bd-6280-458b-88a4-805f496fb8b7 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:32.093067 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964fa75-837f-41ed-9bcf-504332f60054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:32.094411 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964fa75-837f-41ed-9bcf-504332f60054 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:32.094714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964fa75-837f-41ed-9bcf-504332f60054 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:32.094980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964fa75-837f-41ed-9bcf-504332f60054 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:32.101500 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964fa75-837f-41ed-9bcf-504332f60054 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:32.102931 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964fa75-837f-41ed-9bcf-504332f60054 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:32.116956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-1964fa75-837f-41ed-9bcf-504332f60054 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:47:32.116956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:32.116956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:32.116956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:32.116956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:32.116956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:32.116956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:32.116956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:32.116956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:32.116956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:32.116956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:32.116956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:32.116956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:47:32.116956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:47:32.116956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:32.118044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:32.119259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:47:32.119259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:47:32.119259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:47:32.119259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:47:32.119259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:47:32.119259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:47:32.119259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:47:32.119259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:32.119259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 623/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:47:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:32.124084 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61942af1-436d-429f-a248-eb78b46a14f3 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:32.223294 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61942af1-436d-429f-a248-eb78b46a14f3 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:32.255903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63fa80-6051-47e2-b803-3b2af2ceb855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:32.256556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63fa80-6051-47e2-b803-3b2af2ceb855 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:32.256845 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63fa80-6051-47e2-b803-3b2af2ceb855 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:32.257151 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63fa80-6051-47e2-b803-3b2af2ceb855 None admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:32.257946 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63fa80-6051-47e2-b803-3b2af2ceb855 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:32.258259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63fa80-6051-47e2-b803-3b2af2ceb855 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:32.259684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63fa80-6051-47e2-b803-3b2af2ceb855 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:32.271820 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 636/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:47:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:32.278035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964fa75-837f-41ed-9bcf-504332f60054 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:32.303749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:32.377044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964fa75-837f-41ed-9bcf-504332f60054 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:32.410054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816f224-df5c-4d6e-8024-f85164de3a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:32.410704 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816f224-df5c-4d6e-8024-f85164de3a2c None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:32.410988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816f224-df5c-4d6e-8024-f85164de3a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:32.411265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816f224-df5c-4d6e-8024-f85164de3a2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:32.412088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816f224-df5c-4d6e-8024-f85164de3a2c None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=534035b2e8cf4f769e3dbbaabc0f6ee7) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:32.412404 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816f224-df5c-4d6e-8024-f85164de3a2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:32.413894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816f224-df5c-4d6e-8024-f85164de3a2c None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:32.419309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 624/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:47:32 2022] GET /identity/v3/role_assignments?user.id=534035b2e8cf4f769e3dbbaabc0f6ee7&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=c865040abd6c4b099381557da21c471d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:34.516210 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9be246-e826-4a61-87ba-6a2cefe8d546 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:34.516735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9be246-e826-4a61-87ba-6a2cefe8d546 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:34.516858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9be246-e826-4a61-87ba-6a2cefe8d546 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:34.518157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 637/1261] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:34.523339 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9dbf8-1251-4592-b622-5652b1069db4 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:34.523724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9dbf8-1251-4592-b622-5652b1069db4 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:34.523904 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9dbf8-1251-4592-b622-5652b1069db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:34.540488 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-6dd9dbf8-1251-4592-b622-5652b1069db4 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:34.541705 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-6dd9dbf8-1251-4592-b622-5652b1069db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:34.606791 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 625/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:47:34.630297 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9be246-e826-4a61-87ba-6a2cefe8d546 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:34.641116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:34.728288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9be246-e826-4a61-87ba-6a2cefe8d546 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:34.762049 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368916e3-6467-428f-addc-6abc61f8fbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:34.762847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368916e3-6467-428f-addc-6abc61f8fbae None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:34.763130 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368916e3-6467-428f-addc-6abc61f8fbae None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:34.763403 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368916e3-6467-428f-addc-6abc61f8fbae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:34.773356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368916e3-6467-428f-addc-6abc61f8fbae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:47:34.780927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-368916e3-6467-428f-addc-6abc61f8fbae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:47:34.780927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:34.780927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:34.780927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:34.780927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:34.780927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:34.780927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:34.780927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:34.780927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:34.780927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:34.780927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:34.780927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:34.780927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:47:34.780927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:47:34.780927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:47:34.780927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:47:34.782480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:47:34.782480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:47:34.782480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:47:34.782480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:47:34.782480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:34.782480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:34.782480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:34.782480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:34.782480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:34.782480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:34.782480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:34.782480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:34.782480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:34.782480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:34.782480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:34.782480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:34.783331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:34.783331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:34.783331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:34.783331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:34.783331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:47:34.783331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:47:34.783331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:47:34.783331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:47:34.783331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:47:34.783331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:47:34.783331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:47:34.783331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:47:34.783331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 638/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:47:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:34.788987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9dbf8-1251-4592-b622-5652b1069db4 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:34.808323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:34.885673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9dbf8-1251-4592-b622-5652b1069db4 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:34.918308 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1157f6-2f75-49be-960d-3fd592480ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:34.921357 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1157f6-2f75-49be-960d-3fd592480ccd None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:34.921357 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1157f6-2f75-49be-960d-3fd592480ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:34.921357 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1157f6-2f75-49be-960d-3fd592480ccd None admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:34.921357 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1157f6-2f75-49be-960d-3fd592480ccd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:34.921357 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1157f6-2f75-49be-960d-3fd592480ccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:34.922017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1157f6-2f75-49be-960d-3fd592480ccd None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:34.930547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 626/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:47:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:34.936504 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368916e3-6467-428f-addc-6abc61f8fbae None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:35.003404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:35.035983 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368916e3-6467-428f-addc-6abc61f8fbae None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:35.068650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a8322-bf49-4223-a8c5-02cfa69ff94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:35.070777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a8322-bf49-4223-a8c5-02cfa69ff94b None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:35.070777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a8322-bf49-4223-a8c5-02cfa69ff94b None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:35.070777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a8322-bf49-4223-a8c5-02cfa69ff94b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:35.080232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a8322-bf49-4223-a8c5-02cfa69ff94b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:35.081770 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a8322-bf49-4223-a8c5-02cfa69ff94b None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:35.101581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-198a8322-bf49-4223-a8c5-02cfa69ff94b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:35.101581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:35.101581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:35.101581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:35.101581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:35.101581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:35.101581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:35.101581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:35.101581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:35.101581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:35.101581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:35.101581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:35.101581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:47:35.101581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:47:35.101581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:35.102714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:35.103620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:47:35.103620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:47:35.103620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:35.103620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:47:35.103620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 639/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:35.108705 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1157f6-2f75-49be-960d-3fd592480ccd None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:35.187642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:35.206995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1157f6-2f75-49be-960d-3fd592480ccd None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:35.239389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d9ac0-c3f2-4f38-bff7-c77827e8570f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:35.240056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d9ac0-c3f2-4f38-bff7-c77827e8570f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:35.240344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d9ac0-c3f2-4f38-bff7-c77827e8570f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:35.240623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d9ac0-c3f2-4f38-bff7-c77827e8570f None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:35.241370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d9ac0-c3f2-4f38-bff7-c77827e8570f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:35.241679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d9ac0-c3f2-4f38-bff7-c77827e8570f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:35.243059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d9ac0-c3f2-4f38-bff7-c77827e8570f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:35.254266 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 627/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:35.260034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a8322-bf49-4223-a8c5-02cfa69ff94b None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:35.364639 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a8322-bf49-4223-a8c5-02cfa69ff94b None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:35.383714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:35.397583 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3804d-eaec-4c48-8c5c-c3714465886b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:35.398381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3804d-eaec-4c48-8c5c-c3714465886b None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:35.398669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3804d-eaec-4c48-8c5c-c3714465886b None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:35.398948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3804d-eaec-4c48-8c5c-c3714465886b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:35.406122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3804d-eaec-4c48-8c5c-c3714465886b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:35.409344 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3804d-eaec-4c48-8c5c-c3714465886b None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:35.422185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-91a3804d-eaec-4c48-8c5c-c3714465886b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:47:35.422185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:35.422185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:35.422185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:35.422185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:35.422185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:35.422185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:35.422185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:35.422185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:35.422185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:35.422185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:35.422185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:35.422185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:47:35.422185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:47:35.422185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:47:35.422185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:35.423113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:35.424240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:35.424240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:35.424240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:47:35.424240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:47:35.424240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:47:35.424240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:47:35.424240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:47:35.424240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:47:35.424240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:47:35.424240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:47:35.424240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 640/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:35.429216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d9ac0-c3f2-4f38-bff7-c77827e8570f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:35.529576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d9ac0-c3f2-4f38-bff7-c77827e8570f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:35.564013 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793cf49-6e13-44c5-9e4e-483e57857e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:35.564675 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793cf49-6e13-44c5-9e4e-483e57857e0e None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:35.564960 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793cf49-6e13-44c5-9e4e-483e57857e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:35.565588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793cf49-6e13-44c5-9e4e-483e57857e0e None admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:35.566453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793cf49-6e13-44c5-9e4e-483e57857e0e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:35.566761 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793cf49-6e13-44c5-9e4e-483e57857e0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:35.568301 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793cf49-6e13-44c5-9e4e-483e57857e0e None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:35.576649 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:35.587650 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 628/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jun 16 14:47:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:35.593497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3804d-eaec-4c48-8c5c-c3714465886b None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:35.713664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3804d-eaec-4c48-8c5c-c3714465886b None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:35.746560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087f5bd-c534-4c9f-8894-47b74b9ba524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:35.747341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087f5bd-c534-4c9f-8894-47b74b9ba524 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:35.747621 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087f5bd-c534-4c9f-8894-47b74b9ba524 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:35.747893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087f5bd-c534-4c9f-8894-47b74b9ba524 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:35.758159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087f5bd-c534-4c9f-8894-47b74b9ba524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:35.759616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087f5bd-c534-4c9f-8894-47b74b9ba524 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:35.776069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-7087f5bd-c534-4c9f-8894-47b74b9ba524 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:35.776069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:35.776069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:35.776069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:35.776069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:35.776069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:35.776069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:35.776069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:35.776069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:35.776069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:35.776069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:35.776069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:35.776069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:47:35.776069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:47:35.776069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:35.777110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:35.778321 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:47:35.778321 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:47:35.778321 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:35.778321 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:47:35.778321 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 641/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:35.783566 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793cf49-6e13-44c5-9e4e-483e57857e0e None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:35.881673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793cf49-6e13-44c5-9e4e-483e57857e0e None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:35.914198 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb4ec0-7bab-46cc-baec-1fe337848b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:35.914844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb4ec0-7bab-46cc-baec-1fe337848b97 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:35.915126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb4ec0-7bab-46cc-baec-1fe337848b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:35.915402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb4ec0-7bab-46cc-baec-1fe337848b97 None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:35.916149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb4ec0-7bab-46cc-baec-1fe337848b97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:35.916453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb4ec0-7bab-46cc-baec-1fe337848b97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:35.917832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb4ec0-7bab-46cc-baec-1fe337848b97 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:35.929562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 629/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:35.935632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087f5bd-c534-4c9f-8894-47b74b9ba524 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:35.967760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:36.041501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087f5bd-c534-4c9f-8894-47b74b9ba524 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:36.075733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bd213-266c-412c-978d-0e307835b172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:36.076616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bd213-266c-412c-978d-0e307835b172 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:36.076907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bd213-266c-412c-978d-0e307835b172 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:36.077212 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bd213-266c-412c-978d-0e307835b172 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:36.083794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bd213-266c-412c-978d-0e307835b172 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:36.086312 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bd213-266c-412c-978d-0e307835b172 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:36.099126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-941bd213-266c-412c-978d-0e307835b172 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:47:36.099126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:36.099126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:36.099126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:36.099126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:36.099126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:36.099126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:36.099126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:36.099126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:36.099126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:36.099126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:36.099126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:36.099126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:47:36.099126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:47:36.099126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:36.100145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:36.101283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:47:36.101283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:47:36.101283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:47:36.101283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:47:36.101283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:47:36.101283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:47:36.101283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:47:36.101283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:47:36.101283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 642/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:47:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:36.106262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb4ec0-7bab-46cc-baec-1fe337848b97 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:36.162770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:36.204370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb4ec0-7bab-46cc-baec-1fe337848b97 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:36.237885 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac1a6c-9fb9-427a-8020-4a05535b4348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:36.238478 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac1a6c-9fb9-427a-8020-4a05535b4348 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:36.238769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac1a6c-9fb9-427a-8020-4a05535b4348 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:36.239051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac1a6c-9fb9-427a-8020-4a05535b4348 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:36.239832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac1a6c-9fb9-427a-8020-4a05535b4348 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:36.240148 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac1a6c-9fb9-427a-8020-4a05535b4348 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:36.241659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac1a6c-9fb9-427a-8020-4a05535b4348 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:36.253894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 630/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:47:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:36.260062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bd213-266c-412c-978d-0e307835b172 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:36.354296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:36.363301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bd213-266c-412c-978d-0e307835b172 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:36.395958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f17f9-12a0-4bd0-aace-0ed42853ed64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:36.396842 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f17f9-12a0-4bd0-aace-0ed42853ed64 None admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:36.397153 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f17f9-12a0-4bd0-aace-0ed42853ed64 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:36.397440 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f17f9-12a0-4bd0-aace-0ed42853ed64 None admin] PATH_INFO: `/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/534035b2e8cf4f769e3dbbaabc0f6ee7/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:36.399385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f17f9-12a0-4bd0-aace-0ed42853ed64 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec9e5996685142bb94c83c5403fbf17d, user_id=534035b2e8cf4f769e3dbbaabc0f6ee7, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:36.400820 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f17f9-12a0-4bd0-aace-0ed42853ed64 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:36.581105 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 643/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Thu Jun 16 14:47:36 2022] PUT /identity/v3/projects/ec9e5996685142bb94c83c5403fbf17d/users/534035b2e8cf4f769e3dbbaabc0f6ee7/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:47:38.685702 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d4db7-482c-4431-bb37-35e954761df2 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:38.686268 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d4db7-482c-4431-bb37-35e954761df2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:38.686268 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d4db7-482c-4431-bb37-35e954761df2 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:38.687627 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 631/1274] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:38.692916 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f8e0f-b594-410d-820f-06096c043858 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:38.693425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f8e0f-b594-410d-820f-06096c043858 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:38.693528 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f8e0f-b594-410d-820f-06096c043858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:38.709442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-366f8e0f-b594-410d-820f-06096c043858 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:38.710660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-366f8e0f-b594-410d-820f-06096c043858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:38.776352 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 644/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:47:38.801809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d4db7-482c-4431-bb37-35e954761df2 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:38.903673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d4db7-482c-4431-bb37-35e954761df2 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:38.922096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:38.939433 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dce01-b98f-4b38-ac75-a53bda2706a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:38.940162 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dce01-b98f-4b38-ac75-a53bda2706a0 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:38.940450 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dce01-b98f-4b38-ac75-a53bda2706a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:38.940727 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dce01-b98f-4b38-ac75-a53bda2706a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:38.950896 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dce01-b98f-4b38-ac75-a53bda2706a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 14:47:38.959598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-9c6dce01-b98f-4b38-ac75-a53bda2706a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:47:38.959598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:38.959598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:38.959598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:38.959598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:38.959598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:38.959598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:38.959598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:38.959598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:38.959598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:38.959598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:38.959598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:38.959598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 14:47:38.959598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 14:47:38.959598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 14:47:38.959598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 14:47:38.960724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 14:47:38.960724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 14:47:38.960724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 14:47:38.960724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 14:47:38.960724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:38.960724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:38.960724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:38.960724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:38.960724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:38.960724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:38.960724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:38.960724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:38.960724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:38.960724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:38.960724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:38.960724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:38.961630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:38.961630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:38.961630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:38.961630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:38.961630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 14:47:38.961630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 14:47:38.961630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 14:47:38.961630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 14:47:38.961630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 14:47:38.961630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 14:47:38.961630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 14:47:38.961630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:38.961630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 632/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Thu Jun 16 14:47:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:38.966865 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f8e0f-b594-410d-820f-06096c043858 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:39.048705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:39.066194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f8e0f-b594-410d-820f-06096c043858 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:39.101433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe2f3a-f957-4518-95ac-c2a2f404f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:39.102143 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe2f3a-f957-4518-95ac-c2a2f404f5ec None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:39.102430 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe2f3a-f957-4518-95ac-c2a2f404f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:39.102709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe2f3a-f957-4518-95ac-c2a2f404f5ec None admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:39.103458 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe2f3a-f957-4518-95ac-c2a2f404f5ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:39.103770 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe2f3a-f957-4518-95ac-c2a2f404f5ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:39.105171 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe2f3a-f957-4518-95ac-c2a2f404f5ec None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:39.113101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 645/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Thu Jun 16 14:47:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:39.119058 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dce01-b98f-4b38-ac75-a53bda2706a0 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:39.218471 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dce01-b98f-4b38-ac75-a53bda2706a0 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:39.252247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392f2d5-dc25-42ec-852e-a7111878b459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:39.253033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392f2d5-dc25-42ec-852e-a7111878b459 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:39.253347 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392f2d5-dc25-42ec-852e-a7111878b459 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:39.253626 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392f2d5-dc25-42ec-852e-a7111878b459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:39.263801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392f2d5-dc25-42ec-852e-a7111878b459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:39.265283 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392f2d5-dc25-42ec-852e-a7111878b459 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:39.283247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-1392f2d5-dc25-42ec-852e-a7111878b459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:39.283247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:39.283247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:39.283247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:39.283247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:39.283247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:39.283247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:39.283247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:39.283247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:39.283247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:39.283247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:39.283247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:39.283247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:47:39.283247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:47:39.283247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:39.288665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:39.289796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:47:39.289796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:47:39.289796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:39.289796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:39.289796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 633/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:39.290452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe2f3a-f957-4518-95ac-c2a2f404f5ec None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:39.388699 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe2f3a-f957-4518-95ac-c2a2f404f5ec None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:39.421451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f21fe-eece-4d03-8537-a50445ec96a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:39.422109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f21fe-eece-4d03-8537-a50445ec96a4 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:39.422397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f21fe-eece-4d03-8537-a50445ec96a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:39.422672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f21fe-eece-4d03-8537-a50445ec96a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:39.423428 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f21fe-eece-4d03-8537-a50445ec96a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:39.423736 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f21fe-eece-4d03-8537-a50445ec96a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:39.425101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f21fe-eece-4d03-8537-a50445ec96a4 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:39.437237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 646/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:39.443400 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392f2d5-dc25-42ec-852e-a7111878b459 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:39.486026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:39.541259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392f2d5-dc25-42ec-852e-a7111878b459 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:39.574933 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5a2bb-26a7-4369-94cd-c84a36139117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:39.575742 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5a2bb-26a7-4369-94cd-c84a36139117 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:39.576030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5a2bb-26a7-4369-94cd-c84a36139117 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:39.576308 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5a2bb-26a7-4369-94cd-c84a36139117 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:39.584174 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5a2bb-26a7-4369-94cd-c84a36139117 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:39.585726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5a2bb-26a7-4369-94cd-c84a36139117 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:39.600333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-99a5a2bb-26a7-4369-94cd-c84a36139117 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:47:39.600333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:39.600333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:39.600333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:39.600333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:39.600333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:39.600333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:39.600333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:39.600333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:39.600333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:39.600333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:39.600333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:39.600333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 14:47:39.600333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 14:47:39.600333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 14:47:39.600333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:39.601509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:39.602542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:39.602542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:39.602542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 14:47:39.602542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 14:47:39.602542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 14:47:39.602542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 14:47:39.602542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 14:47:39.602542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 14:47:39.602542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 14:47:39.602542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:39.602542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 634/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:39.607296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f21fe-eece-4d03-8537-a50445ec96a4 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:39.611736 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:39.705030 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f21fe-eece-4d03-8537-a50445ec96a4 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:39.739279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea6492-84c7-423f-bc1b-c15c30cc00af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:39.739894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea6492-84c7-423f-bc1b-c15c30cc00af None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:39.740192 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea6492-84c7-423f-bc1b-c15c30cc00af None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:39.740450 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea6492-84c7-423f-bc1b-c15c30cc00af None admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:39.741301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea6492-84c7-423f-bc1b-c15c30cc00af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:39.741608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea6492-84c7-423f-bc1b-c15c30cc00af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:39.743120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea6492-84c7-423f-bc1b-c15c30cc00af None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:39.759894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 647/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Thu Jun 16 14:47:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:39.765712 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5a2bb-26a7-4369-94cd-c84a36139117 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:39.855073 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:39.864350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5a2bb-26a7-4369-94cd-c84a36139117 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:39.895977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880e307-49d4-4c85-b944-5e41fc046449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:39.896610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880e307-49d4-4c85-b944-5e41fc046449 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:39.896893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880e307-49d4-4c85-b944-5e41fc046449 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:39.897189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880e307-49d4-4c85-b944-5e41fc046449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:39.961964 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880e307-49d4-4c85-b944-5e41fc046449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:39.963453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880e307-49d4-4c85-b944-5e41fc046449 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:40.051771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:40.061865 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 635/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Thu Jun 16 14:47:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 14:47:40.068151 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea6492-84c7-423f-bc1b-c15c30cc00af None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:40.128254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:40.165403 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea6492-84c7-423f-bc1b-c15c30cc00af None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:40.198513 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7081e3-c480-4576-958f-c0f0c4effaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:40.199310 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7081e3-c480-4576-958f-c0f0c4effaad None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:40.199598 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7081e3-c480-4576-958f-c0f0c4effaad None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:40.199879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7081e3-c480-4576-958f-c0f0c4effaad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:40.210095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7081e3-c480-4576-958f-c0f0c4effaad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:40.211542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7081e3-c480-4576-958f-c0f0c4effaad None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:40.228657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-ed7081e3-c480-4576-958f-c0f0c4effaad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:40.228657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:40.228657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:40.228657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:40.228657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:40.228657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:40.228657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:40.228657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:40.228657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:40.228657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:40.228657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:40.228657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:40.228657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 14:47:40.228657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 14:47:40.228657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:40.238360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:40.239489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 14:47:40.239489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 14:47:40.239489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 14:47:40.239489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:47:40.239489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 648/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:40.239833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880e307-49d4-4c85-b944-5e41fc046449 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:40.332139 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880e307-49d4-4c85-b944-5e41fc046449 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:40.365580 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccbeb8-1566-4c36-a130-9aee18f24c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:40.366243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccbeb8-1566-4c36-a130-9aee18f24c1f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:40.366529 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccbeb8-1566-4c36-a130-9aee18f24c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:40.366807 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccbeb8-1566-4c36-a130-9aee18f24c1f None admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:40.367518 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccbeb8-1566-4c36-a130-9aee18f24c1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:40.367828 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccbeb8-1566-4c36-a130-9aee18f24c1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:40.369221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccbeb8-1566-4c36-a130-9aee18f24c1f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:40.380799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 636/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Thu Jun 16 14:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:40.386614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7081e3-c480-4576-958f-c0f0c4effaad None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:40.484623 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7081e3-c480-4576-958f-c0f0c4effaad None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:40.499538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:40.519105 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471f9ec-4137-4487-b069-54105589edc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:40.519890 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471f9ec-4137-4487-b069-54105589edc5 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:40.520178 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471f9ec-4137-4487-b069-54105589edc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:40.520461 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471f9ec-4137-4487-b069-54105589edc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:40.526883 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471f9ec-4137-4487-b069-54105589edc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:40.528319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471f9ec-4137-4487-b069-54105589edc5 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:40.541660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application [None req-c471f9ec-4137-4487-b069-54105589edc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:47:40.541660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:40.541660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:40.541660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:40.541660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:40.541660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:40.541660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:40.541660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:40.541660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:40.541660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:40.541660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:40.541660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:40.541660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 14:47:40.541660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 14:47:40.541660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:40.542679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:40.543801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 14:47:40.543801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 14:47:40.543801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 14:47:40.543801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 14:47:40.543801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 14:47:40.543801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 14:47:40.543801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 14:47:40.543801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: ERROR keystone.server.flask.application Jun 16 14:47:40.547840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 649/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Thu Jun 16 14:47:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:40.549392 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccbeb8-1566-4c36-a130-9aee18f24c1f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:40.598181 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:40.645792 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccbeb8-1566-4c36-a130-9aee18f24c1f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:40.677964 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868e441-cd4d-4709-819d-340fe1c63df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:40.678605 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868e441-cd4d-4709-819d-340fe1c63df5 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:40.678889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868e441-cd4d-4709-819d-340fe1c63df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:40.679162 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868e441-cd4d-4709-819d-340fe1c63df5 None admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:40.680013 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868e441-cd4d-4709-819d-340fe1c63df5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:40.680319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868e441-cd4d-4709-819d-340fe1c63df5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:40.682039 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868e441-cd4d-4709-819d-340fe1c63df5 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:40.695335 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 637/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Thu Jun 16 14:47:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:40.701665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471f9ec-4137-4487-b069-54105589edc5 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:40.802908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471f9ec-4137-4487-b069-54105589edc5 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:40.834941 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c23673-5d9b-4cdb-a66f-cc2220af7bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:40.835589 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c23673-5d9b-4cdb-a66f-cc2220af7bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:40.835878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c23673-5d9b-4cdb-a66f-cc2220af7bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:40.836155 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c23673-5d9b-4cdb-a66f-cc2220af7bd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:40.837026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c23673-5d9b-4cdb-a66f-cc2220af7bd8 None admin] RBAC: Adding query filter params (role.id=c865040abd6c4b099381557da21c471d, scope.project.id=ec9e5996685142bb94c83c5403fbf17d, user.id=534035b2e8cf4f769e3dbbaabc0f6ee7) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:40.837370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c23673-5d9b-4cdb-a66f-cc2220af7bd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:40.838793 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c23673-5d9b-4cdb-a66f-cc2220af7bd8 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:40.844473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 650/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Thu Jun 16 14:47:40 2022] GET /identity/v3/role_assignments?user.id=534035b2e8cf4f769e3dbbaabc0f6ee7&scope.project.id=ec9e5996685142bb94c83c5403fbf17d&role.id=c865040abd6c4b099381557da21c471d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:43.054869 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a40f9-97c7-4890-82f8-b0d7d359efb2 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:43.055412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a40f9-97c7-4890-82f8-b0d7d359efb2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:43.055412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a40f9-97c7-4890-82f8-b0d7d359efb2 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:43.056826 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 638/1288] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:43.062353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6b942-4264-41b2-b89f-8e667347660e None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:43.062794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6b942-4264-41b2-b89f-8e667347660e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:43.062919 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6b942-4264-41b2-b89f-8e667347660e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:43.080739 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-cac6b942-4264-41b2-b89f-8e667347660e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:43.081995 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-cac6b942-4264-41b2-b89f-8e667347660e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:43.111750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:43.148441 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 651/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:47:43.170511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a40f9-97c7-4890-82f8-b0d7d359efb2 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:43.271265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a40f9-97c7-4890-82f8-b0d7d359efb2 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:43.281487 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:43.303417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf57b2d-1880-4c65-bb00-8598671449ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:43.304212 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf57b2d-1880-4c65-bb00-8598671449ba None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:43.304503 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf57b2d-1880-4c65-bb00-8598671449ba None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:43.304785 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf57b2d-1880-4c65-bb00-8598671449ba None admin] PATH_INFO: `/v3/services/placement` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:43.305471 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf57b2d-1880-4c65-bb00-8598671449ba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:43.306837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf57b2d-1880-4c65-bb00-8598671449ba None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-4cf57b2d-1880-4c65-bb00-8598671449ba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:43.322126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:43.323480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:43.323480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:43.323480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:43.323480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:43.323480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:43.323480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:43.323480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:47:43.323480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:47:43.323480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:47:43.323480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:47:43.323480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:43.323480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:43.323480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:43.323480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:43.323480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:43.323480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:43.329419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:43.329419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:43.329419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:43.329419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:43.329419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:43.329419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:43.329419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:43.329419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:43.329419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:43.329419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:43.329419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:47:43.329419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:47:43.329419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:47:43.329419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:43.329419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 639/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 16 14:47:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:43.330846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6b942-4264-41b2-b89f-8e667347660e None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:43.440049 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6b942-4264-41b2-b89f-8e667347660e None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:43.477368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a66ec-11f4-4c28-bc35-7f1df32b1464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:43.478031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a66ec-11f4-4c28-bc35-7f1df32b1464 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:43.478344 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a66ec-11f4-4c28-bc35-7f1df32b1464 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:43.478621 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a66ec-11f4-4c28-bc35-7f1df32b1464 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:43.479326 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a66ec-11f4-4c28-bc35-7f1df32b1464 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:43.479631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a66ec-11f4-4c28-bc35-7f1df32b1464 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:43.480994 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a66ec-11f4-4c28-bc35-7f1df32b1464 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:43.485711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 652/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Jun 16 14:47:43 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:43.492000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf57b2d-1880-4c65-bb00-8598671449ba None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:43.589684 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf57b2d-1880-4c65-bb00-8598671449ba None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:43.621741 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d4a0a-b4c1-4962-8325-89cd5a1fd52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:43.622395 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d4a0a-b4c1-4962-8325-89cd5a1fd52c None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:43.622681 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d4a0a-b4c1-4962-8325-89cd5a1fd52c None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:43.622960 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d4a0a-b4c1-4962-8325-89cd5a1fd52c None admin] PATH_INFO: `/v3/services` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:43.623660 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d4a0a-b4c1-4962-8325-89cd5a1fd52c None admin] RBAC: Adding query filter params (type=placement) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:43.623986 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d4a0a-b4c1-4962-8325-89cd5a1fd52c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:43.625367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d4a0a-b4c1-4962-8325-89cd5a1fd52c None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:43.630267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 640/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Jun 16 14:47:43 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:45.747326 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc6c06-3dfe-4b5a-bf69-9ef1bb192d57 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:45.747942 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc6c06-3dfe-4b5a-bf69-9ef1bb192d57 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:45.747942 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc6c06-3dfe-4b5a-bf69-9ef1bb192d57 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:45.749275 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 653/1293] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:45.754469 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5431db9-5181-4a88-b4e2-a38e2d947ba5 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:45.754860 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5431db9-5181-4a88-b4e2-a38e2d947ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:45.755025 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5431db9-5181-4a88-b4e2-a38e2d947ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:45.772042 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-b5431db9-5181-4a88-b4e2-a38e2d947ba5 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:45.773240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b5431db9-5181-4a88-b4e2-a38e2d947ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:45.802438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:45.838100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 641/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:47:45.860751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc6c06-3dfe-4b5a-bf69-9ef1bb192d57 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:45.891775 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:45.959861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc6c06-3dfe-4b5a-bf69-9ef1bb192d57 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:45.992859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba612e3-4154-4e2e-9fac-2fa2e34308b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:45.993555 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba612e3-4154-4e2e-9fac-2fa2e34308b8 None admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:45.993842 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba612e3-4154-4e2e-9fac-2fa2e34308b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:45.994122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba612e3-4154-4e2e-9fac-2fa2e34308b8 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:45.994848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba612e3-4154-4e2e-9fac-2fa2e34308b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:45.996205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba612e3-4154-4e2e-9fac-2fa2e34308b8 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:46.165544 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 654/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Thu Jun 16 14:47:45 2022] POST /identity/v3/services => generated 246 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:47:48.321570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a0992-10a6-4ad1-9897-2c1173222baf None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:48.322083 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a0992-10a6-4ad1-9897-2c1173222baf None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:48.322083 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a0992-10a6-4ad1-9897-2c1173222baf None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:48.323513 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 642/1296] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:48.328773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade7c1d-51ed-48fc-ba61-06e155cdd724 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:48.329222 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade7c1d-51ed-48fc-ba61-06e155cdd724 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:48.329366 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade7c1d-51ed-48fc-ba61-06e155cdd724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:48.347050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-5ade7c1d-51ed-48fc-ba61-06e155cdd724 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:48.348252 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5ade7c1d-51ed-48fc-ba61-06e155cdd724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:48.424771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 655/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:47:48.449013 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a0992-10a6-4ad1-9897-2c1173222baf None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:48.553214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a0992-10a6-4ad1-9897-2c1173222baf None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:48.587199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54732e5-0d23-48e0-aaab-2b61290e875f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:48.587932 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54732e5-0d23-48e0-aaab-2b61290e875f None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:48.588215 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54732e5-0d23-48e0-aaab-2b61290e875f None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:48.588493 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54732e5-0d23-48e0-aaab-2b61290e875f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:48.589169 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54732e5-0d23-48e0-aaab-2b61290e875f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:48.590546 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54732e5-0d23-48e0-aaab-2b61290e875f None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-e54732e5-0d23-48e0-aaab-2b61290e875f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:48.602590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:48.603863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:48.603863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:48.603863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:48.603863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:48.603863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:48.603863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:48.603863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:47:48.603863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:47:48.603863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:47:48.603863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:47:48.603863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:48.603863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:48.603863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:48.603863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:48.603863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:48.603863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:48.604981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:48.604981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:48.604981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:48.604981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:48.604981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:48.604981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:48.604981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:48.604981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:48.604981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:48.604981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:48.604981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:47:48.604981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:47:48.604981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:47:48.604981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:48.604981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 643/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 16 14:47:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:48.609937 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade7c1d-51ed-48fc-ba61-06e155cdd724 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:48.628232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:48.707265 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade7c1d-51ed-48fc-ba61-06e155cdd724 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:48.741711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c00ee-cfa2-4a9c-bb9e-45135c12a1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:48.742423 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c00ee-cfa2-4a9c-bb9e-45135c12a1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:48.742655 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c00ee-cfa2-4a9c-bb9e-45135c12a1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:48.742929 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c00ee-cfa2-4a9c-bb9e-45135c12a1c1 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:48.743628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c00ee-cfa2-4a9c-bb9e-45135c12a1c1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:48.743934 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c00ee-cfa2-4a9c-bb9e-45135c12a1c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:48.745327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c00ee-cfa2-4a9c-bb9e-45135c12a1c1 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:48.750293 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 656/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Jun 16 14:47:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:48.756252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54732e5-0d23-48e0-aaab-2b61290e875f None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:48.788884 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:48.854732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54732e5-0d23-48e0-aaab-2b61290e875f None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:48.886037 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ba287-69d4-43ac-9614-f7a8cd4588d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:48.886686 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ba287-69d4-43ac-9614-f7a8cd4588d7 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:48.886970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ba287-69d4-43ac-9614-f7a8cd4588d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:48.887246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ba287-69d4-43ac-9614-f7a8cd4588d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:48.888026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ba287-69d4-43ac-9614-f7a8cd4588d7 None admin] RBAC: Adding query filter params (interface=public, service_id=3e7c6a3909614ae9a47bcc06c6820525, region_id=RegionOne) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:48.888342 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ba287-69d4-43ac-9614-f7a8cd4588d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:48.889737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ba287-69d4-43ac-9614-f7a8cd4588d7 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:48.895249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 644/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Thu Jun 16 14:47:48 2022] GET /identity/v3/endpoints?service_id=3e7c6a3909614ae9a47bcc06c6820525&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:48.901049 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c00ee-cfa2-4a9c-bb9e-45135c12a1c1 None admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:48.981039 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:48.999285 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c00ee-cfa2-4a9c-bb9e-45135c12a1c1 None admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:49.032127 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e2a07-d416-4d5a-b4d9-dff8c8855017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:49.033370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e2a07-d416-4d5a-b4d9-dff8c8855017 None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:49.033659 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e2a07-d416-4d5a-b4d9-dff8c8855017 None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:49.033937 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e2a07-d416-4d5a-b4d9-dff8c8855017 None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:49.034667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e2a07-d416-4d5a-b4d9-dff8c8855017 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:49.036071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e2a07-d416-4d5a-b4d9-dff8c8855017 None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:49.042637 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 657/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Thu Jun 16 14:47:48 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:47:51.185415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982d2a7-7f90-4466-bf5c-d08d5997a72a None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:51.186029 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982d2a7-7f90-4466-bf5c-d08d5997a72a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:51.186300 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982d2a7-7f90-4466-bf5c-d08d5997a72a None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:51.188404 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 645/1302] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:47:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:47:51.194135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fb87c-e50b-40bc-aa86-773df4c41235 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:51.194745 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fb87c-e50b-40bc-aa86-773df4c41235 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:51.194745 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fb87c-e50b-40bc-aa86-773df4c41235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:51.211196 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-576fb87c-e50b-40bc-aa86-773df4c41235 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:47:51.213102 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-576fb87c-e50b-40bc-aa86-773df4c41235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:47:51.276974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 658/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:47:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 14:47:51.300559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982d2a7-7f90-4466-bf5c-d08d5997a72a None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:51.398008 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:51.404560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982d2a7-7f90-4466-bf5c-d08d5997a72a None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:51.438536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bfbe7-e451-4bee-aa44-4a53eac04ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:51.439339 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bfbe7-e451-4bee-aa44-4a53eac04ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:51.439627 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bfbe7-e451-4bee-aa44-4a53eac04ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:51.439906 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bfbe7-e451-4bee-aa44-4a53eac04ae8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:51.440556 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bfbe7-e451-4bee-aa44-4a53eac04ae8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:51.441947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bfbe7-e451-4bee-aa44-4a53eac04ae8 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application [None req-359bfbe7-e451-4bee-aa44-4a53eac04ae8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 14:47:51.454466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 14:47:51.455690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 14:47:51.455690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 14:47:51.455690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 14:47:51.455690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 14:47:51.455690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 14:47:51.455690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 14:47:51.455690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 14:47:51.455690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 14:47:51.455690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 14:47:51.455690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 14:47:51.455690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 14:47:51.455690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 14:47:51.455690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 14:47:51.455690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 14:47:51.455690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 14:47:51.455690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 14:47:51.457560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 14:47:51.457560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application with Lock( Jun 16 14:47:51.457560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 14:47:51.457560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self._enter() Jun 16 14:47:51.457560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 14:47:51.457560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 14:47:51.457560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 14:47:51.457560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application return self.creator() Jun 16 14:47:51.457560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 14:47:51.457560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application created_value = creator( Jun 16 14:47:51.457560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 14:47:51.457560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 14:47:51.457560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 14:47:51.457560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: ERROR keystone.server.flask.application Jun 16 14:47:51.457560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 646/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Thu Jun 16 14:47:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 14:47:51.461982 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fb87c-e50b-40bc-aa86-773df4c41235 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:51.546872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:47:51.569250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fb87c-e50b-40bc-aa86-773df4c41235 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:51.601902 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7423be6-4b11-41bf-84c6-10a8b266150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:51.602568 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7423be6-4b11-41bf-84c6-10a8b266150f None admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:51.602854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7423be6-4b11-41bf-84c6-10a8b266150f None admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:51.603138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7423be6-4b11-41bf-84c6-10a8b266150f None admin] PATH_INFO: `/v3/services` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:51.603845 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7423be6-4b11-41bf-84c6-10a8b266150f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:47:51.604158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7423be6-4b11-41bf-84c6-10a8b266150f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:51.605581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7423be6-4b11-41bf-84c6-10a8b266150f None admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:51.611129 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 659/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Thu Jun 16 14:47:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:47:51.616928 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bfbe7-e451-4bee-aa44-4a53eac04ae8 None admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:47:51.713726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bfbe7-e451-4bee-aa44-4a53eac04ae8 None admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:47:51.747282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6d12e-1f55-48e9-b567-a697743305d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:47:51.747938 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d12e-1f55-48e9-b567-a697743305d4 None admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:47:51.748225 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d12e-1f55-48e9-b567-a697743305d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:47:51.748504 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6d12e-1f55-48e9-b567-a697743305d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:47:51.749264 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6d12e-1f55-48e9-b567-a697743305d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:47:51.751268 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6d12e-1f55-48e9-b567-a697743305d4 None admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:47:51.860667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 647/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Thu Jun 16 14:47:51 2022] POST /identity/v3/endpoints => generated 331 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:48:01.608244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=30 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:01.855195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:25.822976 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f13b-0170-40b3-9ed0-26be7b8ef3d9 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:25.823570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f13b-0170-40b3-9ed0-26be7b8ef3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:25.823570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f13b-0170-40b3-9ed0-26be7b8ef3d9 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:25.825366 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 660/1307] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:54:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:25.834568 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb60194-ea53-48a7-8c92-522681f62ab9 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:25.834568 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb60194-ea53-48a7-8c92-522681f62ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:25.836168 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb60194-ea53-48a7-8c92-522681f62ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:25.963751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-efb60194-ea53-48a7-8c92-522681f62ab9 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:25.965447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-efb60194-ea53-48a7-8c92-522681f62ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:26.098740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 648/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:26.151755 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e21117-e829-405b-8a27-482000454410 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:26.152672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e21117-e829-405b-8a27-482000454410 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:26.153296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e21117-e829-405b-8a27-482000454410 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:26.155413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 661/1309] 10.222.0.23 () {54 vars in 964 bytes} [Thu Jun 16 14:54:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:26.161431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9a4f5-54b7-43a6-9fa1-2189232ff856 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:26.161840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9a4f5-54b7-43a6-9fa1-2189232ff856 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:26.162224 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9a4f5-54b7-43a6-9fa1-2189232ff856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:26.256619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-e7b9a4f5-54b7-43a6-9fa1-2189232ff856 None None] MFA Rules not processed for user `db3b603ceffb43bc99684e0d2319e3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:26.258475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e7b9a4f5-54b7-43a6-9fa1-2189232ff856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:26.287182 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:26.346407 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 649/1310] 10.222.0.23 () {58 vars in 1061 bytes} [Thu Jun 16 14:54:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:26.355347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e21117-e829-405b-8a27-482000454410 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:26.357468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-89e21117-e829-405b-8a27-482000454410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:26.470596 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e21117-e829-405b-8a27-482000454410 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:26.548287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a360d-0a68-4aae-8d95-3354c8d09fba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:26.548862 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a360d-0a68-4aae-8d95-3354c8d09fba service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:26.549172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a360d-0a68-4aae-8d95-3354c8d09fba service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:26.549457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a360d-0a68-4aae-8d95-3354c8d09fba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:26.551095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-719a360d-0a68-4aae-8d95-3354c8d09fba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:26.608485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:26.665538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a360d-0a68-4aae-8d95-3354c8d09fba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:26.667181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a360d-0a68-4aae-8d95-3354c8d09fba service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:26.687659 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 662/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:54:29.224229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e031d-31bd-4ad2-a2f0-dac0aa9be923 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:29.224760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e031d-31bd-4ad2-a2f0-dac0aa9be923 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:29.224841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e031d-31bd-4ad2-a2f0-dac0aa9be923 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:29.226584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 650/1312] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:29.232736 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74175-acee-47cc-ac73-044e7caded8e None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:29.233287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74175-acee-47cc-ac73-044e7caded8e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:29.233543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74175-acee-47cc-ac73-044e7caded8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:29.330583 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-29a74175-acee-47cc-ac73-044e7caded8e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:29.331850 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-29a74175-acee-47cc-ac73-044e7caded8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:29.457465 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 663/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:29.502399 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e031d-31bd-4ad2-a2f0-dac0aa9be923 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:29.503953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-171e031d-31bd-4ad2-a2f0-dac0aa9be923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:29.621019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e031d-31bd-4ad2-a2f0-dac0aa9be923 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:29.717304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:29.720351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e8db8-4342-4cc4-a517-a22434fb5fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:29.721020 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e8db8-4342-4cc4-a517-a22434fb5fed service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:29.721337 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e8db8-4342-4cc4-a517-a22434fb5fed service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:29.721629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e8db8-4342-4cc4-a517-a22434fb5fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:29.723284 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4c3e8db8-4342-4cc4-a517-a22434fb5fed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:29.850034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e8db8-4342-4cc4-a517-a22434fb5fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:29.852106 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e8db8-4342-4cc4-a517-a22434fb5fed service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:29.873964 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 651/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:54:32.646345 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ac81c-e3b8-451e-a71d-f69e54098e83 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:32.646882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ac81c-e3b8-451e-a71d-f69e54098e83 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:32.646978 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ac81c-e3b8-451e-a71d-f69e54098e83 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:32.648853 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 664/1315] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:32.654015 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59636d61-4f95-48f9-a098-11aa89c17839 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:32.654444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59636d61-4f95-48f9-a098-11aa89c17839 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:32.654584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59636d61-4f95-48f9-a098-11aa89c17839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:32.717461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-59636d61-4f95-48f9-a098-11aa89c17839 None None] MFA Rules not processed for user `1116c623801c4ed79d916a1359b00bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:32.718987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-59636d61-4f95-48f9-a098-11aa89c17839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:32.769217 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:32.812831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 652/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:54:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:32.854317 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ac81c-e3b8-451e-a71d-f69e54098e83 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:32.855830 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-203ac81c-e3b8-451e-a71d-f69e54098e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:32.865614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:32.956100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ac81c-e3b8-451e-a71d-f69e54098e83 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:33.030631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34ddce-367b-42ee-8577-04005250821d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:33.031282 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34ddce-367b-42ee-8577-04005250821d service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:33.031566 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34ddce-367b-42ee-8577-04005250821d service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:33.031841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34ddce-367b-42ee-8577-04005250821d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:33.033503 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-1d34ddce-367b-42ee-8577-04005250821d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:33.094273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:33.139950 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34ddce-367b-42ee-8577-04005250821d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:33.141402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34ddce-367b-42ee-8577-04005250821d service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:33.161485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 665/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:54:36.136387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fff45-0caa-46a4-808a-460027001368 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:36.136893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fff45-0caa-46a4-808a-460027001368 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:36.136893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fff45-0caa-46a4-808a-460027001368 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:36.138422 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 653/1318] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:36.143645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f93157-b864-4829-9120-8340212692e5 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:36.144087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f93157-b864-4829-9120-8340212692e5 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:36.144208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f93157-b864-4829-9120-8340212692e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:36.210097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-47f93157-b864-4829-9120-8340212692e5 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:36.211858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-47f93157-b864-4829-9120-8340212692e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:36.304913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 666/1319] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:36.344081 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fff45-0caa-46a4-808a-460027001368 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:36.345690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a61fff45-0caa-46a4-808a-460027001368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:36.452338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fff45-0caa-46a4-808a-460027001368 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:36.523605 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb816184-82d0-4f24-9e9b-a402d8a63819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:36.524245 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb816184-82d0-4f24-9e9b-a402d8a63819 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:36.524529 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb816184-82d0-4f24-9e9b-a402d8a63819 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:36.524810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb816184-82d0-4f24-9e9b-a402d8a63819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:36.526481 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-cb816184-82d0-4f24-9e9b-a402d8a63819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:36.533660 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:36.632859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb816184-82d0-4f24-9e9b-a402d8a63819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:36.634329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb816184-82d0-4f24-9e9b-a402d8a63819 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:36.652191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 654/1320] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:54:39.955466 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592a228-18fe-4271-aa73-6904c524357e None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:39.956043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592a228-18fe-4271-aa73-6904c524357e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:39.956043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592a228-18fe-4271-aa73-6904c524357e None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:39.957459 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 667/1321] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:39.963435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e50b3-1a4f-4e90-89fa-6fffc13a6109 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:39.963851 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e50b3-1a4f-4e90-89fa-6fffc13a6109 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:39.964008 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e50b3-1a4f-4e90-89fa-6fffc13a6109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:40.036535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-3c0e50b3-1a4f-4e90-89fa-6fffc13a6109 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:40.037836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3c0e50b3-1a4f-4e90-89fa-6fffc13a6109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:40.096133 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:40.135454 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 655/1322] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:40.187926 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d6410-c395-40e7-9e39-435906aff9ca None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:40.188215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d6410-c395-40e7-9e39-435906aff9ca None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:40.188505 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d6410-c395-40e7-9e39-435906aff9ca None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:40.189936 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 668/1323] 10.222.0.23 () {54 vars in 964 bytes} [Thu Jun 16 14:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:40.197356 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf92e9-a1d2-42dd-8d15-7170865ac87b None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:40.197814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf92e9-a1d2-42dd-8d15-7170865ac87b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:40.198191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf92e9-a1d2-42dd-8d15-7170865ac87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:40.280714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-48cf92e9-a1d2-42dd-8d15-7170865ac87b None None] MFA Rules not processed for user `db3b603ceffb43bc99684e0d2319e3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:40.281999 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-48cf92e9-a1d2-42dd-8d15-7170865ac87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:40.364667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 656/1324] 10.222.0.23 () {58 vars in 1061 bytes} [Thu Jun 16 14:54:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:40.374163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d6410-c395-40e7-9e39-435906aff9ca None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:40.375710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-425d6410-c395-40e7-9e39-435906aff9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:40.398736 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:40.484293 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d6410-c395-40e7-9e39-435906aff9ca None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:40.556773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0a550-e557-4aa2-9f15-ba01ecd066db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:40.557454 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0a550-e557-4aa2-9f15-ba01ecd066db service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:40.557741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0a550-e557-4aa2-9f15-ba01ecd066db service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:40.558018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0a550-e557-4aa2-9f15-ba01ecd066db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:40.559634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-d9a0a550-e557-4aa2-9f15-ba01ecd066db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:40.631266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:40.668285 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0a550-e557-4aa2-9f15-ba01ecd066db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:40.669770 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0a550-e557-4aa2-9f15-ba01ecd066db service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:40.688509 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 669/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:54:43.114628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42183fe6-fdc2-4dc6-96e6-484582bc9324 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:43.115141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42183fe6-fdc2-4dc6-96e6-484582bc9324 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:43.116647 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42183fe6-fdc2-4dc6-96e6-484582bc9324 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:43.116783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 657/1326] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:54:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:43.122441 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e5452-258e-40a2-958b-964ba56d00f6 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:43.122866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e5452-258e-40a2-958b-964ba56d00f6 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:43.123006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e5452-258e-40a2-958b-964ba56d00f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:43.193972 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-d99e5452-258e-40a2-958b-964ba56d00f6 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:43.195170 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-d99e5452-258e-40a2-958b-964ba56d00f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:43.290784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 670/1327] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:43.327012 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42183fe6-fdc2-4dc6-96e6-484582bc9324 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:43.328602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-42183fe6-fdc2-4dc6-96e6-484582bc9324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:43.395687 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:43.441020 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42183fe6-fdc2-4dc6-96e6-484582bc9324 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:43.523371 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b72b84-ee10-4387-b90d-db49e73fe48a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:43.524024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b72b84-ee10-4387-b90d-db49e73fe48a service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:43.524336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b72b84-ee10-4387-b90d-db49e73fe48a service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:43.524706 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b72b84-ee10-4387-b90d-db49e73fe48a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:43.526318 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-59b72b84-ee10-4387-b90d-db49e73fe48a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:43.635784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:43.638072 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b72b84-ee10-4387-b90d-db49e73fe48a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:43.639521 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b72b84-ee10-4387-b90d-db49e73fe48a service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:43.657227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 658/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:54:45.856143 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264de6c7-8b97-4f9a-b49b-48457ea2e574 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:45.856616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264de6c7-8b97-4f9a-b49b-48457ea2e574 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:45.856714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264de6c7-8b97-4f9a-b49b-48457ea2e574 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:45.858098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 671/1329] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:45.863799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b2ed0-2a8b-4326-8e50-902f4eca0d6a None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:45.864239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b2ed0-2a8b-4326-8e50-902f4eca0d6a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:45.864450 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b2ed0-2a8b-4326-8e50-902f4eca0d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:45.942628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-197b2ed0-2a8b-4326-8e50-902f4eca0d6a None None] MFA Rules not processed for user `1116c623801c4ed79d916a1359b00bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:45.943859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-197b2ed0-2a8b-4326-8e50-902f4eca0d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:46.049336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 659/1330] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:54:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:46.088532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264de6c7-8b97-4f9a-b49b-48457ea2e574 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:46.090110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-264de6c7-8b97-4f9a-b49b-48457ea2e574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:46.121274 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:46.193896 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264de6c7-8b97-4f9a-b49b-48457ea2e574 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:46.266370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0216e-9886-46e8-89fd-f9b82ab992f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:46.267031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0216e-9886-46e8-89fd-f9b82ab992f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:46.267318 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0216e-9886-46e8-89fd-f9b82ab992f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:46.267597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0216e-9886-46e8-89fd-f9b82ab992f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:46.269269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-35a0216e-9886-46e8-89fd-f9b82ab992f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:46.346130 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:46.377256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0216e-9886-46e8-89fd-f9b82ab992f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:46.378691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0216e-9886-46e8-89fd-f9b82ab992f2 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:46.397020 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 672/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:54:49.103338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db129a-66b8-432a-8c6f-d0f2f2c1996e None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:49.104153 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db129a-66b8-432a-8c6f-d0f2f2c1996e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:49.104153 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db129a-66b8-432a-8c6f-d0f2f2c1996e None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:49.105311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 660/1332] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:49.111876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b72817-51ad-449c-ba5b-3a80845db7bb None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:49.111876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b72817-51ad-449c-ba5b-3a80845db7bb None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:49.111876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b72817-51ad-449c-ba5b-3a80845db7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:49.175620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-83b72817-51ad-449c-ba5b-3a80845db7bb None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:49.176823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-83b72817-51ad-449c-ba5b-3a80845db7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:49.270664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 673/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:49.306791 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db129a-66b8-432a-8c6f-d0f2f2c1996e None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:49.308413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c1db129a-66b8-432a-8c6f-d0f2f2c1996e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:49.375911 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:49.408640 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db129a-66b8-432a-8c6f-d0f2f2c1996e None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:49.482194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98302a58-2822-484f-b1d5-d8769261ea93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:49.482846 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98302a58-2822-484f-b1d5-d8769261ea93 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:49.483134 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98302a58-2822-484f-b1d5-d8769261ea93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:49.483413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98302a58-2822-484f-b1d5-d8769261ea93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:49.485058 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-98302a58-2822-484f-b1d5-d8769261ea93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:49.590806 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98302a58-2822-484f-b1d5-d8769261ea93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:49.592158 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98302a58-2822-484f-b1d5-d8769261ea93 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:49.601875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:49.609835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 661/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:54:51.780861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97865c70-1e3c-4968-b9da-55e604846f2b None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:51.781421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97865c70-1e3c-4968-b9da-55e604846f2b None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:51.781513 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97865c70-1e3c-4968-b9da-55e604846f2b None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:51.783115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 674/1335] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:54:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:51.788226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a281a64-8794-4ea0-902d-b4514e87f6ca None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:51.788605 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a281a64-8794-4ea0-902d-b4514e87f6ca None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:51.788795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a281a64-8794-4ea0-902d-b4514e87f6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:51.867473 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-9a281a64-8794-4ea0-902d-b4514e87f6ca None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:51.868705 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-9a281a64-8794-4ea0-902d-b4514e87f6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:51.964070 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 662/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:52.003805 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97865c70-1e3c-4968-b9da-55e604846f2b None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:52.005360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-97865c70-1e3c-4968-b9da-55e604846f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:52.045149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:52.107026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97865c70-1e3c-4968-b9da-55e604846f2b None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:52.178445 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d80139-213c-4e4d-bd0f-6746cd9054a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:52.179091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d80139-213c-4e4d-bd0f-6746cd9054a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:52.179378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d80139-213c-4e4d-bd0f-6746cd9054a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:52.179659 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d80139-213c-4e4d-bd0f-6746cd9054a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:52.181873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-35d80139-213c-4e4d-bd0f-6746cd9054a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:52.263021 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:52.287526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d80139-213c-4e4d-bd0f-6746cd9054a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:52.288944 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d80139-213c-4e4d-bd0f-6746cd9054a1 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:52.307158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 675/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:54:55.057095 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce98c2d-9bed-47e0-b2e1-87e7527d2d3e None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:55.057666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce98c2d-9bed-47e0-b2e1-87e7527d2d3e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:55.057666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce98c2d-9bed-47e0-b2e1-87e7527d2d3e None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:55.059098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 663/1338] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:54:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:54:55.064527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d5183-c0f1-4d92-aa0f-5c1f6715bd10 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:55.064926 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d5183-c0f1-4d92-aa0f-5c1f6715bd10 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:55.065089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d5183-c0f1-4d92-aa0f-5c1f6715bd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:55.130189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-5a1d5183-c0f1-4d92-aa0f-5c1f6715bd10 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:54:55.131407 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5a1d5183-c0f1-4d92-aa0f-5c1f6715bd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:55.225754 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 676/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:54:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:54:55.261913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce98c2d-9bed-47e0-b2e1-87e7527d2d3e None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:54:55.263445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-dce98c2d-9bed-47e0-b2e1-87e7527d2d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:55.340084 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:54:55.369171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce98c2d-9bed-47e0-b2e1-87e7527d2d3e None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:54:55.441834 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cedfa-3a67-41c7-bdf5-af2172639eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:54:55.442484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cedfa-3a67-41c7-bdf5-af2172639eeb service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:54:55.442780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cedfa-3a67-41c7-bdf5-af2172639eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:54:55.443072 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cedfa-3a67-41c7-bdf5-af2172639eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:54:55.444713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-1f7cedfa-3a67-41c7-bdf5-af2172639eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:54:55.550768 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cedfa-3a67-41c7-bdf5-af2172639eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:54:55.552128 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cedfa-3a67-41c7-bdf5-af2172639eeb service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:54:55.569938 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 664/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:54:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:00.331062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb39ebb-d950-4ae1-a0a3-e3bd2b614d68 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:00.331617 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb39ebb-d950-4ae1-a0a3-e3bd2b614d68 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:00.331617 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb39ebb-d950-4ae1-a0a3-e3bd2b614d68 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:00.333079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 677/1341] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:00.338997 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e6b30-a27f-4856-95d9-2a35d0bc7766 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:00.339412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e6b30-a27f-4856-95d9-2a35d0bc7766 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:00.339599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e6b30-a27f-4856-95d9-2a35d0bc7766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:00.346413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:00.412530 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-8a0e6b30-a27f-4856-95d9-2a35d0bc7766 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:00.413783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-8a0e6b30-a27f-4856-95d9-2a35d0bc7766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:00.526100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 665/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:00.570910 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb39ebb-d950-4ae1-a0a3-e3bd2b614d68 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:00.573082 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-adb39ebb-d950-4ae1-a0a3-e3bd2b614d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:00.624663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:00.671428 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb39ebb-d950-4ae1-a0a3-e3bd2b614d68 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:00.675006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36dd27-5f6e-42ed-ae09-2ca139f9de8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:00.675658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36dd27-5f6e-42ed-ae09-2ca139f9de8a service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:00.675948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36dd27-5f6e-42ed-ae09-2ca139f9de8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:00.676235 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36dd27-5f6e-42ed-ae09-2ca139f9de8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:00.685339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36dd27-5f6e-42ed-ae09-2ca139f9de8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:00.686802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36dd27-5f6e-42ed-ae09-2ca139f9de8a service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:00.696040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 678/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:03.834755 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0fad9-becf-44b5-a8a5-0d7648671b23 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:03.835339 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0fad9-becf-44b5-a8a5-0d7648671b23 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:03.835339 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0fad9-becf-44b5-a8a5-0d7648671b23 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:03.836745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 666/1344] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:55:03.843283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a9250-ec36-4f70-83b7-a3c10e444b04 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:03.843806 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a9250-ec36-4f70-83b7-a3c10e444b04 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:03.843921 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a9250-ec36-4f70-83b7-a3c10e444b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:03.871097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-c02a9250-ec36-4f70-83b7-a3c10e444b04 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:03.872319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c02a9250-ec36-4f70-83b7-a3c10e444b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:03.950629 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 679/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:03.987600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0fad9-becf-44b5-a8a5-0d7648671b23 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:03.998638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0fad9-becf-44b5-a8a5-0d7648671b23 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:04.002140 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff46ae-a24c-4c6d-b2ae-5fa101956c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:04.002782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff46ae-a24c-4c6d-b2ae-5fa101956c3c service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:04.003071 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff46ae-a24c-4c6d-b2ae-5fa101956c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:04.003355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff46ae-a24c-4c6d-b2ae-5fa101956c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:04.012788 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff46ae-a24c-4c6d-b2ae-5fa101956c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:04.014270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff46ae-a24c-4c6d-b2ae-5fa101956c3c service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:04.024024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 667/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:08.631740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa6eff-c1cb-49a2-bdaa-f12629423fa5 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:08.633506 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa6eff-c1cb-49a2-bdaa-f12629423fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:08.633506 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa6eff-c1cb-49a2-bdaa-f12629423fa5 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:08.637377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 680/1347] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:08.641422 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045f0f1-96db-4080-a874-c68288d2aa69 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:08.641911 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045f0f1-96db-4080-a874-c68288d2aa69 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:08.642014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045f0f1-96db-4080-a874-c68288d2aa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:08.661014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-4045f0f1-96db-4080-a874-c68288d2aa69 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:08.662272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4045f0f1-96db-4080-a874-c68288d2aa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:08.671105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 668/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:08.707998 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa6eff-c1cb-49a2-bdaa-f12629423fa5 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:08.720053 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa6eff-c1cb-49a2-bdaa-f12629423fa5 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:08.723748 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb25364-c8c0-4f9e-a9b1-0c47a511136c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:08.724558 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb25364-c8c0-4f9e-a9b1-0c47a511136c service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:08.724910 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb25364-c8c0-4f9e-a9b1-0c47a511136c service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:08.725299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb25364-c8c0-4f9e-a9b1-0c47a511136c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:08.735608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb25364-c8c0-4f9e-a9b1-0c47a511136c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:08.737051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb25364-c8c0-4f9e-a9b1-0c47a511136c service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:08.747485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 681/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:13.846379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d73eb-756a-436b-be56-c0e59dd772d4 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:13.846910 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d73eb-756a-436b-be56-c0e59dd772d4 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:13.847866 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d73eb-756a-436b-be56-c0e59dd772d4 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:13.849429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 669/1350] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 16 14:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:13.857982 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37e67f-3af6-438f-9f5c-085d1c5df773 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:13.858381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37e67f-3af6-438f-9f5c-085d1c5df773 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:13.858964 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37e67f-3af6-438f-9f5c-085d1c5df773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:13.932649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-bd37e67f-3af6-438f-9f5c-085d1c5df773 None None] MFA Rules not processed for user `534035b2e8cf4f769e3dbbaabc0f6ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:13.934397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-bd37e67f-3af6-438f-9f5c-085d1c5df773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:13.968824 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:14.032284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 682/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 16 14:55:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:18.212030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6635c-8b72-475a-94d0-2182a6ea22eb None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:18.213476 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6635c-8b72-475a-94d0-2182a6ea22eb None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:18.213756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6635c-8b72-475a-94d0-2182a6ea22eb None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:18.215133 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 670/1352] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 16 14:55:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:18.220563 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55886d9d-f23a-48c7-b0ce-e6fb728c88ae None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:18.221482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55886d9d-f23a-48c7-b0ce-e6fb728c88ae None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:18.222041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55886d9d-f23a-48c7-b0ce-e6fb728c88ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:18.243263 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-55886d9d-f23a-48c7-b0ce-e6fb728c88ae None None] MFA Rules not processed for user `534035b2e8cf4f769e3dbbaabc0f6ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:18.245036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-55886d9d-f23a-48c7-b0ce-e6fb728c88ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:18.254416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 683/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 16 14:55:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:18.657671 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=72 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:19.807333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94ce22-b829-4460-8486-f5a855c6205d None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:19.807968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94ce22-b829-4460-8486-f5a855c6205d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:19.807968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94ce22-b829-4460-8486-f5a855c6205d None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:19.809393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 671/1354] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 16 14:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:19.814589 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce111b4e-1d42-4a7f-b116-1c4a11fe3315 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:19.815029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce111b4e-1d42-4a7f-b116-1c4a11fe3315 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:19.815140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce111b4e-1d42-4a7f-b116-1c4a11fe3315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:19.833335 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-ce111b4e-1d42-4a7f-b116-1c4a11fe3315 None None] MFA Rules not processed for user `534035b2e8cf4f769e3dbbaabc0f6ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:19.834524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ce111b4e-1d42-4a7f-b116-1c4a11fe3315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:19.843565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 684/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 16 14:55:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:23.615795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547eedf-d53f-4c32-a09f-ce8a1d4d6826 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.616285 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547eedf-d53f-4c32-a09f-ce8a1d4d6826 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.616285 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547eedf-d53f-4c32-a09f-ce8a1d4d6826 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.619528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 672/1356] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:23.625120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27750ce2-480a-432f-8bd9-fd656b6eac1e None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.625599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27750ce2-480a-432f-8bd9-fd656b6eac1e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.625720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27750ce2-480a-432f-8bd9-fd656b6eac1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.644683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-27750ce2-480a-432f-8bd9-fd656b6eac1e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:23.645998 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-27750ce2-480a-432f-8bd9-fd656b6eac1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:23.656334 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 685/1357] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:23.707845 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e3135-98e7-4667-976b-c0a1c4060d30 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.708486 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e3135-98e7-4667-976b-c0a1c4060d30 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.708986 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e3135-98e7-4667-976b-c0a1c4060d30 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.710608 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 673/1358] 10.222.0.23 () {54 vars in 961 bytes} [Thu Jun 16 14:55:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:23.718170 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec8e6d-fb8e-4b8e-baf1-64f1a5e0d8b9 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.718713 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec8e6d-fb8e-4b8e-baf1-64f1a5e0d8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.724814 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec8e6d-fb8e-4b8e-baf1-64f1a5e0d8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.770865 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-23ec8e6d-fb8e-4b8e-baf1-64f1a5e0d8b9 None None] MFA Rules not processed for user `60c2f1c63a674e3195c490ab5ad1318f`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:23.772333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-23ec8e6d-fb8e-4b8e-baf1-64f1a5e0d8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:23.873582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 686/1359] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Jun 16 14:55:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:23.881527 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e3135-98e7-4667-976b-c0a1c4060d30 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:23.896189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e3135-98e7-4667-976b-c0a1c4060d30 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:23.902494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fdc90-85c6-4df7-9123-e4d576477ba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:23.903210 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fdc90-85c6-4df7-9123-e4d576477ba6 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:23.903566 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fdc90-85c6-4df7-9123-e4d576477ba6 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:23.903911 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fdc90-85c6-4df7-9123-e4d576477ba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:23.912774 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fdc90-85c6-4df7-9123-e4d576477ba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:23.914559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fdc90-85c6-4df7-9123-e4d576477ba6 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:23.925167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 674/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:26.327365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650f017-c23a-45da-9ce7-07568f6476fa None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:26.327950 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650f017-c23a-45da-9ce7-07568f6476fa None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:26.327950 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650f017-c23a-45da-9ce7-07568f6476fa None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:26.329393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 687/1361] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:26.334567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1515c0-9aa2-4850-8514-d7066f83e50c None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:26.335022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1515c0-9aa2-4850-8514-d7066f83e50c None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:26.335120 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1515c0-9aa2-4850-8514-d7066f83e50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:26.354277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-1f1515c0-9aa2-4850-8514-d7066f83e50c None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:26.355499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-1f1515c0-9aa2-4850-8514-d7066f83e50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:26.363555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 675/1362] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:26.408872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650f017-c23a-45da-9ce7-07568f6476fa None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:26.425510 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650f017-c23a-45da-9ce7-07568f6476fa None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:26.431148 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b444eb4-29c0-4cb3-bf49-d2ead3c2ff87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:26.431955 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b444eb4-29c0-4cb3-bf49-d2ead3c2ff87 service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:26.432337 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b444eb4-29c0-4cb3-bf49-d2ead3c2ff87 service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:26.432692 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b444eb4-29c0-4cb3-bf49-d2ead3c2ff87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:26.443017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b444eb4-29c0-4cb3-bf49-d2ead3c2ff87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:26.444956 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b444eb4-29c0-4cb3-bf49-d2ead3c2ff87 service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:26.458778 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 688/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:29.051051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31201684-3ed5-454b-941b-61affac1284b None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:29.051602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31201684-3ed5-454b-941b-61affac1284b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:29.051602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31201684-3ed5-454b-941b-61affac1284b None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:29.052970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 676/1364] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:29.058748 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd768ccc-b785-4710-bf35-747b0cba127e None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:29.059190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd768ccc-b785-4710-bf35-747b0cba127e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:29.059333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd768ccc-b785-4710-bf35-747b0cba127e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:29.079846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-cd768ccc-b785-4710-bf35-747b0cba127e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:29.081079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-cd768ccc-b785-4710-bf35-747b0cba127e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:29.088810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 689/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:29.136239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d76a9-20e4-4459-80ee-c01667b25f04 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:29.136563 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d76a9-20e4-4459-80ee-c01667b25f04 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:29.136968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d76a9-20e4-4459-80ee-c01667b25f04 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:29.138466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 677/1366] 10.222.0.23 () {54 vars in 961 bytes} [Thu Jun 16 14:55:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:29.143790 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c7bcd-ec08-4916-9d49-b504aff62079 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:29.144087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c7bcd-ec08-4916-9d49-b504aff62079 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:29.144371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c7bcd-ec08-4916-9d49-b504aff62079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:29.162445 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-4e3c7bcd-ec08-4916-9d49-b504aff62079 None None] MFA Rules not processed for user `60c2f1c63a674e3195c490ab5ad1318f`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:29.163631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4e3c7bcd-ec08-4916-9d49-b504aff62079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:29.174011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 690/1367] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Jun 16 14:55:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:29.182251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d76a9-20e4-4459-80ee-c01667b25f04 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:29.197206 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d76a9-20e4-4459-80ee-c01667b25f04 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:29.202953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7746ed8-487d-4c42-901d-bd7e35a45fc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:29.203670 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7746ed8-487d-4c42-901d-bd7e35a45fc9 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:29.204029 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7746ed8-487d-4c42-901d-bd7e35a45fc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:29.204379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7746ed8-487d-4c42-901d-bd7e35a45fc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:29.214164 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7746ed8-487d-4c42-901d-bd7e35a45fc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:29.215769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7746ed8-487d-4c42-901d-bd7e35a45fc9 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:29.227716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 678/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:31.581246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d638d-f382-47f8-87d9-0c80e099d2dd None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:31.581780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d638d-f382-47f8-87d9-0c80e099d2dd None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:31.581780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d638d-f382-47f8-87d9-0c80e099d2dd None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:31.583165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 691/1369] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:31.589011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f0a1f-a76c-47d2-959e-3c189f6c4815 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:31.589807 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f0a1f-a76c-47d2-959e-3c189f6c4815 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:31.590246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f0a1f-a76c-47d2-959e-3c189f6c4815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:31.607865 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-1d6f0a1f-a76c-47d2-959e-3c189f6c4815 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:31.609296 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-1d6f0a1f-a76c-47d2-959e-3c189f6c4815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:31.617436 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 679/1370] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:31.661707 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d638d-f382-47f8-87d9-0c80e099d2dd None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:31.677974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d638d-f382-47f8-87d9-0c80e099d2dd None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:31.685455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f2422-5ffa-4ce6-8567-50a9698c4f98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:31.686115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f2422-5ffa-4ce6-8567-50a9698c4f98 service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:31.686398 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f2422-5ffa-4ce6-8567-50a9698c4f98 service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:31.686672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f2422-5ffa-4ce6-8567-50a9698c4f98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:31.698465 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f2422-5ffa-4ce6-8567-50a9698c4f98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:31.700047 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f2422-5ffa-4ce6-8567-50a9698c4f98 service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:31.709946 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 692/1371] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:32.027716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47632b-2edc-4717-b2c5-85a25603b8f2 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:32.028123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47632b-2edc-4717-b2c5-85a25603b8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:32.028300 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47632b-2edc-4717-b2c5-85a25603b8f2 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:32.029788 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 680/1372] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:32.036435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e94aa-9160-4bca-98e4-58152a194937 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:32.036749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e94aa-9160-4bca-98e4-58152a194937 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:32.037004 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e94aa-9160-4bca-98e4-58152a194937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:32.056210 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-0c4e94aa-9160-4bca-98e4-58152a194937 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:32.058001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0c4e94aa-9160-4bca-98e4-58152a194937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:32.066588 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 693/1373] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:55:32.375112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636dce8-4327-4780-a00b-be23ace48a58 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:32.375112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636dce8-4327-4780-a00b-be23ace48a58 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:32.375112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636dce8-4327-4780-a00b-be23ace48a58 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:32.377690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 681/1374] 10.222.0.23 () {54 vars in 963 bytes} [Thu Jun 16 14:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:32.383339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b632fa-bf5d-42ed-b768-40b02c69dac5 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:32.383339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b632fa-bf5d-42ed-b768-40b02c69dac5 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:32.383339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b632fa-bf5d-42ed-b768-40b02c69dac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:32.392545 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:32.434895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-a3b632fa-bf5d-42ed-b768-40b02c69dac5 None None] MFA Rules not processed for user `30309e7760004bd795c22dcb55d4ff99`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:32.436140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a3b632fa-bf5d-42ed-b768-40b02c69dac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:32.501378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 694/1375] 10.222.0.23 () {58 vars in 1060 bytes} [Thu Jun 16 14:55:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:32.509253 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636dce8-4327-4780-a00b-be23ace48a58 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:32.521162 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636dce8-4327-4780-a00b-be23ace48a58 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:32.524861 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13124de1-0715-4af9-82a1-1142ba1a88b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:32.526197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124de1-0715-4af9-82a1-1142ba1a88b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:32.526562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124de1-0715-4af9-82a1-1142ba1a88b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:32.526921 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13124de1-0715-4af9-82a1-1142ba1a88b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:32.536552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13124de1-0715-4af9-82a1-1142ba1a88b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:32.538089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13124de1-0715-4af9-82a1-1142ba1a88b1 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:32.548822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 682/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:34.072190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215a0eb-d0bb-44d0-87ed-23a49570bd4d None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:34.072744 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215a0eb-d0bb-44d0-87ed-23a49570bd4d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:34.072744 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215a0eb-d0bb-44d0-87ed-23a49570bd4d None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:34.074164 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 695/1377] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:34.079480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b3704-888b-42fc-bb93-3f94d1526c96 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:34.079958 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b3704-888b-42fc-bb93-3f94d1526c96 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:34.080431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b3704-888b-42fc-bb93-3f94d1526c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:34.098743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-735b3704-888b-42fc-bb93-3f94d1526c96 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:34.099956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-735b3704-888b-42fc-bb93-3f94d1526c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:34.108655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 683/1378] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:34.152920 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215a0eb-d0bb-44d0-87ed-23a49570bd4d None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:34.167971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215a0eb-d0bb-44d0-87ed-23a49570bd4d None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:34.173552 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039bf12-81b0-474b-b5c9-57f59dc21424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:34.177688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039bf12-81b0-474b-b5c9-57f59dc21424 service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:34.177688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039bf12-81b0-474b-b5c9-57f59dc21424 service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:34.177688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039bf12-81b0-474b-b5c9-57f59dc21424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:34.182801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039bf12-81b0-474b-b5c9-57f59dc21424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:34.184420 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039bf12-81b0-474b-b5c9-57f59dc21424 service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:34.193835 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 696/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:36.513756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a0f99-dc8d-4329-bb9c-4a37fe6a95da None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:36.514342 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a0f99-dc8d-4329-bb9c-4a37fe6a95da None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:36.514617 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a0f99-dc8d-4329-bb9c-4a37fe6a95da None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:36.516185 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 684/1380] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:36.521374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58f65a-4f94-48bc-bd9d-908cdb4c6b7f None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:36.521776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58f65a-4f94-48bc-bd9d-908cdb4c6b7f None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:36.521922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58f65a-4f94-48bc-bd9d-908cdb4c6b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:36.540030 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-4f58f65a-4f94-48bc-bd9d-908cdb4c6b7f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:36.541822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4f58f65a-4f94-48bc-bd9d-908cdb4c6b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:36.549885 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 697/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:36.592976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a0f99-dc8d-4329-bb9c-4a37fe6a95da None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:36.608351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a0f99-dc8d-4329-bb9c-4a37fe6a95da None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:36.613845 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10298973-aed4-4cc5-a328-76e6ad106c7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:36.614946 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10298973-aed4-4cc5-a328-76e6ad106c7c service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:36.615362 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10298973-aed4-4cc5-a328-76e6ad106c7c service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:36.615737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10298973-aed4-4cc5-a328-76e6ad106c7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:36.625690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10298973-aed4-4cc5-a328-76e6ad106c7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:36.627516 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10298973-aed4-4cc5-a328-76e6ad106c7c service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:36.637555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 685/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:55:38.947976 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a150e-3ef6-40ba-a4ce-e6ba7b932ab0 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:38.948501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a150e-3ef6-40ba-a4ce-e6ba7b932ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:38.948501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a150e-3ef6-40ba-a4ce-e6ba7b932ab0 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:38.949901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 698/1383] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:38.955188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624de13d-357b-4588-b200-e682d02ff4b5 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:38.955612 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624de13d-357b-4588-b200-e682d02ff4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:38.955746 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624de13d-357b-4588-b200-e682d02ff4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:38.978324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-624de13d-357b-4588-b200-e682d02ff4b5 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:38.980071 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-624de13d-357b-4588-b200-e682d02ff4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:38.988092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 686/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:39.030233 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a150e-3ef6-40ba-a4ce-e6ba7b932ab0 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:39.049973 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a150e-3ef6-40ba-a4ce-e6ba7b932ab0 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:39.055923 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362b20c-b3eb-4501-aa8f-0c59e01b3303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:39.056708 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362b20c-b3eb-4501-aa8f-0c59e01b3303 service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:39.057794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362b20c-b3eb-4501-aa8f-0c59e01b3303 service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:39.058179 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362b20c-b3eb-4501-aa8f-0c59e01b3303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:39.067782 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362b20c-b3eb-4501-aa8f-0c59e01b3303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:39.069498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362b20c-b3eb-4501-aa8f-0c59e01b3303 service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:39.080041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 699/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:41.237163 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3ff7b-f87b-4de3-83e0-8171f16fdbb9 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:41.237672 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3ff7b-f87b-4de3-83e0-8171f16fdbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:41.237810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3ff7b-f87b-4de3-83e0-8171f16fdbb9 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:41.239945 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 687/1386] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:41.246707 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1380e-288c-4d00-9280-2ff343a4e199 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:41.247152 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1380e-288c-4d00-9280-2ff343a4e199 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:41.247505 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1380e-288c-4d00-9280-2ff343a4e199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:41.267834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-64d1380e-288c-4d00-9280-2ff343a4e199 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:41.269082 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-64d1380e-288c-4d00-9280-2ff343a4e199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:41.277943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 700/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:41.324468 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3ff7b-f87b-4de3-83e0-8171f16fdbb9 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:41.340620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3ff7b-f87b-4de3-83e0-8171f16fdbb9 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:41.346408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e3f68-8159-4e28-af62-d3cf0490898a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:41.347110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e3f68-8159-4e28-af62-d3cf0490898a service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:41.347420 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e3f68-8159-4e28-af62-d3cf0490898a service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:41.347709 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e3f68-8159-4e28-af62-d3cf0490898a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:41.356512 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e3f68-8159-4e28-af62-d3cf0490898a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:41.358234 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e3f68-8159-4e28-af62-d3cf0490898a service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:41.368419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 688/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:43.715026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a372a65-199b-450f-b7da-93f93779f6c7 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:43.715798 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a372a65-199b-450f-b7da-93f93779f6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:43.715798 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a372a65-199b-450f-b7da-93f93779f6c7 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:43.717070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 701/1389] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:43.723033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c3aa8-6a39-43a6-bccc-f880699bce61 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:43.723523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c3aa8-6a39-43a6-bccc-f880699bce61 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:43.723636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c3aa8-6a39-43a6-bccc-f880699bce61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:43.742323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-aa6c3aa8-6a39-43a6-bccc-f880699bce61 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:43.743544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-aa6c3aa8-6a39-43a6-bccc-f880699bce61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:43.752042 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 689/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:43.798921 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a372a65-199b-450f-b7da-93f93779f6c7 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:43.814677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a372a65-199b-450f-b7da-93f93779f6c7 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:43.823010 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3adae-8681-40bf-b6d4-30573c0fa8cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:43.823989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3adae-8681-40bf-b6d4-30573c0fa8cc service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:43.824466 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3adae-8681-40bf-b6d4-30573c0fa8cc service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:43.824965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3adae-8681-40bf-b6d4-30573c0fa8cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:43.837978 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3adae-8681-40bf-b6d4-30573c0fa8cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:43.841162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3adae-8681-40bf-b6d4-30573c0fa8cc service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:43.857248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 702/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:46.171212 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9160be-76a5-4068-bc7d-fae09c0b8b12 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:46.171717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9160be-76a5-4068-bc7d-fae09c0b8b12 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:46.171717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9160be-76a5-4068-bc7d-fae09c0b8b12 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:46.173407 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 690/1392] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:46.178942 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02093f-d799-4bed-ae88-335db4332dd6 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:46.179429 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02093f-d799-4bed-ae88-335db4332dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:46.179657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02093f-d799-4bed-ae88-335db4332dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:46.197561 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-8c02093f-d799-4bed-ae88-335db4332dd6 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:46.198796 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-8c02093f-d799-4bed-ae88-335db4332dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:46.206637 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 703/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:55:46.264809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9160be-76a5-4068-bc7d-fae09c0b8b12 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:46.280026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9160be-76a5-4068-bc7d-fae09c0b8b12 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:46.285723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282cf28-d100-43ff-bd25-140b409c6178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:46.286377 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282cf28-d100-43ff-bd25-140b409c6178 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:46.286670 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282cf28-d100-43ff-bd25-140b409c6178 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:46.286949 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282cf28-d100-43ff-bd25-140b409c6178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:46.296125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282cf28-d100-43ff-bd25-140b409c6178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:46.297891 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282cf28-d100-43ff-bd25-140b409c6178 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:46.307541 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 691/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:48.358353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b8e2a-36b0-43f4-93c7-0ec9f1c58d6b None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:48.358955 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b8e2a-36b0-43f4-93c7-0ec9f1c58d6b None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:48.358955 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b8e2a-36b0-43f4-93c7-0ec9f1c58d6b None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:48.360346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 704/1395] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 14:55:48.365933 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36de1ac-9e0b-44ba-bc36-5c9c7cb3645a None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:48.366384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36de1ac-9e0b-44ba-bc36-5c9c7cb3645a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:48.366500 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36de1ac-9e0b-44ba-bc36-5c9c7cb3645a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:48.384549 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-b36de1ac-9e0b-44ba-bc36-5c9c7cb3645a None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:48.386407 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b36de1ac-9e0b-44ba-bc36-5c9c7cb3645a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:48.394327 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 692/1396] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:48.450299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bec53-1fbc-44ac-9382-0252145ce4c0 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:48.450661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bec53-1fbc-44ac-9382-0252145ce4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:48.451019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bec53-1fbc-44ac-9382-0252145ce4c0 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:48.452542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 705/1397] 10.222.0.23 () {54 vars in 962 bytes} [Thu Jun 16 14:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:48.457625 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b368fa8-83d1-4c82-83dd-65a050c3b09d None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:48.457925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b368fa8-83d1-4c82-83dd-65a050c3b09d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:48.458211 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b368fa8-83d1-4c82-83dd-65a050c3b09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:48.506298 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-0b368fa8-83d1-4c82-83dd-65a050c3b09d None None] MFA Rules not processed for user `e8f268ca2cb34c06b188908495cdcd53`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:48.507508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-0b368fa8-83d1-4c82-83dd-65a050c3b09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:48.572281 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 693/1398] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Jun 16 14:55:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:48.580587 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bec53-1fbc-44ac-9382-0252145ce4c0 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:48.591149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bec53-1fbc-44ac-9382-0252145ce4c0 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:48.594629 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5593c-2d96-45a6-850a-05b0a5781975 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8f268ca2cb34c06b188908495cdcd53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:48.595266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5593c-2d96-45a6-850a-05b0a5781975 service glance] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:48.595553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5593c-2d96-45a6-850a-05b0a5781975 service glance] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:48.595837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5593c-2d96-45a6-850a-05b0a5781975 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:48.598046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f612db4-534e-4096-9fa7-784279f90ff3 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:48.598346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f612db4-534e-4096-9fa7-784279f90ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:48.598632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f612db4-534e-4096-9fa7-784279f90ff3 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:48.600000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 694/1399] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:48.604877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13601576-c63b-4229-ad62-525b5cddad5b None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:48.605192 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13601576-c63b-4229-ad62-525b5cddad5b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:48.605483 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13601576-c63b-4229-ad62-525b5cddad5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:48.605607 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5593c-2d96-45a6-850a-05b0a5781975 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:48.606983 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5593c-2d96-45a6-850a-05b0a5781975 service glance] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:48.617117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 706/1400] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:48.623787 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-13601576-c63b-4229-ad62-525b5cddad5b None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:48.625119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-13601576-c63b-4229-ad62-525b5cddad5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:48.633116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 695/1401] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:55:48.679887 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5593c-2d96-45a6-850a-05b0a5781975 service glance] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:48.693079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5593c-2d96-45a6-850a-05b0a5781975 service glance] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:48.698762 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d53f62-be98-415e-add3-cea4611549fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:48.699440 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d53f62-be98-415e-add3-cea4611549fe service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:48.699724 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d53f62-be98-415e-add3-cea4611549fe service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:48.700036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d53f62-be98-415e-add3-cea4611549fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:48.709366 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d53f62-be98-415e-add3-cea4611549fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:48.710977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d53f62-be98-415e-add3-cea4611549fe service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:48.722192 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 707/1402] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:55:49.448936 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a173b8a-7a89-4288-a1e7-b6e5539dcf4f None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:49.449439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a173b8a-7a89-4288-a1e7-b6e5539dcf4f None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:49.449542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a173b8a-7a89-4288-a1e7-b6e5539dcf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:49.454681 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:49.500422 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-9a173b8a-7a89-4288-a1e7-b6e5539dcf4f None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:49.501679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-9a173b8a-7a89-4288-a1e7-b6e5539dcf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:49.573802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 696/1403] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 16 14:55:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:49.618346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf9ce8-377f-4aba-966d-f78bf66e1b2b None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:49.618915 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf9ce8-377f-4aba-966d-f78bf66e1b2b None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:49.619009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf9ce8-377f-4aba-966d-f78bf66e1b2b None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:49.620595 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 708/1404] 10.222.0.23 () {54 vars in 942 bytes} [Thu Jun 16 14:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:49.627533 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67f472-cc53-4296-bc00-244ca48c87bf None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:49.627942 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67f472-cc53-4296-bc00-244ca48c87bf None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:49.628330 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67f472-cc53-4296-bc00-244ca48c87bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:49.681818 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-4e67f472-cc53-4296-bc00-244ca48c87bf None None] MFA Rules not processed for user `a952ee6a39e1453b80a8a8b787d0fdf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:49.683222 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4e67f472-cc53-4296-bc00-244ca48c87bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:49.764472 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 697/1405] 10.222.0.23 () {58 vars in 1039 bytes} [Thu Jun 16 14:55:49 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:49.775300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf9ce8-377f-4aba-966d-f78bf66e1b2b None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:49.794192 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf9ce8-377f-4aba-966d-f78bf66e1b2b None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:49.799335 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c81887-411b-448e-9538-749ae5b5fee9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:49.799986 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c81887-411b-448e-9538-749ae5b5fee9 service swift] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:49.800275 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c81887-411b-448e-9538-749ae5b5fee9 service swift] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:49.800561 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c81887-411b-448e-9538-749ae5b5fee9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:49.811935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c81887-411b-448e-9538-749ae5b5fee9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:49.813571 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c81887-411b-448e-9538-749ae5b5fee9 service swift] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:49.821659 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 709/1406] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 14:55:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 14:55:51.021549 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f4015-520b-468c-924a-4fb6d994df1c None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:51.023004 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f4015-520b-468c-924a-4fb6d994df1c None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:51.023004 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f4015-520b-468c-924a-4fb6d994df1c None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:51.023669 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 698/1407] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:55:51.029710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac992b-0752-47f1-a982-4a405c470b49 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:51.030148 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac992b-0752-47f1-a982-4a405c470b49 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:51.030347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac992b-0752-47f1-a982-4a405c470b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:51.050040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-62ac992b-0752-47f1-a982-4a405c470b49 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:55:51.051548 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-62ac992b-0752-47f1-a982-4a405c470b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:55:51.060389 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 710/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:55:51.106404 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f4015-520b-468c-924a-4fb6d994df1c None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:55:51.123304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f4015-520b-468c-924a-4fb6d994df1c None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:55:51.128895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66f5f6-f7b7-4f49-957d-7de11b75c585 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:55:51.129591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66f5f6-f7b7-4f49-957d-7de11b75c585 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:55:51.129875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66f5f6-f7b7-4f49-957d-7de11b75c585 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:55:51.130148 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66f5f6-f7b7-4f49-957d-7de11b75c585 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:55:51.144129 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66f5f6-f7b7-4f49-957d-7de11b75c585 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:55:51.146893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66f5f6-f7b7-4f49-957d-7de11b75c585 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:55:51.160051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 699/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:01.043972 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=84 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:01.154766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:13.707618 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a376667-3c35-40ff-92c1-afae2d8c4f11 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:13.708207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a376667-3c35-40ff-92c1-afae2d8c4f11 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:13.708207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a376667-3c35-40ff-92c1-afae2d8c4f11 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:13.709603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 711/1410] 10.222.0.23 () {54 vars in 918 bytes} [Thu Jun 16 14:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:13.715328 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27757d5-800c-4d7a-8696-7c95e79fe001 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:13.715730 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27757d5-800c-4d7a-8696-7c95e79fe001 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:13.715881 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27757d5-800c-4d7a-8696-7c95e79fe001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:13.734427 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-f27757d5-800c-4d7a-8696-7c95e79fe001 None None] MFA Rules not processed for user `534035b2e8cf4f769e3dbbaabc0f6ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:13.735632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f27757d5-800c-4d7a-8696-7c95e79fe001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:13.744374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 700/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Jun 16 14:56:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:13.758617 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb291-efd1-4da8-9a84-f42b41fea234 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:13.758912 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb291-efd1-4da8-9a84-f42b41fea234 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:13.759224 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb291-efd1-4da8-9a84-f42b41fea234 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:13.760588 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 712/1412] 10.222.0.23 () {54 vars in 918 bytes} [Thu Jun 16 14:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:13.765583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af877270-4b20-4185-8163-49efb4d3f8d5 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:13.765874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af877270-4b20-4185-8163-49efb4d3f8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:13.766158 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af877270-4b20-4185-8163-49efb4d3f8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:13.783936 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-af877270-4b20-4185-8163-49efb4d3f8d5 None None] MFA Rules not processed for user `60c2f1c63a674e3195c490ab5ad1318f`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:13.785121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-af877270-4b20-4185-8163-49efb4d3f8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:13.794149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 701/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Jun 16 14:56:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:16.405212 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d22698-b822-434d-bb47-80da615f18c8 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:16.405785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d22698-b822-434d-bb47-80da615f18c8 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:16.405785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d22698-b822-434d-bb47-80da615f18c8 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:16.407119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:16.412297 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d74a0-43bc-4dc1-8bee-22871bce3341 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:16.412697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d74a0-43bc-4dc1-8bee-22871bce3341 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:16.412875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d74a0-43bc-4dc1-8bee-22871bce3341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:16.430677 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-157d74a0-43bc-4dc1-8bee-22871bce3341 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:16.431863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-157d74a0-43bc-4dc1-8bee-22871bce3341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:16.439544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:16.481800 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d22698-b822-434d-bb47-80da615f18c8 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:16.495917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d22698-b822-434d-bb47-80da615f18c8 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:16.503038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd563d-6a64-405e-93c1-7ab5110cb42b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:16.503038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd563d-6a64-405e-93c1-7ab5110cb42b service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:16.503038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd563d-6a64-405e-93c1-7ab5110cb42b service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:16.503038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd563d-6a64-405e-93c1-7ab5110cb42b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:16.510890 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd563d-6a64-405e-93c1-7ab5110cb42b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:16.512991 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd563d-6a64-405e-93c1-7ab5110cb42b service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:16.522325 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 714/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:17.471026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6732c-aa4d-417a-ae80-b65e2c412edf None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:17.471559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6732c-aa4d-417a-ae80-b65e2c412edf None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:17.471653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6732c-aa4d-417a-ae80-b65e2c412edf None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:17.472994 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:17.477776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d94390-4678-4981-ac4a-812a526cb961 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:17.478180 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d94390-4678-4981-ac4a-812a526cb961 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:17.478351 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d94390-4678-4981-ac4a-812a526cb961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:17.497059 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-13d94390-4678-4981-ac4a-812a526cb961 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:17.498283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-13d94390-4678-4981-ac4a-812a526cb961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:17.506043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:17.656203 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6732c-aa4d-417a-ae80-b65e2c412edf None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:17.670886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6732c-aa4d-417a-ae80-b65e2c412edf None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:17.678235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa5a46-1949-4d53-8b42-a505211e0e53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:17.678235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa5a46-1949-4d53-8b42-a505211e0e53 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:17.678235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa5a46-1949-4d53-8b42-a505211e0e53 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:17.678235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa5a46-1949-4d53-8b42-a505211e0e53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:17.685729 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa5a46-1949-4d53-8b42-a505211e0e53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:17.687464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa5a46-1949-4d53-8b42-a505211e0e53 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:17.696895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 704/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:18.653332 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053ea49-b05b-434f-88dd-cf5d57846674 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.653958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053ea49-b05b-434f-88dd-cf5d57846674 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.653958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053ea49-b05b-434f-88dd-cf5d57846674 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.655266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:56:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:18.660965 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73adb29-4bae-43e0-93e7-410efaab4604 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.661498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73adb29-4bae-43e0-93e7-410efaab4604 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.661612 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73adb29-4bae-43e0-93e7-410efaab4604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.681914 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-d73adb29-4bae-43e0-93e7-410efaab4604 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:18.687016 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d73adb29-4bae-43e0-93e7-410efaab4604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:18.695964 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:18.849493 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053ea49-b05b-434f-88dd-cf5d57846674 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:18.863944 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053ea49-b05b-434f-88dd-cf5d57846674 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:18.869778 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806dbcd2-bb39-4ab9-9aa9-dd912bcbef4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:18.870449 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dbcd2-bb39-4ab9-9aa9-dd912bcbef4f service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:18.870736 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dbcd2-bb39-4ab9-9aa9-dd912bcbef4f service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:18.871029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dbcd2-bb39-4ab9-9aa9-dd912bcbef4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:18.879089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806dbcd2-bb39-4ab9-9aa9-dd912bcbef4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:18.880668 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806dbcd2-bb39-4ab9-9aa9-dd912bcbef4f service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:18.890690 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 717/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:19.794313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f850a2-ac4c-4844-9020-15a14c3dc806 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:19.795166 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f850a2-ac4c-4844-9020-15a14c3dc806 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:19.795166 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f850a2-ac4c-4844-9020-15a14c3dc806 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:19.796263 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:19.801326 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1be2-c5c6-48c8-b644-86838d4f5b67 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:19.801775 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1be2-c5c6-48c8-b644-86838d4f5b67 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:19.801884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a1be2-c5c6-48c8-b644-86838d4f5b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:19.819974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-406a1be2-c5c6-48c8-b644-86838d4f5b67 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:19.822779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-406a1be2-c5c6-48c8-b644-86838d4f5b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:19.830065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:19.982361 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f850a2-ac4c-4844-9020-15a14c3dc806 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:19.997848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f850a2-ac4c-4844-9020-15a14c3dc806 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:20.003435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e1596-f3c7-48aa-af8c-395df10ffcad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:20.004080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1596-f3c7-48aa-af8c-395df10ffcad service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:20.004368 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1596-f3c7-48aa-af8c-395df10ffcad service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:20.004647 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e1596-f3c7-48aa-af8c-395df10ffcad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:20.013566 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e1596-f3c7-48aa-af8c-395df10ffcad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:20.015172 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e1596-f3c7-48aa-af8c-395df10ffcad service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:20.024456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 707/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 14:56:20.928166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d1e03-7c1c-4ef9-bb12-56d3b01b369b None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:20.928775 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d1e03-7c1c-4ef9-bb12-56d3b01b369b None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:20.928775 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d1e03-7c1c-4ef9-bb12-56d3b01b369b None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:20.930801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:56:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:20.936192 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec25333-15dc-4805-909c-7dc5b21404e4 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:20.936648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec25333-15dc-4805-909c-7dc5b21404e4 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:20.936777 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec25333-15dc-4805-909c-7dc5b21404e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:20.955971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-eec25333-15dc-4805-909c-7dc5b21404e4 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:20.957224 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-eec25333-15dc-4805-909c-7dc5b21404e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:20.965779 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:21.119508 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d1e03-7c1c-4ef9-bb12-56d3b01b369b None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:21.134665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d1e03-7c1c-4ef9-bb12-56d3b01b369b None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:21.140624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423f1bf-e7d6-4b28-bd2c-bab9e5f458a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:21.141307 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423f1bf-e7d6-4b28-bd2c-bab9e5f458a5 service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:21.141601 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423f1bf-e7d6-4b28-bd2c-bab9e5f458a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:21.141881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423f1bf-e7d6-4b28-bd2c-bab9e5f458a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:21.150093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423f1bf-e7d6-4b28-bd2c-bab9e5f458a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:21.153041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423f1bf-e7d6-4b28-bd2c-bab9e5f458a5 service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:21.162548 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 720/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:22.070432 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536cd1b-d559-4d7b-abf9-c111fe09eced None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:22.071001 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536cd1b-d559-4d7b-abf9-c111fe09eced None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:22.071001 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536cd1b-d559-4d7b-abf9-c111fe09eced None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:22.072361 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:22.078198 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3e33b-03d5-48ce-bd87-0e2c8e75936a None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:22.078646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3e33b-03d5-48ce-bd87-0e2c8e75936a None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:22.078808 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3e33b-03d5-48ce-bd87-0e2c8e75936a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:22.097562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-0ac3e33b-03d5-48ce-bd87-0e2c8e75936a None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:22.098810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0ac3e33b-03d5-48ce-bd87-0e2c8e75936a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:22.106792 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:22.257784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536cd1b-d559-4d7b-abf9-c111fe09eced None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:22.272443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536cd1b-d559-4d7b-abf9-c111fe09eced None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:22.278280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b74bf2-50c5-40ae-bcae-5b495f2c5aed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:22.279174 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b74bf2-50c5-40ae-bcae-5b495f2c5aed service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:22.279584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b74bf2-50c5-40ae-bcae-5b495f2c5aed service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:22.279994 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b74bf2-50c5-40ae-bcae-5b495f2c5aed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:22.288765 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b74bf2-50c5-40ae-bcae-5b495f2c5aed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:22.290371 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b74bf2-50c5-40ae-bcae-5b495f2c5aed service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:22.299694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 710/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:23.263134 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec6e63-3749-41f2-85bf-d81dd2bdaa43 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.263667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec6e63-3749-41f2-85bf-d81dd2bdaa43 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.263667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec6e63-3749-41f2-85bf-d81dd2bdaa43 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.264971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:56:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:23.269966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad015b1d-4720-4617-af11-79e0f938c6db None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.270374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad015b1d-4720-4617-af11-79e0f938c6db None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.270524 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad015b1d-4720-4617-af11-79e0f938c6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.288529 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-ad015b1d-4720-4617-af11-79e0f938c6db None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:23.289745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ad015b1d-4720-4617-af11-79e0f938c6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:23.297747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:23.449122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec6e63-3749-41f2-85bf-d81dd2bdaa43 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:23.462934 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec6e63-3749-41f2-85bf-d81dd2bdaa43 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:23.468751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac59f7-19fc-4d2b-becd-aca93b5191cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:23.469414 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac59f7-19fc-4d2b-becd-aca93b5191cd service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:23.469698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac59f7-19fc-4d2b-becd-aca93b5191cd service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:23.469971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac59f7-19fc-4d2b-becd-aca93b5191cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:23.477990 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac59f7-19fc-4d2b-becd-aca93b5191cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:23.479540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac59f7-19fc-4d2b-becd-aca93b5191cd service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:23.488669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 723/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:24.407680 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deb5a5-58c3-4278-9aee-6a04c03e7c63 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.408244 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deb5a5-58c3-4278-9aee-6a04c03e7c63 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.408244 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deb5a5-58c3-4278-9aee-6a04c03e7c63 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.409654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:24.414521 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c04dd2-9579-42f5-af7d-487ea1291ab6 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.414960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c04dd2-9579-42f5-af7d-487ea1291ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.415088 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c04dd2-9579-42f5-af7d-487ea1291ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.433204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-d8c04dd2-9579-42f5-af7d-487ea1291ab6 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:24.434400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-d8c04dd2-9579-42f5-af7d-487ea1291ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:24.442405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:24.592772 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9deb5a5-58c3-4278-9aee-6a04c03e7c63 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:24.607653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9deb5a5-58c3-4278-9aee-6a04c03e7c63 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:24.613009 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df21524-7a19-43b5-ac35-edae35294c36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:24.613677 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df21524-7a19-43b5-ac35-edae35294c36 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:24.613965 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df21524-7a19-43b5-ac35-edae35294c36 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:24.614243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df21524-7a19-43b5-ac35-edae35294c36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:24.622592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df21524-7a19-43b5-ac35-edae35294c36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:24.624155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df21524-7a19-43b5-ac35-edae35294c36 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:24.633362 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 713/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:25.546272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4007972-bb06-45e9-881d-cc8eb22658be None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.546829 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4007972-bb06-45e9-881d-cc8eb22658be None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.546951 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4007972-bb06-45e9-881d-cc8eb22658be None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.548292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 14:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:25.553079 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb52be-7e11-4a49-b4d1-9a3bd8cb6a05 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.553531 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb52be-7e11-4a49-b4d1-9a3bd8cb6a05 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.553691 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb52be-7e11-4a49-b4d1-9a3bd8cb6a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.571130 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-4bfb52be-7e11-4a49-b4d1-9a3bd8cb6a05 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:25.572327 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4bfb52be-7e11-4a49-b4d1-9a3bd8cb6a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:25.580558 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:25.731499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4007972-bb06-45e9-881d-cc8eb22658be None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:25.746998 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4007972-bb06-45e9-881d-cc8eb22658be None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:25.752415 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661846b-5cc4-4673-8f4e-af2f90b6c2b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:25.753078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661846b-5cc4-4673-8f4e-af2f90b6c2b3 service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:25.753394 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661846b-5cc4-4673-8f4e-af2f90b6c2b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:25.753674 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661846b-5cc4-4673-8f4e-af2f90b6c2b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:25.762149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661846b-5cc4-4673-8f4e-af2f90b6c2b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:25.763722 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661846b-5cc4-4673-8f4e-af2f90b6c2b3 service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:25.773000 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 726/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:27.789315 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4dc8a-c4ef-47c5-ad8a-7bf640160be9 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.789822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4dc8a-c4ef-47c5-ad8a-7bf640160be9 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.789822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4dc8a-c4ef-47c5-ad8a-7bf640160be9 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.791199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:27.797047 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523501f-174e-4c35-86a1-e108d165409e None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.797483 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523501f-174e-4c35-86a1-e108d165409e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.797651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523501f-174e-4c35-86a1-e108d165409e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.815674 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-2523501f-174e-4c35-86a1-e108d165409e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:27.816939 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2523501f-174e-4c35-86a1-e108d165409e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:27.824905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:27.865323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4dc8a-c4ef-47c5-ad8a-7bf640160be9 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:27.876566 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4dc8a-c4ef-47c5-ad8a-7bf640160be9 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:27.880190 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e91231-c766-4d73-b6be-2b02827139cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:27.880826 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e91231-c766-4d73-b6be-2b02827139cf service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:27.881115 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e91231-c766-4d73-b6be-2b02827139cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:27.881417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e91231-c766-4d73-b6be-2b02827139cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:27.890179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e91231-c766-4d73-b6be-2b02827139cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:27.891639 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e91231-c766-4d73-b6be-2b02827139cf service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:27.900919 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 716/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:30.197384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65d80d-407b-4166-bdca-edee2d6ed8bf None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:30.197919 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65d80d-407b-4166-bdca-edee2d6ed8bf None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:30.197919 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65d80d-407b-4166-bdca-edee2d6ed8bf None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:30.199349 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:30.204699 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6e42-542c-4d35-90ab-0906c460b699 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:30.205112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6e42-542c-4d35-90ab-0906c460b699 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:30.205302 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6e42-542c-4d35-90ab-0906c460b699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:30.222592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-444a6e42-542c-4d35-90ab-0906c460b699 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:30.223782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-444a6e42-542c-4d35-90ab-0906c460b699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:30.232092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:30.270383 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65d80d-407b-4166-bdca-edee2d6ed8bf None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:30.281599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65d80d-407b-4166-bdca-edee2d6ed8bf None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:30.285067 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925d92e-7bde-4b45-8d72-716181bae230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:30.285733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925d92e-7bde-4b45-8d72-716181bae230 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:30.286020 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925d92e-7bde-4b45-8d72-716181bae230 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:30.286304 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925d92e-7bde-4b45-8d72-716181bae230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:30.295604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925d92e-7bde-4b45-8d72-716181bae230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:30.297030 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925d92e-7bde-4b45-8d72-716181bae230 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:30.306339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 729/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:32.844688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31ff61-92ef-4f0c-b667-31f076af6739 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:32.845275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31ff61-92ef-4f0c-b667-31f076af6739 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:32.845275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31ff61-92ef-4f0c-b667-31f076af6739 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:32.846654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:32.851753 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5263da-8ab0-4db2-a17f-25a218f9c254 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:32.852259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5263da-8ab0-4db2-a17f-25a218f9c254 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:32.852357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5263da-8ab0-4db2-a17f-25a218f9c254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:32.870223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-af5263da-8ab0-4db2-a17f-25a218f9c254 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:32.871524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-af5263da-8ab0-4db2-a17f-25a218f9c254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:32.879199 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:32.917742 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31ff61-92ef-4f0c-b667-31f076af6739 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:32.928309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31ff61-92ef-4f0c-b667-31f076af6739 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:32.931827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e042f-762b-4656-82af-42070e0a8085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:32.932470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e042f-762b-4656-82af-42070e0a8085 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:32.932760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e042f-762b-4656-82af-42070e0a8085 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:32.933041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e042f-762b-4656-82af-42070e0a8085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:32.941918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e042f-762b-4656-82af-42070e0a8085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:32.943355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e042f-762b-4656-82af-42070e0a8085 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:32.953296 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 719/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:35.193265 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997a94e-3564-4bb0-a8c3-d754f040e867 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.193828 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997a94e-3564-4bb0-a8c3-d754f040e867 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.193828 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997a94e-3564-4bb0-a8c3-d754f040e867 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.195196 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:35.201059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acfbfc-c16c-47e9-8a52-03b9f3ea0104 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.201499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acfbfc-c16c-47e9-8a52-03b9f3ea0104 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.201609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acfbfc-c16c-47e9-8a52-03b9f3ea0104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.219565 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-88acfbfc-c16c-47e9-8a52-03b9f3ea0104 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:35.220752 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-88acfbfc-c16c-47e9-8a52-03b9f3ea0104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:35.228512 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:35.268427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997a94e-3564-4bb0-a8c3-d754f040e867 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:35.277470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997a94e-3564-4bb0-a8c3-d754f040e867 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:35.281102 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29667dde-84f4-4d5f-8cae-2c583c609052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:35.281775 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29667dde-84f4-4d5f-8cae-2c583c609052 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:35.282060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29667dde-84f4-4d5f-8cae-2c583c609052 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:35.282337 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29667dde-84f4-4d5f-8cae-2c583c609052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:35.292089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29667dde-84f4-4d5f-8cae-2c583c609052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:35.293698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29667dde-84f4-4d5f-8cae-2c583c609052 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:35.303393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 732/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:37.481620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843f9b3-2013-46b3-9a82-c235548f926a None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.482159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843f9b3-2013-46b3-9a82-c235548f926a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.482159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843f9b3-2013-46b3-9a82-c235548f926a None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.483572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:37.488911 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9d1af-9769-4b7f-84ef-f6e89bb40029 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.489683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9d1af-9769-4b7f-84ef-f6e89bb40029 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.489788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9d1af-9769-4b7f-84ef-f6e89bb40029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.508112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-75a9d1af-9769-4b7f-84ef-f6e89bb40029 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:37.509342 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-75a9d1af-9769-4b7f-84ef-f6e89bb40029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:37.517599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:37.554978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843f9b3-2013-46b3-9a82-c235548f926a None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:37.565750 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843f9b3-2013-46b3-9a82-c235548f926a None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:37.569411 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ce759-2571-44bd-b08b-c397a4f258ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:37.570050 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ce759-2571-44bd-b08b-c397a4f258ac service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:37.570336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ce759-2571-44bd-b08b-c397a4f258ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:37.570616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ce759-2571-44bd-b08b-c397a4f258ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:37.580002 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ce759-2571-44bd-b08b-c397a4f258ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:37.581447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ce759-2571-44bd-b08b-c397a4f258ac service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:37.591398 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 722/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:39.823597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45616147-c4c4-4356-b2ec-a16574548a94 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:39.824186 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45616147-c4c4-4356-b2ec-a16574548a94 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:39.824186 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45616147-c4c4-4356-b2ec-a16574548a94 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:39.825591 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:39.831425 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0f170-8c79-4add-bf87-0f93cb681b5e None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:39.831901 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0f170-8c79-4add-bf87-0f93cb681b5e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:39.831901 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0f170-8c79-4add-bf87-0f93cb681b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:39.850827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-0ef0f170-8c79-4add-bf87-0f93cb681b5e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:39.852058 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-0ef0f170-8c79-4add-bf87-0f93cb681b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:39.860602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:39.899356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45616147-c4c4-4356-b2ec-a16574548a94 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:39.910311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45616147-c4c4-4356-b2ec-a16574548a94 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:39.913908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ea3ca-5df0-46c1-9f44-af94a494e362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:39.914572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ea3ca-5df0-46c1-9f44-af94a494e362 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:39.914862 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ea3ca-5df0-46c1-9f44-af94a494e362 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:39.915144 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ea3ca-5df0-46c1-9f44-af94a494e362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:39.926168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ea3ca-5df0-46c1-9f44-af94a494e362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:39.927632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ea3ca-5df0-46c1-9f44-af94a494e362 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:39.938638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 735/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:42.226894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695373f0-1ba8-49bd-b2aa-fb176ea92f55 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:42.227435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695373f0-1ba8-49bd-b2aa-fb176ea92f55 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:42.227435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695373f0-1ba8-49bd-b2aa-fb176ea92f55 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:42.229415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:42.234890 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5fef0-0611-41d8-8ca1-ef68c9478621 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:42.235322 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5fef0-0611-41d8-8ca1-ef68c9478621 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:42.235462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5fef0-0611-41d8-8ca1-ef68c9478621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:42.242243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=70 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:42.254777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-6fe5fef0-0611-41d8-8ca1-ef68c9478621 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:42.260949 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6fe5fef0-0611-41d8-8ca1-ef68c9478621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:42.264127 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:42.302754 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695373f0-1ba8-49bd-b2aa-fb176ea92f55 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:42.308191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=73 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:42.316567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695373f0-1ba8-49bd-b2aa-fb176ea92f55 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:42.322756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98058779-eb56-4127-912c-98a35d064ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:42.322756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98058779-eb56-4127-912c-98a35d064ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:42.322756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98058779-eb56-4127-912c-98a35d064ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:42.322756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98058779-eb56-4127-912c-98a35d064ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:42.331595 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98058779-eb56-4127-912c-98a35d064ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:42.333067 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98058779-eb56-4127-912c-98a35d064ab0 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:42.343544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 725/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:44.713832 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd2108-d3dc-45e4-a313-c6e3bf260310 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:44.714393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd2108-d3dc-45e4-a313-c6e3bf260310 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:44.714393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd2108-d3dc-45e4-a313-c6e3bf260310 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:44.715739 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:56:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:44.721095 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37dc30-0020-4b27-96e9-950e74fa026e None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:44.721525 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37dc30-0020-4b27-96e9-950e74fa026e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:44.721686 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37dc30-0020-4b27-96e9-950e74fa026e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:44.739954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-dd37dc30-0020-4b27-96e9-950e74fa026e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:44.741172 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-dd37dc30-0020-4b27-96e9-950e74fa026e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:44.748964 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:56:44.785567 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd2108-d3dc-45e4-a313-c6e3bf260310 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:44.796486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd2108-d3dc-45e4-a313-c6e3bf260310 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:44.799980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1e596-c5bd-4adb-966c-d35c33423c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:44.800605 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1e596-c5bd-4adb-966c-d35c33423c32 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:44.800887 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1e596-c5bd-4adb-966c-d35c33423c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:44.801191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1e596-c5bd-4adb-966c-d35c33423c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:44.809770 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1e596-c5bd-4adb-966c-d35c33423c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:44.811182 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1e596-c5bd-4adb-966c-d35c33423c32 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:44.820264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 738/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:47.141264 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaf809-5abe-4a07-8c3b-372593fcdcde None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:47.141873 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaf809-5abe-4a07-8c3b-372593fcdcde None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:47.141873 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaf809-5abe-4a07-8c3b-372593fcdcde None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:47.143200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:47.148588 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9a094-7211-4721-91cc-35e00df09a32 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:47.148974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9a094-7211-4721-91cc-35e00df09a32 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:47.149176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9a094-7211-4721-91cc-35e00df09a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:47.168715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-43c9a094-7211-4721-91cc-35e00df09a32 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:47.169966 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-43c9a094-7211-4721-91cc-35e00df09a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:47.177917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:47.215624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaf809-5abe-4a07-8c3b-372593fcdcde None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:47.226789 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaf809-5abe-4a07-8c3b-372593fcdcde None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:47.230921 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5680879-f530-4698-8b56-cafa39787b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:47.231568 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5680879-f530-4698-8b56-cafa39787b7d service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:47.231859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5680879-f530-4698-8b56-cafa39787b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:47.232197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5680879-f530-4698-8b56-cafa39787b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:47.242569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5680879-f530-4698-8b56-cafa39787b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:47.244037 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5680879-f530-4698-8b56-cafa39787b7d service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:47.254095 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 728/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:49.413839 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69054cb6-31b1-4741-9e23-b7e0d2ea29c1 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:49.414362 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69054cb6-31b1-4741-9e23-b7e0d2ea29c1 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:49.414362 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69054cb6-31b1-4741-9e23-b7e0d2ea29c1 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:49.416205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 14:56:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:56:49.421355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d671b84-7c89-44f6-bcc6-ea089c0bd197 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:49.421757 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d671b84-7c89-44f6-bcc6-ea089c0bd197 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:49.421927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d671b84-7c89-44f6-bcc6-ea089c0bd197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:49.439590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-8d671b84-7c89-44f6-bcc6-ea089c0bd197 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:56:49.440782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-8d671b84-7c89-44f6-bcc6-ea089c0bd197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:56:49.448461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 14:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:56:49.484373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69054cb6-31b1-4741-9e23-b7e0d2ea29c1 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:56:49.495703 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69054cb6-31b1-4741-9e23-b7e0d2ea29c1 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:56:49.499222 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deacfc2-f15d-489e-82fc-591120ba2ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:56:49.499862 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deacfc2-f15d-489e-82fc-591120ba2ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:56:49.500149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deacfc2-f15d-489e-82fc-591120ba2ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:56:49.500431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deacfc2-f15d-489e-82fc-591120ba2ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:56:49.511958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deacfc2-f15d-489e-82fc-591120ba2ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:56:49.513906 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deacfc2-f15d-489e-82fc-591120ba2ba5 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:56:49.526222 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 741/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:56:59.434592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=17 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:56:59.520344 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=17 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:09.766669 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda016cb-bbe9-4f32-8beb-be825835af0c None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:09.767080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda016cb-bbe9-4f32-8beb-be825835af0c None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:09.767238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda016cb-bbe9-4f32-8beb-be825835af0c None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:09.768626 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 730/1471] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:57:09.774557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f32a2b-4149-4a6d-8169-e295b733d880 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:09.775016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f32a2b-4149-4a6d-8169-e295b733d880 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:09.775111 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f32a2b-4149-4a6d-8169-e295b733d880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:09.792547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-a5f32a2b-4149-4a6d-8169-e295b733d880 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:09.793766 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a5f32a2b-4149-4a6d-8169-e295b733d880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:09.801724 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 742/1472] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:09.850854 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a72d1b-5d6d-45c2-b2ca-ed32ef853211 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:09.851187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a72d1b-5d6d-45c2-b2ca-ed32ef853211 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:09.851480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a72d1b-5d6d-45c2-b2ca-ed32ef853211 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:09.852901 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 731/1473] 10.222.0.23 () {54 vars in 962 bytes} [Thu Jun 16 14:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:57:09.858121 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9135e-ba6a-4a2c-b647-f028392d337d None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:09.858414 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9135e-ba6a-4a2c-b647-f028392d337d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:09.858697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9135e-ba6a-4a2c-b647-f028392d337d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:09.877347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-9af9135e-ba6a-4a2c-b647-f028392d337d None None] MFA Rules not processed for user `e8f268ca2cb34c06b188908495cdcd53`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:09.878583 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9af9135e-ba6a-4a2c-b647-f028392d337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:09.885653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 743/1474] 10.222.0.23 () {58 vars in 1059 bytes} [Thu Jun 16 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:09.893107 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a72d1b-5d6d-45c2-b2ca-ed32ef853211 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:09.904541 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a72d1b-5d6d-45c2-b2ca-ed32ef853211 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:09.908106 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb97ca-25ea-4987-9185-02af43c60233 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8f268ca2cb34c06b188908495cdcd53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:09.908750 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb97ca-25ea-4987-9185-02af43c60233 service glance] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:09.909036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb97ca-25ea-4987-9185-02af43c60233 service glance] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:09.909346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb97ca-25ea-4987-9185-02af43c60233 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:09.918817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb97ca-25ea-4987-9185-02af43c60233 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:09.920325 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb97ca-25ea-4987-9185-02af43c60233 service glance] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:09.930341 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 732/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:12.150261 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05c6bf-6131-4103-8f67-21f9e8f211af None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:12.150822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05c6bf-6131-4103-8f67-21f9e8f211af None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:12.150822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05c6bf-6131-4103-8f67-21f9e8f211af None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:12.152182 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 744/1476] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:57:12.157591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6320b7-d4e8-4f95-90bb-406eb49eb0fc None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:12.158077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6320b7-d4e8-4f95-90bb-406eb49eb0fc None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:12.158184 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6320b7-d4e8-4f95-90bb-406eb49eb0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:12.176239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-7c6320b7-d4e8-4f95-90bb-406eb49eb0fc None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:12.177551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-7c6320b7-d4e8-4f95-90bb-406eb49eb0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:12.186058 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 733/1477] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:12.208840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05c6bf-6131-4103-8f67-21f9e8f211af None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:12.221559 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05c6bf-6131-4103-8f67-21f9e8f211af None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:12.226498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623ae96-07aa-4e2f-9c40-e7f3a373a1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:12.227153 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623ae96-07aa-4e2f-9c40-e7f3a373a1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:12.227442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623ae96-07aa-4e2f-9c40-e7f3a373a1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:12.227724 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623ae96-07aa-4e2f-9c40-e7f3a373a1d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:12.228466 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623ae96-07aa-4e2f-9c40-e7f3a373a1d4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:12.230329 dv-cinder-837163-3-smb devstack@keystone.service[80274]: WARNING py.warnings [None req-6623ae96-07aa-4e2f-9c40-e7f3a373a1d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:57:12.230329 dv-cinder-837163-3-smb devstack@keystone.service[80274]: warnings.warn(msg) Jun 16 14:57:12.230329 dv-cinder-837163-3-smb devstack@keystone.service[80274]: Jun 16 14:57:12.231463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623ae96-07aa-4e2f-9c40-e7f3a373a1d4 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:12.251459 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 745/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Thu Jun 16 14:57:12 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:57:14.427592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ea217-ea4c-4875-ac12-adfccf69d7e8 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:14.428131 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ea217-ea4c-4875-ac12-adfccf69d7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:14.428249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ea217-ea4c-4875-ac12-adfccf69d7e8 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:14.429605 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 734/1479] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:57:14.434857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ebb2e-ce4c-4699-a457-4ac684d50f4f None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:14.435289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ebb2e-ce4c-4699-a457-4ac684d50f4f None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:14.435409 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ebb2e-ce4c-4699-a457-4ac684d50f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:14.453336 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-033ebb2e-ce4c-4699-a457-4ac684d50f4f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:14.454538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-033ebb2e-ce4c-4699-a457-4ac684d50f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:14.462885 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 746/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:14.505901 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ea217-ea4c-4875-ac12-adfccf69d7e8 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:14.521031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ea217-ea4c-4875-ac12-adfccf69d7e8 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:14.527220 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829894dc-bfe6-446e-892e-6bc50470357d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:14.527891 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829894dc-bfe6-446e-892e-6bc50470357d service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:14.528226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829894dc-bfe6-446e-892e-6bc50470357d service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:14.528502 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829894dc-bfe6-446e-892e-6bc50470357d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:14.536716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829894dc-bfe6-446e-892e-6bc50470357d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:14.538318 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829894dc-bfe6-446e-892e-6bc50470357d service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:14.547648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 735/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:16.899337 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec277e3d-0e90-4325-8624-020f4ea586b3 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:16.899906 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec277e3d-0e90-4325-8624-020f4ea586b3 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:16.899906 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec277e3d-0e90-4325-8624-020f4ea586b3 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:16.901289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 747/1482] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:57:16.906596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99476a85-f6de-438b-a22c-3eefe84cc9c9 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:16.906993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99476a85-f6de-438b-a22c-3eefe84cc9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:16.907167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99476a85-f6de-438b-a22c-3eefe84cc9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:16.924980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-99476a85-f6de-438b-a22c-3eefe84cc9c9 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:16.926213 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-99476a85-f6de-438b-a22c-3eefe84cc9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:16.934331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 736/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:16.971162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec277e3d-0e90-4325-8624-020f4ea586b3 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:16.972911 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ec277e3d-0e90-4325-8624-020f4ea586b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:16.986256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec277e3d-0e90-4325-8624-020f4ea586b3 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:16.990069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c20ae8-4a74-41f7-afcb-eeb15fedaab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:16.990705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c20ae8-4a74-41f7-afcb-eeb15fedaab8 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:16.990993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c20ae8-4a74-41f7-afcb-eeb15fedaab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:16.991278 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c20ae8-4a74-41f7-afcb-eeb15fedaab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:17.000169 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c20ae8-4a74-41f7-afcb-eeb15fedaab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:17.001626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c20ae8-4a74-41f7-afcb-eeb15fedaab8 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:17.010905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 748/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:19.230235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69f2b9-2687-44f0-97f1-4c386604f103 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:19.230760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69f2b9-2687-44f0-97f1-4c386604f103 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:19.230760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69f2b9-2687-44f0-97f1-4c386604f103 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:19.232105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 737/1485] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:57:19.237713 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8b2be-6b32-4429-b184-4808747848f0 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:19.238120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8b2be-6b32-4429-b184-4808747848f0 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:19.238276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8b2be-6b32-4429-b184-4808747848f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:19.257542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-cde8b2be-6b32-4429-b184-4808747848f0 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:19.258736 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-cde8b2be-6b32-4429-b184-4808747848f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:19.275124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 749/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:19.313374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69f2b9-2687-44f0-97f1-4c386604f103 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:19.324049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69f2b9-2687-44f0-97f1-4c386604f103 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:19.327784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9539876-1269-41b5-ad78-b3f964781fe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:19.328432 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9539876-1269-41b5-ad78-b3f964781fe4 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:19.328713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9539876-1269-41b5-ad78-b3f964781fe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:19.328990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9539876-1269-41b5-ad78-b3f964781fe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:19.338839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9539876-1269-41b5-ad78-b3f964781fe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:19.340305 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9539876-1269-41b5-ad78-b3f964781fe4 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:19.349698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 738/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:21.691535 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8645e0b-67b4-4ec8-8bf6-1c768b86d296 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.692135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8645e0b-67b4-4ec8-8bf6-1c768b86d296 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.692135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8645e0b-67b4-4ec8-8bf6-1c768b86d296 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.693512 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 750/1488] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:57:21.699492 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b3f7d-58e0-4918-b202-14bb77830b39 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.699916 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b3f7d-58e0-4918-b202-14bb77830b39 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.700046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b3f7d-58e0-4918-b202-14bb77830b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.718355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-a69b3f7d-58e0-4918-b202-14bb77830b39 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:21.719609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a69b3f7d-58e0-4918-b202-14bb77830b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:21.727414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 739/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:21.767290 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8645e0b-67b4-4ec8-8bf6-1c768b86d296 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:21.779109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8645e0b-67b4-4ec8-8bf6-1c768b86d296 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:21.782811 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b56c9c-08b5-493d-b059-2cd0da2378bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:21.783462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b56c9c-08b5-493d-b059-2cd0da2378bc service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:21.783752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b56c9c-08b5-493d-b059-2cd0da2378bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:21.784064 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b56c9c-08b5-493d-b059-2cd0da2378bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:21.793227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b56c9c-08b5-493d-b059-2cd0da2378bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:21.794685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b56c9c-08b5-493d-b059-2cd0da2378bc service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:21.804132 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 751/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:24.386412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e2bde-b379-47ed-b47b-b6fe7448ea8e None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.386947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e2bde-b379-47ed-b47b-b6fe7448ea8e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.386947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e2bde-b379-47ed-b47b-b6fe7448ea8e None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.388258 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 740/1491] 10.222.0.23 () {54 vars in 926 bytes} [Thu Jun 16 14:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:57:24.393921 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb309c-db96-4c7f-9cc2-5206441987bf None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.394358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb309c-db96-4c7f-9cc2-5206441987bf None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.394483 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb309c-db96-4c7f-9cc2-5206441987bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.413922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-dadb309c-db96-4c7f-9cc2-5206441987bf None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:57:24.415107 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-dadb309c-db96-4c7f-9cc2-5206441987bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:57:24.423235 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 752/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Thu Jun 16 14:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:57:24.463123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e2bde-b379-47ed-b47b-b6fe7448ea8e None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:57:24.474350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e2bde-b379-47ed-b47b-b6fe7448ea8e None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:57:24.478624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42869fcf-016e-4bd1-8de4-7359d05c112e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:57:24.479277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42869fcf-016e-4bd1-8de4-7359d05c112e service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:57:24.479568 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42869fcf-016e-4bd1-8de4-7359d05c112e service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:57:24.479851 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42869fcf-016e-4bd1-8de4-7359d05c112e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:57:24.489214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42869fcf-016e-4bd1-8de4-7359d05c112e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:57:24.490640 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42869fcf-016e-4bd1-8de4-7359d05c112e service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:57:24.501125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 741/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:57:34.407455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=33 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:34.496415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=33 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:09.609892 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86077-8123-4dac-aef1-933b9da82c66 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:09.611097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86077-8123-4dac-aef1-933b9da82c66 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:09.611097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86077-8123-4dac-aef1-933b9da82c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:09.630809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-35e86077-8123-4dac-aef1-933b9da82c66 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:09.632093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-35e86077-8123-4dac-aef1-933b9da82c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:09.640436 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 753/1494] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 14:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 14:59:09.649634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8176b4-1c2c-465f-a561-13c1ab61ccb0 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:09.650177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8176b4-1c2c-465f-a561-13c1ab61ccb0 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:09.650177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8176b4-1c2c-465f-a561-13c1ab61ccb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:09.669271 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-5f8176b4-1c2c-465f-a561-13c1ab61ccb0 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:09.670488 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-5f8176b4-1c2c-465f-a561-13c1ab61ccb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:09.678964 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 742/1495] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 14:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:09.683900 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e86077-8123-4dac-aef1-933b9da82c66 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:09.694120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e86077-8123-4dac-aef1-933b9da82c66 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:09.698620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dfe3c-c375-4cde-92b6-3c6d02579e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:09.699267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dfe3c-c375-4cde-92b6-3c6d02579e7f admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:09.699547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dfe3c-c375-4cde-92b6-3c6d02579e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:09.699821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dfe3c-c375-4cde-92b6-3c6d02579e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:09.700540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dfe3c-c375-4cde-92b6-3c6d02579e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 14:59:09.700845 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dfe3c-c375-4cde-92b6-3c6d02579e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:09.701948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: WARNING py.warnings [None req-370dfe3c-c375-4cde-92b6-3c6d02579e7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:59:09.701948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: warnings.warn(msg) Jun 16 14:59:09.701948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: Jun 16 14:59:09.702827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dfe3c-c375-4cde-92b6-3c6d02579e7f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:09.714140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 754/1496] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 14:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 14:59:09.723631 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8176b4-1c2c-465f-a561-13c1ab61ccb0 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:09.733044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8176b4-1c2c-465f-a561-13c1ab61ccb0 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:09.738639 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b04a2c-8efd-46a2-b735-34ce999ed38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:09.739287 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b04a2c-8efd-46a2-b735-34ce999ed38a admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:09.739579 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b04a2c-8efd-46a2-b735-34ce999ed38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:09.739860 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b04a2c-8efd-46a2-b735-34ce999ed38a admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:09.740615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b04a2c-8efd-46a2-b735-34ce999ed38a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:09.742378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: WARNING py.warnings [None req-b1b04a2c-8efd-46a2-b735-34ce999ed38a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:59:09.742378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: warnings.warn(msg) Jun 16 14:59:09.742378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: Jun 16 14:59:09.743575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b04a2c-8efd-46a2-b735-34ce999ed38a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:09.994569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 743/1497] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 14:59:09 2022] POST /identity/v3/projects => generated 379 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:59:09.998354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dfe3c-c375-4cde-92b6-3c6d02579e7f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:10.009534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dfe3c-c375-4cde-92b6-3c6d02579e7f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:10.068804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a707e5-a358-4ec2-847b-bf1ec6a37855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:10.069538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a707e5-a358-4ec2-847b-bf1ec6a37855 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:10.069828 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a707e5-a358-4ec2-847b-bf1ec6a37855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:10.070111 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a707e5-a358-4ec2-847b-bf1ec6a37855 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:10.070826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a707e5-a358-4ec2-847b-bf1ec6a37855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:10.071877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: WARNING py.warnings [None req-57a707e5-a358-4ec2-847b-bf1ec6a37855 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:59:10.071877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: warnings.warn(msg) Jun 16 14:59:10.071877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: Jun 16 14:59:10.073094 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a707e5-a358-4ec2-847b-bf1ec6a37855 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:10.180463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 755/1498] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 14:59:09 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 14:59:10.184652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b04a2c-8efd-46a2-b735-34ce999ed38a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:10.195909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b04a2c-8efd-46a2-b735-34ce999ed38a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:10.201053 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f47ff-b27a-4a2a-9847-f8757cca60ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:10.201792 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f47ff-b27a-4a2a-9847-f8757cca60ab admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:10.202080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f47ff-b27a-4a2a-9847-f8757cca60ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:10.202358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f47ff-b27a-4a2a-9847-f8757cca60ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:10.203101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f47ff-b27a-4a2a-9847-f8757cca60ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:10.204782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: WARNING py.warnings [None req-ac3f47ff-b27a-4a2a-9847-f8757cca60ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:59:10.204782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: warnings.warn(msg) Jun 16 14:59:10.204782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: Jun 16 14:59:10.205726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f47ff-b27a-4a2a-9847-f8757cca60ab admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:10.219493 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 744/1499] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 14:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:59:10.224200 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a707e5-a358-4ec2-847b-bf1ec6a37855 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:10.234510 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a707e5-a358-4ec2-847b-bf1ec6a37855 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:10.238998 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559af97-2886-4387-8da5-7ad8e61100cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:10.239668 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559af97-2886-4387-8da5-7ad8e61100cd admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:10.239954 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559af97-2886-4387-8da5-7ad8e61100cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:10.240233 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559af97-2886-4387-8da5-7ad8e61100cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:10.240975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559af97-2886-4387-8da5-7ad8e61100cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:10.242034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: WARNING py.warnings [None req-1559af97-2886-4387-8da5-7ad8e61100cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:59:10.242034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: warnings.warn(msg) Jun 16 14:59:10.242034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: Jun 16 14:59:10.242925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559af97-2886-4387-8da5-7ad8e61100cd admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:10.257499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 756/1500] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 14:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 14:59:10.261564 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f47ff-b27a-4a2a-9847-f8757cca60ab admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:10.272463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f47ff-b27a-4a2a-9847-f8757cca60ab admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:10.277043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49101d-ab28-4ff5-a87a-0054771c1a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:10.277966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49101d-ab28-4ff5-a87a-0054771c1a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:10.278254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49101d-ab28-4ff5-a87a-0054771c1a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:10.278533 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49101d-ab28-4ff5-a87a-0054771c1a70 admin admin] PATH_INFO: `/v3/projects/674ec2ce72e9409ca0c597ba00420548/users/3c514019b48646d9b40d27c7d1452335/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:10.293424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49101d-ab28-4ff5-a87a-0054771c1a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674ec2ce72e9409ca0c597ba00420548, user_id=3c514019b48646d9b40d27c7d1452335, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:10.294456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: WARNING py.warnings [None req-3b49101d-ab28-4ff5-a87a-0054771c1a70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:59:10.294456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: warnings.warn(msg) Jun 16 14:59:10.294456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: Jun 16 14:59:10.296376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49101d-ab28-4ff5-a87a-0054771c1a70 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:10.528849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 745/1501] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 14:59:10 2022] PUT /identity/v3/projects/674ec2ce72e9409ca0c597ba00420548/users/3c514019b48646d9b40d27c7d1452335/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:59:10.541383 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df8996-8d35-4996-b9c5-2f697b834a79 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:10.541711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df8996-8d35-4996-b9c5-2f697b834a79 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:10.541993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df8996-8d35-4996-b9c5-2f697b834a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:10.568951 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-c8df8996-8d35-4996-b9c5-2f697b834a79 None None] MFA Rules not processed for user `3c514019b48646d9b40d27c7d1452335`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:10.570240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c8df8996-8d35-4996-b9c5-2f697b834a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:10.638254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 757/1502] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 14:59:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:10.651385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e421f-061f-4efb-9a43-11a66c6de0ec None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:10.651825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e421f-061f-4efb-9a43-11a66c6de0ec None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:10.651955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e421f-061f-4efb-9a43-11a66c6de0ec None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:10.653564 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 746/1503] 10.222.0.23 () {54 vars in 963 bytes} [Thu Jun 16 14:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:59:10.658750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dc97e-7961-4772-9fea-c9f92305f15a None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:10.659120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dc97e-7961-4772-9fea-c9f92305f15a None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:10.659459 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dc97e-7961-4772-9fea-c9f92305f15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:10.679055 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-412dc97e-7961-4772-9fea-c9f92305f15a None None] MFA Rules not processed for user `30309e7760004bd795c22dcb55d4ff99`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:10.680306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-412dc97e-7961-4772-9fea-c9f92305f15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:10.726178 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:10.734097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 758/1504] 10.222.0.23 () {58 vars in 1060 bytes} [Thu Jun 16 14:59:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:10.742568 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e421f-061f-4efb-9a43-11a66c6de0ec None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:10.753687 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e421f-061f-4efb-9a43-11a66c6de0ec None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:10.757207 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726784f8-3ab2-4d84-b88c-d0d8247e62d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:10.757844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726784f8-3ab2-4d84-b88c-d0d8247e62d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:10.758133 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726784f8-3ab2-4d84-b88c-d0d8247e62d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:10.758413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726784f8-3ab2-4d84-b88c-d0d8247e62d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:10.766638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726784f8-3ab2-4d84-b88c-d0d8247e62d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:10.768049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726784f8-3ab2-4d84-b88c-d0d8247e62d3 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:10.776851 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 747/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:59:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:59:10.825084 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ba196-2e54-4b01-b757-473a965d1636 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:10.825084 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ba196-2e54-4b01-b757-473a965d1636 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:10.825382 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ba196-2e54-4b01-b757-473a965d1636 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:10.826518 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 759/1506] 10.222.0.23 () {52 vars in 829 bytes} [Thu Jun 16 14:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 14:59:10.830518 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726784f8-3ab2-4d84-b88c-d0d8247e62d3 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:10.893123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726784f8-3ab2-4d84-b88c-d0d8247e62d3 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:10.897890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457ed0e-d7e3-499c-beb6-20e1b57c2210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:10.898821 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ed0e-d7e3-499c-beb6-20e1b57c2210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:10.899126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ed0e-d7e3-499c-beb6-20e1b57c2210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:10.899406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ed0e-d7e3-499c-beb6-20e1b57c2210 admin admin] PATH_INFO: `/v3/users/3c514019b48646d9b40d27c7d1452335` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:10.900587 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457ed0e-d7e3-499c-beb6-20e1b57c2210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c514019b48646d9b40d27c7d1452335)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:10.901620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: WARNING py.warnings [None req-1457ed0e-d7e3-499c-beb6-20e1b57c2210 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:59:10.901620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: warnings.warn(msg) Jun 16 14:59:10.901620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: Jun 16 14:59:10.904568 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457ed0e-d7e3-499c-beb6-20e1b57c2210 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:11.508923 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-1457ed0e-d7e3-499c-beb6-20e1b57c2210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c514019b48646d9b40d27c7d1452335'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:11.509580 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-1457ed0e-d7e3-499c-beb6-20e1b57c2210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c514019b48646d9b40d27c7d1452335'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:11.523727 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-1457ed0e-d7e3-499c-beb6-20e1b57c2210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c514019b48646d9b40d27c7d1452335'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:11.524509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-1457ed0e-d7e3-499c-beb6-20e1b57c2210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c514019b48646d9b40d27c7d1452335'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:11.735313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-1457ed0e-d7e3-499c-beb6-20e1b57c2210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c514019b48646d9b40d27c7d1452335'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:11.753916 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:11.761968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 748/1507] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 14:59:10 2022] DELETE /identity/v3/users/3c514019b48646d9b40d27c7d1452335 => generated 0 bytes in 932 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:59:11.767553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959cb21-27ca-4841-9347-6d74dda6c839 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:11.768019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959cb21-27ca-4841-9347-6d74dda6c839 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:11.768227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959cb21-27ca-4841-9347-6d74dda6c839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:11.786840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-c959cb21-27ca-4841-9347-6d74dda6c839 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 14:59:11.788076 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c959cb21-27ca-4841-9347-6d74dda6c839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:11.845987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 760/1508] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 14:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 14:59:11.856766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457ed0e-d7e3-499c-beb6-20e1b57c2210 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:11.858326 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-1457ed0e-d7e3-499c-beb6-20e1b57c2210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:11.918150 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457ed0e-d7e3-499c-beb6-20e1b57c2210 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:11.921869 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c1c05-3f29-4a56-9d66-be6b5de8716e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:11.922550 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c1c05-3f29-4a56-9d66-be6b5de8716e service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:11.923485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c1c05-3f29-4a56-9d66-be6b5de8716e service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:11.923764 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c1c05-3f29-4a56-9d66-be6b5de8716e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:11.932999 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c1c05-3f29-4a56-9d66-be6b5de8716e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:11.934476 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c1c05-3f29-4a56-9d66-be6b5de8716e service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:11.943921 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 749/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 14:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 14:59:12.663001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959cb21-27ca-4841-9347-6d74dda6c839 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 14:59:12.664586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c959cb21-27ca-4841-9347-6d74dda6c839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 14:59:12.689068 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959cb21-27ca-4841-9347-6d74dda6c839 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 14:59:12.689068 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e0b25-db27-48d4-be4f-27790e038940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 14:59:12.689068 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e0b25-db27-48d4-be4f-27790e038940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 14:59:12.689068 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e0b25-db27-48d4-be4f-27790e038940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 14:59:12.689404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e0b25-db27-48d4-be4f-27790e038940 admin admin] PATH_INFO: `/v3/projects/674ec2ce72e9409ca0c597ba00420548` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 14:59:12.689404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e0b25-db27-48d4-be4f-27790e038940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=674ec2ce72e9409ca0c597ba00420548)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 14:59:12.689404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: WARNING py.warnings [None req-454e0b25-db27-48d4-be4f-27790e038940 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:59:12.689404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: warnings.warn(msg) Jun 16 14:59:12.689404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: Jun 16 14:59:12.689404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e0b25-db27-48d4-be4f-27790e038940 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 14:59:12.898599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-454e0b25-db27-48d4-be4f-27790e038940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674ec2ce72e9409ca0c597ba00420548', 'request_id': 'req-454e0b25-db27-48d4-be4f-27790e038940'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:12.920848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-454e0b25-db27-48d4-be4f-27790e038940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674ec2ce72e9409ca0c597ba00420548', 'request_id': 'req-454e0b25-db27-48d4-be4f-27790e038940'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:12.922160 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-454e0b25-db27-48d4-be4f-27790e038940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674ec2ce72e9409ca0c597ba00420548', 'request_id': 'req-454e0b25-db27-48d4-be4f-27790e038940'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:13.067101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-454e0b25-db27-48d4-be4f-27790e038940 admin admin] The token cache is being invalidate because project 674ec2ce72e9409ca0c597ba00420548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 14:59:13.067400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-454e0b25-db27-48d4-be4f-27790e038940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:13.068131 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-454e0b25-db27-48d4-be4f-27790e038940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 14:59:13.069724 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 761/1510] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 14:59:12 2022] DELETE /identity/v3/projects/674ec2ce72e9409ca0c597ba00420548 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 14:59:22.078547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:23.063515 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:08.418417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac634fbf-76b5-4f8d-957f-acafd0d94d40 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:08.418995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac634fbf-76b5-4f8d-957f-acafd0d94d40 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:08.418995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac634fbf-76b5-4f8d-957f-acafd0d94d40 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:08.420799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 15:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:01:08.425747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a25a0c-2e9d-4a37-bed4-e6b757981b72 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:08.426195 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a25a0c-2e9d-4a37-bed4-e6b757981b72 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:08.426308 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a25a0c-2e9d-4a37-bed4-e6b757981b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:08.444190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-74a25a0c-2e9d-4a37-bed4-e6b757981b72 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:08.445451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-74a25a0c-2e9d-4a37-bed4-e6b757981b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:08.504011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 15:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:01:08.692329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac634fbf-76b5-4f8d-957f-acafd0d94d40 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:08.694076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ac634fbf-76b5-4f8d-957f-acafd0d94d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:08.770050 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac634fbf-76b5-4f8d-957f-acafd0d94d40 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:08.775338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c59a7-8a4e-4b3c-99b2-868fa52a3fc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:08.775984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c59a7-8a4e-4b3c-99b2-868fa52a3fc4 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:08.776269 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c59a7-8a4e-4b3c-99b2-868fa52a3fc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:08.776542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c59a7-8a4e-4b3c-99b2-868fa52a3fc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:08.785541 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c59a7-8a4e-4b3c-99b2-868fa52a3fc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:08.787125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c59a7-8a4e-4b3c-99b2-868fa52a3fc4 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:08.796678 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 751/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:01:09.072570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e86e3-ee05-44ac-be59-f262cb262c37 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:09.072970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e86e3-ee05-44ac-be59-f262cb262c37 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:09.073382 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e86e3-ee05-44ac-be59-f262cb262c37 None None] PATH_INFO: `/v3` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:09.075170 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 763/1514] 10.222.0.79 () {54 vars in 925 bytes} [Thu Jun 16 15:01:09 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:01:09.114062 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c63a0-1690-4f42-ad8a-449d68969725 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:09.114363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c63a0-1690-4f42-ad8a-449d68969725 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:09.114647 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c63a0-1690-4f42-ad8a-449d68969725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:09.133853 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-1b7c63a0-1690-4f42-ad8a-449d68969725 None None] MFA Rules not processed for user `534035b2e8cf4f769e3dbbaabc0f6ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:09.135081 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-1b7c63a0-1690-4f42-ad8a-449d68969725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:09.199989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 752/1515] 10.222.0.79 () {58 vars in 1015 bytes} [Thu Jun 16 15:01:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:01:09.685375 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1fe40-641c-429b-93ee-fd4223348398 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:09.685964 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1fe40-641c-429b-93ee-fd4223348398 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:09.685964 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1fe40-641c-429b-93ee-fd4223348398 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:09.687283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 764/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 15:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:01:09.692178 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64d1b9-291d-435c-b3d2-98f4887c4b9b None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:09.692575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64d1b9-291d-435c-b3d2-98f4887c4b9b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:09.692751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64d1b9-291d-435c-b3d2-98f4887c4b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:09.715207 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-7b64d1b9-291d-435c-b3d2-98f4887c4b9b None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:09.716419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-7b64d1b9-291d-435c-b3d2-98f4887c4b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:09.724932 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 753/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 15:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:01:09.878622 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1fe40-641c-429b-93ee-fd4223348398 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:09.892762 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1fe40-641c-429b-93ee-fd4223348398 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:09.899173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b948998-5320-4273-85be-73271081a50d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:09.899807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948998-5320-4273-85be-73271081a50d service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:09.900093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948998-5320-4273-85be-73271081a50d service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:09.900369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948998-5320-4273-85be-73271081a50d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:09.909268 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b948998-5320-4273-85be-73271081a50d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:09.910864 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b948998-5320-4273-85be-73271081a50d service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:09.920895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 765/1518] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:01:19.707804 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=66 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:19.740478 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf36e70-1c04-4800-9143-f65097d9a78f None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:19.740693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf36e70-1c04-4800-9143-f65097d9a78f None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:19.740974 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf36e70-1c04-4800-9143-f65097d9a78f None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:19.742427 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 754/1519] 10.222.0.23 () {54 vars in 960 bytes} [Thu Jun 16 15:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:01:19.747352 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3807efc-e6bf-4930-97dd-f2d9fc06a3fe None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:19.747796 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3807efc-e6bf-4930-97dd-f2d9fc06a3fe None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:19.747908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3807efc-e6bf-4930-97dd-f2d9fc06a3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:19.767334 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-c3807efc-e6bf-4930-97dd-f2d9fc06a3fe None None] MFA Rules not processed for user `534035b2e8cf4f769e3dbbaabc0f6ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:19.768549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c3807efc-e6bf-4930-97dd-f2d9fc06a3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:19.777712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 766/1520] 10.222.0.23 () {58 vars in 1057 bytes} [Thu Jun 16 15:01:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:01:19.788306 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf36e70-1c04-4800-9143-f65097d9a78f None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:19.798247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf36e70-1c04-4800-9143-f65097d9a78f None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:19.803147 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2719310-dbe8-4975-b6dd-e51a16624353 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534035b2e8cf4f769e3dbbaabc0f6ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:19.803781 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2719310-dbe8-4975-b6dd-e51a16624353 service placement] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:19.804090 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2719310-dbe8-4975-b6dd-e51a16624353 service placement] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:19.804361 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2719310-dbe8-4975-b6dd-e51a16624353 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:19.813450 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2719310-dbe8-4975-b6dd-e51a16624353 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:19.815115 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2719310-dbe8-4975-b6dd-e51a16624353 service placement] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:19.824974 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 755/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:01:21.221574 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d4f4-88fb-452b-a846-a2b664d57139 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:21.222132 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d4f4-88fb-452b-a846-a2b664d57139 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:21.222132 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d4f4-88fb-452b-a846-a2b664d57139 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:21.223769 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 15:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:01:21.228775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f218e9-67e4-42e5-ac7d-0ce418a1f4ef None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:21.229243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f218e9-67e4-42e5-ac7d-0ce418a1f4ef None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:21.229380 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f218e9-67e4-42e5-ac7d-0ce418a1f4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:21.247619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-00f218e9-67e4-42e5-ac7d-0ce418a1f4ef None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:21.249384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-00f218e9-67e4-42e5-ac7d-0ce418a1f4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:21.257152 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 15:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:01:21.414211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018d4f4-88fb-452b-a846-a2b664d57139 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:21.429611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018d4f4-88fb-452b-a846-a2b664d57139 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:21.435019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77faf9-3af0-4a8a-87dd-f363ad6979bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:21.436343 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77faf9-3af0-4a8a-87dd-f363ad6979bc service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:21.436630 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77faf9-3af0-4a8a-87dd-f363ad6979bc service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:21.436910 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77faf9-3af0-4a8a-87dd-f363ad6979bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:21.445428 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77faf9-3af0-4a8a-87dd-f363ad6979bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:21.447028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77faf9-3af0-4a8a-87dd-f363ad6979bc service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:21.456656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 768/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:01:22.415419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767ff78-f651-413d-8fab-88e230bebeb4 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:22.415961 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767ff78-f651-413d-8fab-88e230bebeb4 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:22.415961 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767ff78-f651-413d-8fab-88e230bebeb4 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:22.417296 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 15:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:01:22.423082 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33f122-8110-4cb5-a169-41fd762b749f None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:22.423578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33f122-8110-4cb5-a169-41fd762b749f None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:22.423708 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33f122-8110-4cb5-a169-41fd762b749f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:22.442300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-ee33f122-8110-4cb5-a169-41fd762b749f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:22.443507 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ee33f122-8110-4cb5-a169-41fd762b749f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:22.451886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 15:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:01:22.617825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767ff78-f651-413d-8fab-88e230bebeb4 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:22.634206 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767ff78-f651-413d-8fab-88e230bebeb4 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:22.640320 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1375088-f45d-4047-9a8b-04afb8ae98b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:22.640966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1375088-f45d-4047-9a8b-04afb8ae98b9 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:22.641290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1375088-f45d-4047-9a8b-04afb8ae98b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:22.641567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1375088-f45d-4047-9a8b-04afb8ae98b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:22.650415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1375088-f45d-4047-9a8b-04afb8ae98b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:22.652111 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1375088-f45d-4047-9a8b-04afb8ae98b9 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:22.662343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 758/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:01:26.758881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd9651-7b2f-470c-a956-634d6597c31b None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:26.759565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd9651-7b2f-470c-a956-634d6597c31b None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:26.759565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd9651-7b2f-470c-a956-634d6597c31b None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:26.760826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 15:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:01:26.766718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e34f7e-03ff-4651-bcad-2f809be1d904 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:26.767282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e34f7e-03ff-4651-bcad-2f809be1d904 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:26.767282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e34f7e-03ff-4651-bcad-2f809be1d904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:26.785976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-17e34f7e-03ff-4651-bcad-2f809be1d904 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:26.787221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-17e34f7e-03ff-4651-bcad-2f809be1d904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:26.795726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 15:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:01:26.833067 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd9651-7b2f-470c-a956-634d6597c31b None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:26.834992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-dcdd9651-7b2f-470c-a956-634d6597c31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:26.896975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd9651-7b2f-470c-a956-634d6597c31b None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:26.900597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d51bb-0149-424d-befa-951d2cc87e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:26.901460 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d51bb-0149-424d-befa-951d2cc87e61 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:26.901904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d51bb-0149-424d-befa-951d2cc87e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:26.902344 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d51bb-0149-424d-befa-951d2cc87e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:26.913750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d51bb-0149-424d-befa-951d2cc87e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:26.915197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d51bb-0149-424d-befa-951d2cc87e61 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:26.925603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 771/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:01:29.179833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e795f70-c186-4fdd-b96a-389a35047c5a None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:29.180364 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e795f70-c186-4fdd-b96a-389a35047c5a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:29.180479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e795f70-c186-4fdd-b96a-389a35047c5a None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:29.181850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 15:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:01:29.188300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce09e4-2e80-4942-a157-36a3f56ffa3d None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:29.188785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce09e4-2e80-4942-a157-36a3f56ffa3d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:29.188914 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce09e4-2e80-4942-a157-36a3f56ffa3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:29.207554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-07ce09e4-2e80-4942-a157-36a3f56ffa3d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:29.208781 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-07ce09e4-2e80-4942-a157-36a3f56ffa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:29.218196 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:01:29.257098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e795f70-c186-4fdd-b96a-389a35047c5a None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:29.268248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e795f70-c186-4fdd-b96a-389a35047c5a None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:29.271982 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90d86a-cdfa-43fe-abdb-6f10ab65a9ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:29.272637 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90d86a-cdfa-43fe-abdb-6f10ab65a9ab service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:29.272923 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90d86a-cdfa-43fe-abdb-6f10ab65a9ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:29.273229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90d86a-cdfa-43fe-abdb-6f10ab65a9ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:29.284122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90d86a-cdfa-43fe-abdb-6f10ab65a9ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:29.285597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90d86a-cdfa-43fe-abdb-6f10ab65a9ab service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:29.296109 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 761/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:01:33.291826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3747c-4a29-44f3-82f3-5e246cd94906 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:33.292393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3747c-4a29-44f3-82f3-5e246cd94906 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:33.292393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3747c-4a29-44f3-82f3-5e246cd94906 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:33.293710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 15:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:01:33.299929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed58ef-15a3-496e-9c35-7e760d53bf00 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:33.300398 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed58ef-15a3-496e-9c35-7e760d53bf00 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:33.300534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed58ef-15a3-496e-9c35-7e760d53bf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:33.318598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-47ed58ef-15a3-496e-9c35-7e760d53bf00 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:33.319822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-47ed58ef-15a3-496e-9c35-7e760d53bf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:33.327851 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 15:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:01:33.612395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3747c-4a29-44f3-82f3-5e246cd94906 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:33.614140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-7ac3747c-4a29-44f3-82f3-5e246cd94906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:33.619841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=75 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:33.672882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3747c-4a29-44f3-82f3-5e246cd94906 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:33.676493 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588c972-a623-4735-b04d-7d3d3b6d7e97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:33.677161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c972-a623-4735-b04d-7d3d3b6d7e97 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:33.677458 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c972-a623-4735-b04d-7d3d3b6d7e97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:33.677741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c972-a623-4735-b04d-7d3d3b6d7e97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:33.687213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588c972-a623-4735-b04d-7d3d3b6d7e97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:33.688700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588c972-a623-4735-b04d-7d3d3b6d7e97 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:33.698433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 774/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:01:35.897604 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3105075-ca66-437f-bf83-0b134a1e27e9 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:35.898186 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3105075-ca66-437f-bf83-0b134a1e27e9 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:35.898620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3105075-ca66-437f-bf83-0b134a1e27e9 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:35.901060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 15:01:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:01:35.906572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2749c7e-45a6-4f7c-85b9-aced013652f6 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:35.907051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2749c7e-45a6-4f7c-85b9-aced013652f6 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:35.907156 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2749c7e-45a6-4f7c-85b9-aced013652f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:35.925534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-f2749c7e-45a6-4f7c-85b9-aced013652f6 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:01:35.926778 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-f2749c7e-45a6-4f7c-85b9-aced013652f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:35.934659 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 15:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:01:36.205744 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3105075-ca66-437f-bf83-0b134a1e27e9 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:01:36.207739 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d3105075-ca66-437f-bf83-0b134a1e27e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:01:36.222254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3105075-ca66-437f-bf83-0b134a1e27e9 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:01:36.225957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d8086-c631-4c30-ae9d-434159c73570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:01:36.226700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8086-c631-4c30-ae9d-434159c73570 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:01:36.226984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8086-c631-4c30-ae9d-434159c73570 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:01:36.227266 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8086-c631-4c30-ae9d-434159c73570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:01:36.238154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d8086-c631-4c30-ae9d-434159c73570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:01:36.239628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d8086-c631-4c30-ae9d-434159c73570 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:01:36.250001 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 764/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:01:45.919960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=28 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:46.245435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=33 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:14.748303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91001953-42fa-43c0-b7f5-7129beb0ecd5 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:14.751898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91001953-42fa-43c0-b7f5-7129beb0ecd5 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:14.751898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91001953-42fa-43c0-b7f5-7129beb0ecd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:14.787223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-91001953-42fa-43c0-b7f5-7129beb0ecd5 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:14.793311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-91001953-42fa-43c0-b7f5-7129beb0ecd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:14.805556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 776/1540] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:03:14.816798 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97f34d-9d48-4176-b454-62ccd186e028 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:14.817439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97f34d-9d48-4176-b454-62ccd186e028 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:14.817439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97f34d-9d48-4176-b454-62ccd186e028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:14.849877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-3d97f34d-9d48-4176-b454-62ccd186e028 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:14.851572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3d97f34d-9d48-4176-b454-62ccd186e028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:14.864859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 765/1541] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:03:14.870753 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91001953-42fa-43c0-b7f5-7129beb0ecd5 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:14.901272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91001953-42fa-43c0-b7f5-7129beb0ecd5 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:14.915074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd01f1e-f308-4dac-8037-66486d667c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:14.916797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd01f1e-f308-4dac-8037-66486d667c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:14.918001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd01f1e-f308-4dac-8037-66486d667c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:14.918854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd01f1e-f308-4dac-8037-66486d667c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:14.921026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd01f1e-f308-4dac-8037-66486d667c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:14.921839 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd01f1e-f308-4dac-8037-66486d667c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:14.925428 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd01f1e-f308-4dac-8037-66486d667c33 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:14.932379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196fadd-ea89-474f-9c02-bf2ef94a4179 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:14.932379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196fadd-ea89-474f-9c02-bf2ef94a4179 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:14.932379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196fadd-ea89-474f-9c02-bf2ef94a4179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:14.959012 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 777/1542] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:03:14.977924 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-2196fadd-ea89-474f-9c02-bf2ef94a4179 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:14.981008 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2196fadd-ea89-474f-9c02-bf2ef94a4179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:14.986370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd01f1e-f308-4dac-8037-66486d667c33 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:14.996258 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 766/1543] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:15.007447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b165382-00f9-495f-aa41-44e0c9099080 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.007726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b165382-00f9-495f-aa41-44e0c9099080 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.007885 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b165382-00f9-495f-aa41-44e0c9099080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.012894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd01f1e-f308-4dac-8037-66486d667c33 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:15.032083 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f2d8e-a4d4-42f8-8577-92c9e16ce03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:15.033090 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f2d8e-a4d4-42f8-8577-92c9e16ce03c admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.033625 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f2d8e-a4d4-42f8-8577-92c9e16ce03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.034118 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f2d8e-a4d4-42f8-8577-92c9e16ce03c admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.035028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f2d8e-a4d4-42f8-8577-92c9e16ce03c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:15.036120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: WARNING py.warnings [None req-248f2d8e-a4d4-42f8-8577-92c9e16ce03c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 15:03:15.036120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: warnings.warn(msg) Jun 16 15:03:15.036120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: Jun 16 15:03:15.037374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f2d8e-a4d4-42f8-8577-92c9e16ce03c admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:15.052957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-9b165382-00f9-495f-aa41-44e0c9099080 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:15.054738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-9b165382-00f9-495f-aa41-44e0c9099080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:15.082151 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 767/1544] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:03:15.084587 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fac6f2-822a-43a2-a223-c81e2d39ff02 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.084886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fac6f2-822a-43a2-a223-c81e2d39ff02 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.085192 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fac6f2-822a-43a2-a223-c81e2d39ff02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.115889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-19fac6f2-822a-43a2-a223-c81e2d39ff02 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:15.117164 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-19fac6f2-822a-43a2-a223-c81e2d39ff02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:15.135658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 768/1545] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:15.137259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fac6f2-822a-43a2-a223-c81e2d39ff02 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:15.148651 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fac6f2-822a-43a2-a223-c81e2d39ff02 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:15.154057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa016c6-fbbb-420d-b730-58e877237c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:15.157823 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa016c6-fbbb-420d-b730-58e877237c89 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.157823 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa016c6-fbbb-420d-b730-58e877237c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.157823 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa016c6-fbbb-420d-b730-58e877237c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.157823 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa016c6-fbbb-420d-b730-58e877237c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:15.157823 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa016c6-fbbb-420d-b730-58e877237c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:15.158668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: WARNING py.warnings [None req-caa016c6-fbbb-420d-b730-58e877237c89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 15:03:15.158668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: warnings.warn(msg) Jun 16 15:03:15.158668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: Jun 16 15:03:15.165162 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa016c6-fbbb-420d-b730-58e877237c89 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:15.175500 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 769/1546] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:15.177107 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58819367-a549-4ee8-981a-a26d2dbdeb9d None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.177433 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58819367-a549-4ee8-981a-a26d2dbdeb9d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.177719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58819367-a549-4ee8-981a-a26d2dbdeb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.211365 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-58819367-a549-4ee8-981a-a26d2dbdeb9d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:15.213044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-58819367-a549-4ee8-981a-a26d2dbdeb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:15.214809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 778/1547] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:14 2022] POST /identity/v3/projects => generated 365 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:15.221184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17a4e5-ce43-443f-9925-b82070a09e72 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.221184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17a4e5-ce43-443f-9925-b82070a09e72 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.221184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17a4e5-ce43-443f-9925-b82070a09e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.241285 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-ff17a4e5-ce43-443f-9925-b82070a09e72 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:15.243102 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ff17a4e5-ce43-443f-9925-b82070a09e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:15.291843 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 770/1548] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:15.293627 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcdde4-7b8f-4749-a97f-2ef0ada7bb21 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.294158 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcdde4-7b8f-4749-a97f-2ef0ada7bb21 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.294667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcdde4-7b8f-4749-a97f-2ef0ada7bb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.319982 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-19fcdde4-7b8f-4749-a97f-2ef0ada7bb21 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:15.320623 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 779/1549] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:15.321299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-19fcdde4-7b8f-4749-a97f-2ef0ada7bb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:15.325223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17a4e5-ce43-443f-9925-b82070a09e72 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:15.331393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 771/1550] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:15.333960 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d190f3-79d7-4373-ae6d-909e10ce4df3 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.334254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d190f3-79d7-4373-ae6d-909e10ce4df3 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.334540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d190f3-79d7-4373-ae6d-909e10ce4df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.335900 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17a4e5-ce43-443f-9925-b82070a09e72 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:15.340583 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb04ef-4dae-42fb-8ac0-c0866d6fe9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:15.341292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb04ef-4dae-42fb-8ac0-c0866d6fe9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.341579 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb04ef-4dae-42fb-8ac0-c0866d6fe9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.341905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb04ef-4dae-42fb-8ac0-c0866d6fe9d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.342663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb04ef-4dae-42fb-8ac0-c0866d6fe9d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:15.344612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb04ef-4dae-42fb-8ac0-c0866d6fe9d7 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:15.353118 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-f9d190f3-79d7-4373-ae6d-909e10ce4df3 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:15.356784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f9d190f3-79d7-4373-ae6d-909e10ce4df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:15.363439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 772/1551] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:15.364297 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d190f3-79d7-4373-ae6d-909e10ce4df3 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:15.374674 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d190f3-79d7-4373-ae6d-909e10ce4df3 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:15.379473 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14f916-52ac-468d-ad16-e1cfe247672f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:15.380135 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14f916-52ac-468d-ad16-e1cfe247672f admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.380438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14f916-52ac-468d-ad16-e1cfe247672f admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.380705 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14f916-52ac-468d-ad16-e1cfe247672f admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.381441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14f916-52ac-468d-ad16-e1cfe247672f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:15.385406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: WARNING py.warnings [None req-9e14f916-52ac-468d-ad16-e1cfe247672f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 15:03:15.385406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: warnings.warn(msg) Jun 16 15:03:15.385406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: Jun 16 15:03:15.385406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14f916-52ac-468d-ad16-e1cfe247672f admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:15.510850 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 780/1552] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:15.512147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf526d26-ae31-4d8a-baca-76f45dfe32f5 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.512439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf526d26-ae31-4d8a-baca-76f45dfe32f5 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.512720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf526d26-ae31-4d8a-baca-76f45dfe32f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.530862 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-bf526d26-ae31-4d8a-baca-76f45dfe32f5 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:15.532072 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-bf526d26-ae31-4d8a-baca-76f45dfe32f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:15.554192 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 773/1553] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:15.554192 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fb813-2040-4769-bdc2-c6b69f6d0dee None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.554192 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fb813-2040-4769-bdc2-c6b69f6d0dee None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.554192 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fb813-2040-4769-bdc2-c6b69f6d0dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.572639 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-3b0fb813-2040-4769-bdc2-c6b69f6d0dee None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:15.573879 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3b0fb813-2040-4769-bdc2-c6b69f6d0dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:15.596140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 781/1554] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:15.597539 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0339d1-8473-415a-9646-6d8933c0ff65 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.597864 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0339d1-8473-415a-9646-6d8933c0ff65 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.598373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0339d1-8473-415a-9646-6d8933c0ff65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.616672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-6a0339d1-8473-415a-9646-6d8933c0ff65 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:15.617952 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6a0339d1-8473-415a-9646-6d8933c0ff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:15.629189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 782/1555] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:15.629189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dca2b-941f-47dc-89e4-7a0329329eed None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.629189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dca2b-941f-47dc-89e4-7a0329329eed None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.629189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dca2b-941f-47dc-89e4-7a0329329eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.646885 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 774/1556] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:15.648010 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fb813-2040-4769-bdc2-c6b69f6d0dee None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:15.652833 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-732dca2b-941f-47dc-89e4-7a0329329eed None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:15.654086 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-732dca2b-941f-47dc-89e4-7a0329329eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:15.659221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fb813-2040-4769-bdc2-c6b69f6d0dee None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:15.663157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 783/1557] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:15.663998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e207b75-72d4-4cfb-9cd0-d9040921adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:15.664402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82386b-09b8-40da-a5e0-860b815d8d7b None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.664761 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82386b-09b8-40da-a5e0-860b815d8d7b None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.664865 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e207b75-72d4-4cfb-9cd0-d9040921adf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.665043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82386b-09b8-40da-a5e0-860b815d8d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.665251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e207b75-72d4-4cfb-9cd0-d9040921adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.665359 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e207b75-72d4-4cfb-9cd0-d9040921adf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.666116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e207b75-72d4-4cfb-9cd0-d9040921adf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:15.666427 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e207b75-72d4-4cfb-9cd0-d9040921adf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:15.668281 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e207b75-72d4-4cfb-9cd0-d9040921adf3 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:15.681199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 775/1558] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:15.682019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e207b75-72d4-4cfb-9cd0-d9040921adf3 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:15.683227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-fd82386b-09b8-40da-a5e0-860b815d8d7b None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:15.684424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fd82386b-09b8-40da-a5e0-860b815d8d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:15.692541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 784/1559] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:15.693375 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82386b-09b8-40da-a5e0-860b815d8d7b None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:15.693509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e207b75-72d4-4cfb-9cd0-d9040921adf3 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:15.698410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fa0db-adae-49f5-8206-c4e4818aee30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:15.699133 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fa0db-adae-49f5-8206-c4e4818aee30 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.699481 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fa0db-adae-49f5-8206-c4e4818aee30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.699759 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fa0db-adae-49f5-8206-c4e4818aee30 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.700444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fa0db-adae-49f5-8206-c4e4818aee30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:15.703033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8fa0db-adae-49f5-8206-c4e4818aee30 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:15.703159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82386b-09b8-40da-a5e0-860b815d8d7b None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:15.708203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb052e-2947-4efb-8cf3-89f28c346299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:15.708858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb052e-2947-4efb-8cf3-89f28c346299 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.709160 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb052e-2947-4efb-8cf3-89f28c346299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.709444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb052e-2947-4efb-8cf3-89f28c346299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.710173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb052e-2947-4efb-8cf3-89f28c346299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:15.712034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb052e-2947-4efb-8cf3-89f28c346299 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:15.723005 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 785/1560] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:15.724245 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23476b9f-669e-4c57-a3a3-df110f31fd30 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.724540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23476b9f-669e-4c57-a3a3-df110f31fd30 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.724823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23476b9f-669e-4c57-a3a3-df110f31fd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.737510 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:15.742840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-23476b9f-669e-4c57-a3a3-df110f31fd30 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:15.744038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-23476b9f-669e-4c57-a3a3-df110f31fd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:15.752349 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 786/1561] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:15.753552 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b43c4d-9bca-4558-89e1-50fc5bd0c3c5 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.753849 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b43c4d-9bca-4558-89e1-50fc5bd0c3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.754135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b43c4d-9bca-4558-89e1-50fc5bd0c3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.771729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-29b43c4d-9bca-4558-89e1-50fc5bd0c3c5 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:15.772901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-29b43c4d-9bca-4558-89e1-50fc5bd0c3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:15.780828 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 787/1562] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:15.781616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b43c4d-9bca-4558-89e1-50fc5bd0c3c5 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:15.790534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b43c4d-9bca-4558-89e1-50fc5bd0c3c5 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:15.795092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07186ffa-d616-46b6-9aca-c67fbf32232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:15.795732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07186ffa-d616-46b6-9aca-c67fbf32232f admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.796017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07186ffa-d616-46b6-9aca-c67fbf32232f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.796301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07186ffa-d616-46b6-9aca-c67fbf32232f admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.797025 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07186ffa-d616-46b6-9aca-c67fbf32232f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:15.797367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07186ffa-d616-46b6-9aca-c67fbf32232f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:15.798960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07186ffa-d616-46b6-9aca-c67fbf32232f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:15.812486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 788/1563] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:15.813338 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07186ffa-d616-46b6-9aca-c67fbf32232f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:15.822710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07186ffa-d616-46b6-9aca-c67fbf32232f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:15.827869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678bc6f-ff24-4e6e-981e-5f4083be3f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:15.828497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678bc6f-ff24-4e6e-981e-5f4083be3f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.828782 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678bc6f-ff24-4e6e-981e-5f4083be3f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.829061 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678bc6f-ff24-4e6e-981e-5f4083be3f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.829803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678bc6f-ff24-4e6e-981e-5f4083be3f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:15.830111 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678bc6f-ff24-4e6e-981e-5f4083be3f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:15.831689 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678bc6f-ff24-4e6e-981e-5f4083be3f34 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:15.837850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:15.846530 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 776/1564] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:15.846720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 789/1565] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:15.846843 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fa0db-adae-49f5-8206-c4e4818aee30 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:15.846938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678bc6f-ff24-4e6e-981e-5f4083be3f34 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:15.857250 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fa0db-adae-49f5-8206-c4e4818aee30 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:15.858417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678bc6f-ff24-4e6e-981e-5f4083be3f34 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:15.861850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb885bf-8cb7-41db-beb3-fb4f2ae0f3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:15.862510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb885bf-8cb7-41db-beb3-fb4f2ae0f3da admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.862800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb885bf-8cb7-41db-beb3-fb4f2ae0f3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.863080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb885bf-8cb7-41db-beb3-fb4f2ae0f3da admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.863208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a266b-52b3-4b00-aab4-05f8fe403f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:15.863772 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb885bf-8cb7-41db-beb3-fb4f2ae0f3da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:15.863962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a266b-52b3-4b00-aab4-05f8fe403f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.864254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a266b-52b3-4b00-aab4-05f8fe403f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.864537 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a266b-52b3-4b00-aab4-05f8fe403f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.865371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a266b-52b3-4b00-aab4-05f8fe403f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:15.865668 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a266b-52b3-4b00-aab4-05f8fe403f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:15.865782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb885bf-8cb7-41db-beb3-fb4f2ae0f3da admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:15.867286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a266b-52b3-4b00-aab4-05f8fe403f43 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:15.879816 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 790/1566] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:15.880623 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a266b-52b3-4b00-aab4-05f8fe403f43 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:15.896118 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a266b-52b3-4b00-aab4-05f8fe403f43 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:15.900797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cff69d-44be-4f99-bb8e-d57340e11877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:15.901557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cff69d-44be-4f99-bb8e-d57340e11877 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.901851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cff69d-44be-4f99-bb8e-d57340e11877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.902137 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cff69d-44be-4f99-bb8e-d57340e11877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.902886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cff69d-44be-4f99-bb8e-d57340e11877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:15.905027 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cff69d-44be-4f99-bb8e-d57340e11877 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:15.915353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 791/1567] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:15.916276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cff69d-44be-4f99-bb8e-d57340e11877 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:15.926418 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cff69d-44be-4f99-bb8e-d57340e11877 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:15.931002 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c54fa-1d0e-4e50-b8a0-023984794ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:15.933628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c54fa-1d0e-4e50-b8a0-023984794ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.933628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c54fa-1d0e-4e50-b8a0-023984794ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.933628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c54fa-1d0e-4e50-b8a0-023984794ac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.933628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c54fa-1d0e-4e50-b8a0-023984794ac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:15.933628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c54fa-1d0e-4e50-b8a0-023984794ac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:15.934803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c54fa-1d0e-4e50-b8a0-023984794ac4 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:15.946273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 792/1568] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:15.947269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c54fa-1d0e-4e50-b8a0-023984794ac4 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:15.957078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c54fa-1d0e-4e50-b8a0-023984794ac4 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:15.961752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd78e6b-b8dd-4b4b-8b60-65754eb612ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:15.962395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd78e6b-b8dd-4b4b-8b60-65754eb612ab admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:15.962686 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd78e6b-b8dd-4b4b-8b60-65754eb612ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:15.962969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd78e6b-b8dd-4b4b-8b60-65754eb612ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:15.963690 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd78e6b-b8dd-4b4b-8b60-65754eb612ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:15.964000 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd78e6b-b8dd-4b4b-8b60-65754eb612ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:15.965652 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd78e6b-b8dd-4b4b-8b60-65754eb612ab admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:15.974235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 777/1569] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:15.978179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb885bf-8cb7-41db-beb3-fb4f2ae0f3da admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:15.978912 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 793/1570] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:15.979790 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd78e6b-b8dd-4b4b-8b60-65754eb612ab admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:15.992350 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd78e6b-b8dd-4b4b-8b60-65754eb612ab admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:16.049344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb885bf-8cb7-41db-beb3-fb4f2ae0f3da admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:16.053190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f8619-7356-4a0c-8ef8-6c6c4111103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:16.054248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4037c-d2c6-4a5d-b4b4-7d27c8fbc990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:16.054374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8619-7356-4a0c-8ef8-6c6c4111103e admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:16.054561 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8619-7356-4a0c-8ef8-6c6c4111103e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:16.054834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8619-7356-4a0c-8ef8-6c6c4111103e admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:16.054949 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4037c-d2c6-4a5d-b4b4-7d27c8fbc990 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:16.055195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4037c-d2c6-4a5d-b4b4-7d27c8fbc990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:16.055475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4037c-d2c6-4a5d-b4b4-7d27c8fbc990 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:16.055575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f8619-7356-4a0c-8ef8-6c6c4111103e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:16.056177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4037c-d2c6-4a5d-b4b4-7d27c8fbc990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:16.057184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f8619-7356-4a0c-8ef8-6c6c4111103e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:16.058252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4037c-d2c6-4a5d-b4b4-7d27c8fbc990 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:16.068065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 794/1571] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:16.068612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f8619-7356-4a0c-8ef8-6c6c4111103e admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:16.078717 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f8619-7356-4a0c-8ef8-6c6c4111103e admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:16.083447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfdcd3-57e1-4d4f-bf9f-97dd7948f91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:16.084100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfdcd3-57e1-4d4f-bf9f-97dd7948f91f admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:16.084388 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfdcd3-57e1-4d4f-bf9f-97dd7948f91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:16.084669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfdcd3-57e1-4d4f-bf9f-97dd7948f91f admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:16.085416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfdcd3-57e1-4d4f-bf9f-97dd7948f91f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:16.087368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfdcd3-57e1-4d4f-bf9f-97dd7948f91f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:16.200646 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 778/1572] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:15 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:16.200646 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4037c-d2c6-4a5d-b4b4-7d27c8fbc990 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:16.249210 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 795/1573] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:16 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:16.250153 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfdcd3-57e1-4d4f-bf9f-97dd7948f91f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:16.263978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4037c-d2c6-4a5d-b4b4-7d27c8fbc990 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:16.301520 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:16.313273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfdcd3-57e1-4d4f-bf9f-97dd7948f91f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:16.318038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6672763-fbdd-44e7-9de8-e4a5bb0fc66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:16.318985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6672763-fbdd-44e7-9de8-e4a5bb0fc66b admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:16.319217 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6672763-fbdd-44e7-9de8-e4a5bb0fc66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:16.319498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6672763-fbdd-44e7-9de8-e4a5bb0fc66b admin admin] PATH_INFO: `/v3/projects/ccd1cf1ca65c44af9dc3dcd4f85c2586/users/cb882ac10e17437fbb12844913d0026c/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:16.322268 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3f187-b966-4de1-9568-1815fd0e3610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:16.322917 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f187-b966-4de1-9568-1815fd0e3610 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:16.323208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f187-b966-4de1-9568-1815fd0e3610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:16.323494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3f187-b966-4de1-9568-1815fd0e3610 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:16.324339 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3f187-b966-4de1-9568-1815fd0e3610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:16.326452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3f187-b966-4de1-9568-1815fd0e3610 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:16.336064 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6672763-fbdd-44e7-9de8-e4a5bb0fc66b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd1cf1ca65c44af9dc3dcd4f85c2586, user_id=cb882ac10e17437fbb12844913d0026c, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:16.337165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: WARNING py.warnings [None req-a6672763-fbdd-44e7-9de8-e4a5bb0fc66b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 15:03:16.337165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: warnings.warn(msg) Jun 16 15:03:16.337165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: Jun 16 15:03:16.339079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6672763-fbdd-44e7-9de8-e4a5bb0fc66b admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:16.341491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:16.511815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 796/1574] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:16 2022] PUT /identity/v3/projects/ccd1cf1ca65c44af9dc3dcd4f85c2586/users/cb882ac10e17437fbb12844913d0026c/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:16.511815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6672763-fbdd-44e7-9de8-e4a5bb0fc66b admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:16.512123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 779/1575] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:16 2022] POST /identity/v3/projects => generated 377 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:16.512123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3f187-b966-4de1-9568-1815fd0e3610 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:16.573094 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3f187-b966-4de1-9568-1815fd0e3610 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:16.573807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6672763-fbdd-44e7-9de8-e4a5bb0fc66b admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:16.578982 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dff082-7010-4fef-8e08-cb5bcb06c8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:16.579313 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67bcc0-3fc1-441c-aa6a-2ce8825ef2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:16.579700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff082-7010-4fef-8e08-cb5bcb06c8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:16.579978 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67bcc0-3fc1-441c-aa6a-2ce8825ef2eb admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:16.580090 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff082-7010-4fef-8e08-cb5bcb06c8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:16.580274 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67bcc0-3fc1-441c-aa6a-2ce8825ef2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:16.580435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff082-7010-4fef-8e08-cb5bcb06c8c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:16.580590 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67bcc0-3fc1-441c-aa6a-2ce8825ef2eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:16.581229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dff082-7010-4fef-8e08-cb5bcb06c8c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:16.581350 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67bcc0-3fc1-441c-aa6a-2ce8825ef2eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:16.583223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67bcc0-3fc1-441c-aa6a-2ce8825ef2eb admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:16.583342 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dff082-7010-4fef-8e08-cb5bcb06c8c0 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:16.739199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 780/1576] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:16 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:16.740517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dff082-7010-4fef-8e08-cb5bcb06c8c0 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:16.752089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dff082-7010-4fef-8e08-cb5bcb06c8c0 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:16.753731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 797/1577] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:16 2022] POST /identity/v3/projects => generated 379 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:16.754583 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67bcc0-3fc1-441c-aa6a-2ce8825ef2eb admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:16.810210 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde7f9f-0a84-4c4e-92c2-ae32bed9d446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:16.811616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde7f9f-0a84-4c4e-92c2-ae32bed9d446 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:16.811616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde7f9f-0a84-4c4e-92c2-ae32bed9d446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:16.811616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde7f9f-0a84-4c4e-92c2-ae32bed9d446 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:16.812147 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde7f9f-0a84-4c4e-92c2-ae32bed9d446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:16.814112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde7f9f-0a84-4c4e-92c2-ae32bed9d446 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:16.821166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67bcc0-3fc1-441c-aa6a-2ce8825ef2eb admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:16.826420 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadf086-176a-4606-bcb6-21bd0ac08e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:16.827440 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadf086-176a-4606-bcb6-21bd0ac08e08 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:16.827731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadf086-176a-4606-bcb6-21bd0ac08e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:16.828013 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadf086-176a-4606-bcb6-21bd0ac08e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:16.828751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadf086-176a-4606-bcb6-21bd0ac08e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:16.830383 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadf086-176a-4606-bcb6-21bd0ac08e08 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:16.840394 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 798/1578] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:16.841241 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadf086-176a-4606-bcb6-21bd0ac08e08 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:16.852145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadf086-176a-4606-bcb6-21bd0ac08e08 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:16.856967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acfac8-e783-4977-999f-8ca58e04ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:16.863246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acfac8-e783-4977-999f-8ca58e04ddb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:16.863246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acfac8-e783-4977-999f-8ca58e04ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:16.863246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acfac8-e783-4977-999f-8ca58e04ddb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:16.863246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acfac8-e783-4977-999f-8ca58e04ddb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:16.863246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acfac8-e783-4977-999f-8ca58e04ddb2 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:16.946292 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 781/1579] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:16 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:16.947115 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde7f9f-0a84-4c4e-92c2-ae32bed9d446 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:16.984189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 799/1580] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:16 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:16.984189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acfac8-e783-4977-999f-8ca58e04ddb2 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:16.990629 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acfac8-e783-4977-999f-8ca58e04ddb2 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.013573 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde7f9f-0a84-4c4e-92c2-ae32bed9d446 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.020319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2edf9-a506-4022-98a9-1d34b7781209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.020999 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2edf9-a506-4022-98a9-1d34b7781209 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.021393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2edf9-a506-4022-98a9-1d34b7781209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.021682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2edf9-a506-4022-98a9-1d34b7781209 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.022381 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2edf9-a506-4022-98a9-1d34b7781209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.024336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2edf9-a506-4022-98a9-1d34b7781209 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.027742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:17.051631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cc5da-9886-4965-8920-caa7dc46bdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.052369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cc5da-9886-4965-8920-caa7dc46bdfd admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.052585 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cc5da-9886-4965-8920-caa7dc46bdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.058359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cc5da-9886-4965-8920-caa7dc46bdfd admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.058359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6cc5da-9886-4965-8920-caa7dc46bdfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.058359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6cc5da-9886-4965-8920-caa7dc46bdfd admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.146253 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:17.154289 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 782/1581] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:16 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:17.154289 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07e6f8-ef02-4e8c-b5ff-0d0a6612013f None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.154289 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07e6f8-ef02-4e8c-b5ff-0d0a6612013f None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.154289 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07e6f8-ef02-4e8c-b5ff-0d0a6612013f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.179578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-cd07e6f8-ef02-4e8c-b5ff-0d0a6612013f None None] MFA Rules not processed for user `cb882ac10e17437fbb12844913d0026c`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:17.180796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-cd07e6f8-ef02-4e8c-b5ff-0d0a6612013f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:17.190808 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 800/1582] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:16 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:17.191484 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cc5da-9886-4965-8920-caa7dc46bdfd admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.200949 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cc5da-9886-4965-8920-caa7dc46bdfd admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.206496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059668f1-470f-49a0-9b7c-14c6349397bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.207158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059668f1-470f-49a0-9b7c-14c6349397bb admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.207444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059668f1-470f-49a0-9b7c-14c6349397bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.207720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059668f1-470f-49a0-9b7c-14c6349397bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.208480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059668f1-470f-49a0-9b7c-14c6349397bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.210118 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059668f1-470f-49a0-9b7c-14c6349397bb admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.220743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 801/1583] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:17.221580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059668f1-470f-49a0-9b7c-14c6349397bb admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.231577 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059668f1-470f-49a0-9b7c-14c6349397bb admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.237723 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995333b-a7d8-4a1b-a3b2-87b657ea061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.237867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995333b-a7d8-4a1b-a3b2-87b657ea061e admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.238069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995333b-a7d8-4a1b-a3b2-87b657ea061e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.238345 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995333b-a7d8-4a1b-a3b2-87b657ea061e admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.239073 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995333b-a7d8-4a1b-a3b2-87b657ea061e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.241193 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995333b-a7d8-4a1b-a3b2-87b657ea061e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.249992 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 783/1584] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:17.253028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07e6f8-ef02-4e8c-b5ff-0d0a6612013f None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.263929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07e6f8-ef02-4e8c-b5ff-0d0a6612013f None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.268569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd277e3c-ddeb-4e7d-9524-a9bd78c5d848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.269518 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd277e3c-ddeb-4e7d-9524-a9bd78c5d848 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.269807 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd277e3c-ddeb-4e7d-9524-a9bd78c5d848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.278030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd277e3c-ddeb-4e7d-9524-a9bd78c5d848 admin admin] PATH_INFO: `/v3/projects/65b33bec47c34bf19a23b28f5db7696b/users/b970e6cc62d14619b0df478574755d6d/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.287065 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd277e3c-ddeb-4e7d-9524-a9bd78c5d848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b33bec47c34bf19a23b28f5db7696b, user_id=b970e6cc62d14619b0df478574755d6d, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.289769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd277e3c-ddeb-4e7d-9524-a9bd78c5d848 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.361102 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 802/1585] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:17 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:17.361988 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995333b-a7d8-4a1b-a3b2-87b657ea061e admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.371365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995333b-a7d8-4a1b-a3b2-87b657ea061e admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.376054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad93a8-579e-46ef-a92b-be7535a05eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.376711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad93a8-579e-46ef-a92b-be7535a05eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.376999 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad93a8-579e-46ef-a92b-be7535a05eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.377314 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad93a8-579e-46ef-a92b-be7535a05eb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.378030 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad93a8-579e-46ef-a92b-be7535a05eb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.379999 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad93a8-579e-46ef-a92b-be7535a05eb0 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.412687 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 784/1586] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:17 2022] PUT /identity/v3/projects/65b33bec47c34bf19a23b28f5db7696b/users/b970e6cc62d14619b0df478574755d6d/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:17.413484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd277e3c-ddeb-4e7d-9524-a9bd78c5d848 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.478745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd277e3c-ddeb-4e7d-9524-a9bd78c5d848 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.484269 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617ff25-79fa-4176-a198-7340c55a3256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.484935 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617ff25-79fa-4176-a198-7340c55a3256 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.485258 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617ff25-79fa-4176-a198-7340c55a3256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.485539 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617ff25-79fa-4176-a198-7340c55a3256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.486307 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617ff25-79fa-4176-a198-7340c55a3256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.487891 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617ff25-79fa-4176-a198-7340c55a3256 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.497698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 785/1587] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:17.498515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617ff25-79fa-4176-a198-7340c55a3256 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.505187 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 803/1588] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:17 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:17.506130 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad93a8-579e-46ef-a92b-be7535a05eb0 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.511846 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617ff25-79fa-4176-a198-7340c55a3256 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.516289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad93a8-579e-46ef-a92b-be7535a05eb0 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.518688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de846a-bef1-4e96-a29c-eb68bd5b3232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.518688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de846a-bef1-4e96-a29c-eb68bd5b3232 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.518688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de846a-bef1-4e96-a29c-eb68bd5b3232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.518688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de846a-bef1-4e96-a29c-eb68bd5b3232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.519341 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de846a-bef1-4e96-a29c-eb68bd5b3232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.520900 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11b02c-eec9-4e12-8be5-e18151686708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.521048 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de846a-bef1-4e96-a29c-eb68bd5b3232 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.521578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11b02c-eec9-4e12-8be5-e18151686708 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.521866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11b02c-eec9-4e12-8be5-e18151686708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.522140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11b02c-eec9-4e12-8be5-e18151686708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.522855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11b02c-eec9-4e12-8be5-e18151686708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.524542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11b02c-eec9-4e12-8be5-e18151686708 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.532217 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 786/1589] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:17.533119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de846a-bef1-4e96-a29c-eb68bd5b3232 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.535750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 804/1590] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:17.536412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11b02c-eec9-4e12-8be5-e18151686708 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.544126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de846a-bef1-4e96-a29c-eb68bd5b3232 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.549515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b802e5-7ab6-471b-9144-0b651f6f17c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.550154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b802e5-7ab6-471b-9144-0b651f6f17c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.550444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b802e5-7ab6-471b-9144-0b651f6f17c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.550720 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b802e5-7ab6-471b-9144-0b651f6f17c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.551433 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b802e5-7ab6-471b-9144-0b651f6f17c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.553025 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b802e5-7ab6-471b-9144-0b651f6f17c1 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.563109 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 787/1591] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:17.563972 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b802e5-7ab6-471b-9144-0b651f6f17c1 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.573334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b802e5-7ab6-471b-9144-0b651f6f17c1 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.577888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99fb35-264e-44d0-9aa2-532d232931ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.578881 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99fb35-264e-44d0-9aa2-532d232931ed admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.578881 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99fb35-264e-44d0-9aa2-532d232931ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.579114 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99fb35-264e-44d0-9aa2-532d232931ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.579764 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99fb35-264e-44d0-9aa2-532d232931ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.581476 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99fb35-264e-44d0-9aa2-532d232931ed admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.591746 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 788/1592] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:17.593509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79682622-c482-41d9-bb9d-d2c922c87dfe None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.593794 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79682622-c482-41d9-bb9d-d2c922c87dfe None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.594069 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79682622-c482-41d9-bb9d-d2c922c87dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.594731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11b02c-eec9-4e12-8be5-e18151686708 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.598304 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d322324-ffaa-4d6e-a96e-4527aeb59dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.599028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d322324-ffaa-4d6e-a96e-4527aeb59dbd service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.599329 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d322324-ffaa-4d6e-a96e-4527aeb59dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.599595 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d322324-ffaa-4d6e-a96e-4527aeb59dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.620590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-79682622-c482-41d9-bb9d-d2c922c87dfe None None] MFA Rules not processed for user `b970e6cc62d14619b0df478574755d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:17.621817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-79682622-c482-41d9-bb9d-d2c922c87dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:17.640387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:17.658784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d322324-ffaa-4d6e-a96e-4527aeb59dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.660452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d322324-ffaa-4d6e-a96e-4527aeb59dbd service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.669532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 805/1593] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:17.670827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d322324-ffaa-4d6e-a96e-4527aeb59dbd service cinder] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.681863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d322324-ffaa-4d6e-a96e-4527aeb59dbd service cinder] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.687613 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1e224-985a-486f-ae5b-7a7fd00bb6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.688615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1e224-985a-486f-ae5b-7a7fd00bb6bf admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.689197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1e224-985a-486f-ae5b-7a7fd00bb6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.689630 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1e224-985a-486f-ae5b-7a7fd00bb6bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.690296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1e224-985a-486f-ae5b-7a7fd00bb6bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.691932 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1e224-985a-486f-ae5b-7a7fd00bb6bf admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.692409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 789/1594] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:17.693100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79682622-c482-41d9-bb9d-d2c922c87dfe None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.706628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 806/1595] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:17.706779 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79682622-c482-41d9-bb9d-d2c922c87dfe None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.706879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1e224-985a-486f-ae5b-7a7fd00bb6bf admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.710251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127211ce-2647-425c-aef0-298091420a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.710925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127211ce-2647-425c-aef0-298091420a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.711217 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127211ce-2647-425c-aef0-298091420a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.711496 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127211ce-2647-425c-aef0-298091420a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.712221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127211ce-2647-425c-aef0-298091420a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.713963 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127211ce-2647-425c-aef0-298091420a75 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.716785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1e224-985a-486f-ae5b-7a7fd00bb6bf admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.721821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed96d29-b0c0-40ac-9894-f8f1e6124702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.722497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed96d29-b0c0-40ac-9894-f8f1e6124702 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.722791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed96d29-b0c0-40ac-9894-f8f1e6124702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.723077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed96d29-b0c0-40ac-9894-f8f1e6124702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.723816 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed96d29-b0c0-40ac-9894-f8f1e6124702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.725616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed96d29-b0c0-40ac-9894-f8f1e6124702 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.727826 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 790/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:17.728898 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127211ce-2647-425c-aef0-298091420a75 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.737402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 807/1597] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:17.738271 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed96d29-b0c0-40ac-9894-f8f1e6124702 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.743227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127211ce-2647-425c-aef0-298091420a75 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.743897 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:17.749612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed96d29-b0c0-40ac-9894-f8f1e6124702 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.750056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67103fa-4b50-4c5f-a505-580e011ce98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.750733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67103fa-4b50-4c5f-a505-580e011ce98e admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.751017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67103fa-4b50-4c5f-a505-580e011ce98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.751516 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67103fa-4b50-4c5f-a505-580e011ce98e admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.752617 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67103fa-4b50-4c5f-a505-580e011ce98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.754746 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67103fa-4b50-4c5f-a505-580e011ce98e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.756499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876110af-3d8b-42b6-8565-6c811ec29d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.756977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876110af-3d8b-42b6-8565-6c811ec29d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.757376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876110af-3d8b-42b6-8565-6c811ec29d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.757491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876110af-3d8b-42b6-8565-6c811ec29d44 admin admin] PATH_INFO: `/v3/projects/dcb5e5133cbb44c197ed2c06a578029f/users/0d3510e93cba44078ede0016f88d1032/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.771482 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 791/1598] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:17.773075 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67103fa-4b50-4c5f-a505-580e011ce98e admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.775663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876110af-3d8b-42b6-8565-6c811ec29d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb5e5133cbb44c197ed2c06a578029f, user_id=0d3510e93cba44078ede0016f88d1032, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.778625 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876110af-3d8b-42b6-8565-6c811ec29d44 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.787431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67103fa-4b50-4c5f-a505-580e011ce98e admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.792170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cac5c9-8ad8-4649-a73a-f8c4dffb87ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.792848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cac5c9-8ad8-4649-a73a-f8c4dffb87ec admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.793263 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cac5c9-8ad8-4649-a73a-f8c4dffb87ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.793550 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cac5c9-8ad8-4649-a73a-f8c4dffb87ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.794282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cac5c9-8ad8-4649-a73a-f8c4dffb87ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.795930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cac5c9-8ad8-4649-a73a-f8c4dffb87ec admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.806909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 792/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:17.807708 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cac5c9-8ad8-4649-a73a-f8c4dffb87ec admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.821092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cac5c9-8ad8-4649-a73a-f8c4dffb87ec admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.826968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ee7e8-c224-4a02-ab1e-f2fefd2ce2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.827904 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ee7e8-c224-4a02-ab1e-f2fefd2ce2df admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.828189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ee7e8-c224-4a02-ab1e-f2fefd2ce2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.828505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ee7e8-c224-4a02-ab1e-f2fefd2ce2df admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.829358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ee7e8-c224-4a02-ab1e-f2fefd2ce2df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.831354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ee7e8-c224-4a02-ab1e-f2fefd2ce2df admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:17.896473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 808/1600] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:17 2022] PUT /identity/v3/projects/dcb5e5133cbb44c197ed2c06a578029f/users/0d3510e93cba44078ede0016f88d1032/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:17.897815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876110af-3d8b-42b6-8565-6c811ec29d44 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:17.971472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876110af-3d8b-42b6-8565-6c811ec29d44 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:17.977432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdba6b-b42b-4a2a-a92a-da12c0635994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:17.978641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdba6b-b42b-4a2a-a92a-da12c0635994 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:17.979009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdba6b-b42b-4a2a-a92a-da12c0635994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:17.979346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdba6b-b42b-4a2a-a92a-da12c0635994 admin admin] PATH_INFO: `/v3/projects/6f72325fb32840f1bcf296f6b2ea6e38/users/538cc13998f14a3ba870184f18648526/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:17.996015 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdba6b-b42b-4a2a-a92a-da12c0635994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f72325fb32840f1bcf296f6b2ea6e38, user_id=538cc13998f14a3ba870184f18648526, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:17.999359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdba6b-b42b-4a2a-a92a-da12c0635994 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:18.008978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 793/1601] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:17 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:18.015288 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ee7e8-c224-4a02-ab1e-f2fefd2ce2df admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:18.087940 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ee7e8-c224-4a02-ab1e-f2fefd2ce2df admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:18.093159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4546f36-e25c-4f67-9808-1f30e60e61b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:18.103810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4546f36-e25c-4f67-9808-1f30e60e61b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:18.103810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4546f36-e25c-4f67-9808-1f30e60e61b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:18.103810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4546f36-e25c-4f67-9808-1f30e60e61b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:18.103810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4546f36-e25c-4f67-9808-1f30e60e61b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:18.103810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4546f36-e25c-4f67-9808-1f30e60e61b3 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:18.108210 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 794/1602] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:18.109093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4546f36-e25c-4f67-9808-1f30e60e61b3 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:18.119304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4546f36-e25c-4f67-9808-1f30e60e61b3 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:18.124942 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf7b13-b036-435c-9f14-8daf3b9003c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:18.125889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf7b13-b036-435c-9f14-8daf3b9003c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:18.126175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf7b13-b036-435c-9f14-8daf3b9003c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:18.126461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf7b13-b036-435c-9f14-8daf3b9003c0 admin admin] PATH_INFO: `/v3/projects/ca26c89d8c6e43b6a5a8aaaf66e291d7/users/46e1408cf45241208f6c7f485fb4a182/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:18.130149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 809/1603] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:17 2022] PUT /identity/v3/projects/6f72325fb32840f1bcf296f6b2ea6e38/users/538cc13998f14a3ba870184f18648526/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:18.138621 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdba6b-b42b-4a2a-a92a-da12c0635994 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:18.147676 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf7b13-b036-435c-9f14-8daf3b9003c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca26c89d8c6e43b6a5a8aaaf66e291d7, user_id=46e1408cf45241208f6c7f485fb4a182, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:18.150453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf7b13-b036-435c-9f14-8daf3b9003c0 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:18.209343 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdba6b-b42b-4a2a-a92a-da12c0635994 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:18.209343 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea400680-9722-44ae-8190-4b28ed848d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:18.210057 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea400680-9722-44ae-8190-4b28ed848d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:18.210340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea400680-9722-44ae-8190-4b28ed848d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:18.210617 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea400680-9722-44ae-8190-4b28ed848d13 admin admin] PATH_INFO: `/v3/projects/1a388229f5bf43b5a8b64963bd847567/users/f6683ab715b3452a8a79b89be6b3bfce/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:18.227142 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea400680-9722-44ae-8190-4b28ed848d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a388229f5bf43b5a8b64963bd847567, user_id=f6683ab715b3452a8a79b89be6b3bfce, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:18.229861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea400680-9722-44ae-8190-4b28ed848d13 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:18.282384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 795/1604] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:18 2022] PUT /identity/v3/projects/ca26c89d8c6e43b6a5a8aaaf66e291d7/users/46e1408cf45241208f6c7f485fb4a182/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:18.283492 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf7b13-b036-435c-9f14-8daf3b9003c0 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:18.327405 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:18.350530 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf7b13-b036-435c-9f14-8daf3b9003c0 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:18.355514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0650a-c35a-435d-bc5e-e17436ed194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:18.356681 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0650a-c35a-435d-bc5e-e17436ed194d admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:18.356967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0650a-c35a-435d-bc5e-e17436ed194d admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:18.357280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0650a-c35a-435d-bc5e-e17436ed194d admin admin] PATH_INFO: `/v3/projects/4ede9f5444c04b27b2ca855f5b1aaef2/users/cf1ea7fd030a423e8a80f0ad6208b7d2/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:18.368861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 810/1605] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:18 2022] PUT /identity/v3/projects/1a388229f5bf43b5a8b64963bd847567/users/f6683ab715b3452a8a79b89be6b3bfce/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:18.375431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d6f4d-e8de-4659-b3f2-191079665884 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:18.375431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d6f4d-e8de-4659-b3f2-191079665884 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:18.375431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d6f4d-e8de-4659-b3f2-191079665884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:18.375758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0650a-c35a-435d-bc5e-e17436ed194d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ede9f5444c04b27b2ca855f5b1aaef2, user_id=cf1ea7fd030a423e8a80f0ad6208b7d2, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:18.377348 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0650a-c35a-435d-bc5e-e17436ed194d admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:18.393528 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-282d6f4d-e8de-4659-b3f2-191079665884 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:18.394759 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-282d6f4d-e8de-4659-b3f2-191079665884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:18.441709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:18.460961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 811/1606] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:18.462027 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d6f4d-e8de-4659-b3f2-191079665884 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:18.477991 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d6f4d-e8de-4659-b3f2-191079665884 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:18.483406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e844ae-4908-4740-bd98-6c47f5658dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:18.484083 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e844ae-4908-4740-bd98-6c47f5658dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:18.484376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e844ae-4908-4740-bd98-6c47f5658dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:18.484662 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e844ae-4908-4740-bd98-6c47f5658dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:18.485411 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e844ae-4908-4740-bd98-6c47f5658dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:18.487369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e844ae-4908-4740-bd98-6c47f5658dc0 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:18.636398 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 796/1607] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:18 2022] PUT /identity/v3/projects/4ede9f5444c04b27b2ca855f5b1aaef2/users/cf1ea7fd030a423e8a80f0ad6208b7d2/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:18.637248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0650a-c35a-435d-bc5e-e17436ed194d admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:18.701663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 812/1608] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:18 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:18.701957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0650a-c35a-435d-bc5e-e17436ed194d admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:18.703088 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb46d1-23f2-49b5-9f3f-9804b3721207 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:18.703385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb46d1-23f2-49b5-9f3f-9804b3721207 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:18.703679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb46d1-23f2-49b5-9f3f-9804b3721207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:18.707056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1634f-1d0a-4e69-84c2-381ff56b4386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:18.707995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1634f-1d0a-4e69-84c2-381ff56b4386 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:18.708249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1634f-1d0a-4e69-84c2-381ff56b4386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:18.708528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1634f-1d0a-4e69-84c2-381ff56b4386 admin admin] PATH_INFO: `/v3/projects/5c35633b627b4a8482f86692d3d706a9/users/42bbdf56f24946da8b78f5f6227090bf/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:18.723686 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-b8eb46d1-23f2-49b5-9f3f-9804b3721207 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:18.724924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b8eb46d1-23f2-49b5-9f3f-9804b3721207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:18.726202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1634f-1d0a-4e69-84c2-381ff56b4386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c35633b627b4a8482f86692d3d706a9, user_id=42bbdf56f24946da8b78f5f6227090bf, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:18.734410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1634f-1d0a-4e69-84c2-381ff56b4386 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:18.734689 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 813/1609] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:18.734995 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b15a9-9aa9-411f-a0ae-fde9047578e8 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:18.735286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b15a9-9aa9-411f-a0ae-fde9047578e8 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:18.735570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b15a9-9aa9-411f-a0ae-fde9047578e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:18.753475 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-347b15a9-9aa9-411f-a0ae-fde9047578e8 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:18.754929 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-347b15a9-9aa9-411f-a0ae-fde9047578e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:18.762542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 814/1610] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:18.764617 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a996b-06e6-47ab-a032-2f060e4f95e1 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:18.764969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a996b-06e6-47ab-a032-2f060e4f95e1 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:18.765327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a996b-06e6-47ab-a032-2f060e4f95e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:18.785177 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-af0a996b-06e6-47ab-a032-2f060e4f95e1 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:18.786545 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-af0a996b-06e6-47ab-a032-2f060e4f95e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:18.794748 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 815/1611] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:18.796173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a996b-06e6-47ab-a032-2f060e4f95e1 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:18.837096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 797/1612] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:18 2022] PUT /identity/v3/projects/5c35633b627b4a8482f86692d3d706a9/users/42bbdf56f24946da8b78f5f6227090bf/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:18.843840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdc2e4-70c3-40ec-8e05-b0ba7a25e140 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:18.843840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdc2e4-70c3-40ec-8e05-b0ba7a25e140 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:18.843840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdc2e4-70c3-40ec-8e05-b0ba7a25e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:18.862148 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a996b-06e6-47ab-a032-2f060e4f95e1 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:18.893511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-57fdc2e4-70c3-40ec-8e05-b0ba7a25e140 None None] MFA Rules not processed for user `cf1ea7fd030a423e8a80f0ad6208b7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:18.896228 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-57fdc2e4-70c3-40ec-8e05-b0ba7a25e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:18.941886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a4401-059e-4107-9f12-e6f8f7cf4c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:18.942636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a4401-059e-4107-9f12-e6f8f7cf4c78 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:18.943001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a4401-059e-4107-9f12-e6f8f7cf4c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:18.943200 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a4401-059e-4107-9f12-e6f8f7cf4c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.000820 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 798/1613] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:19.005365 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdc2e4-70c3-40ec-8e05-b0ba7a25e140 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:19.029080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a4401-059e-4107-9f12-e6f8f7cf4c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:19.033706 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a4401-059e-4107-9f12-e6f8f7cf4c78 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:19.048786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:19.050016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 816/1614] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:19.050910 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a4401-059e-4107-9f12-e6f8f7cf4c78 service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:19.059479 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a4401-059e-4107-9f12-e6f8f7cf4c78 service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:19.069785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f8288-1bb1-4582-bbe1-b46cdbd53c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:19.070472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f8288-1bb1-4582-bbe1-b46cdbd53c84 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.070759 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f8288-1bb1-4582-bbe1-b46cdbd53c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.071036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f8288-1bb1-4582-bbe1-b46cdbd53c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.083743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f8288-1bb1-4582-bbe1-b46cdbd53c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:19.085197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f8288-1bb1-4582-bbe1-b46cdbd53c84 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:19.088201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdc2e4-70c3-40ec-8e05-b0ba7a25e140 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:19.092470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:19.094842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803beee-2e3b-4434-b6d3-36c2c210e063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:19.095847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803beee-2e3b-4434-b6d3-36c2c210e063 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.096308 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 817/1615] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:19.096453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803beee-2e3b-4434-b6d3-36c2c210e063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.097159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f8288-1bb1-4582-bbe1-b46cdbd53c84 service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:19.098459 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fe5f8288-1bb1-4582-bbe1-b46cdbd53c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:19.105652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803beee-2e3b-4434-b6d3-36c2c210e063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.108908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803beee-2e3b-4434-b6d3-36c2c210e063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:19.110411 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f8288-1bb1-4582-bbe1-b46cdbd53c84 service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:19.112344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803beee-2e3b-4434-b6d3-36c2c210e063 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:19.115176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a85e4-441e-4a08-9e8e-ff1e3624c975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:19.115844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a85e4-441e-4a08-9e8e-ff1e3624c975 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.116132 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a85e4-441e-4a08-9e8e-ff1e3624c975 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.116594 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a85e4-441e-4a08-9e8e-ff1e3624c975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.128690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 799/1616] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:19.128690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803beee-2e3b-4434-b6d3-36c2c210e063 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:19.135167 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a85e4-441e-4a08-9e8e-ff1e3624c975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:19.136764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a85e4-441e-4a08-9e8e-ff1e3624c975 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:19.137535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803beee-2e3b-4434-b6d3-36c2c210e063 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:19.143734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad773a8-753a-432b-bf77-7d0fb74fc30d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:19.145538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad773a8-753a-432b-bf77-7d0fb74fc30d service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.146323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad773a8-753a-432b-bf77-7d0fb74fc30d service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.146818 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad773a8-753a-432b-bf77-7d0fb74fc30d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.150408 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 818/1617] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:19.163247 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21fc3d-9da2-45ad-a44a-550b96c3fe54 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.163373 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad773a8-753a-432b-bf77-7d0fb74fc30d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:19.163483 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21fc3d-9da2-45ad-a44a-550b96c3fe54 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.163483 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21fc3d-9da2-45ad-a44a-550b96c3fe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.164691 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad773a8-753a-432b-bf77-7d0fb74fc30d service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:19.178411 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 800/1618] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:19.179320 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad773a8-753a-432b-bf77-7d0fb74fc30d service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:19.197685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-dc21fc3d-9da2-45ad-a44a-550b96c3fe54 None None] MFA Rules not processed for user `42bbdf56f24946da8b78f5f6227090bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:19.197685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-dc21fc3d-9da2-45ad-a44a-550b96c3fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:19.204975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad773a8-753a-432b-bf77-7d0fb74fc30d service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:19.211656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec54e7-db2c-4722-8eaa-985e57096b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:19.212972 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec54e7-db2c-4722-8eaa-985e57096b79 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.213688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec54e7-db2c-4722-8eaa-985e57096b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.214337 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec54e7-db2c-4722-8eaa-985e57096b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.215005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec54e7-db2c-4722-8eaa-985e57096b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:19.217056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec54e7-db2c-4722-8eaa-985e57096b79 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:19.272583 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 819/1619] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:19.273884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21fc3d-9da2-45ad-a44a-550b96c3fe54 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:19.286109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21fc3d-9da2-45ad-a44a-550b96c3fe54 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:19.291041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cc0bd-ad48-4f9b-8c6c-b32c12383a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:19.292001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc0bd-ad48-4f9b-8c6c-b32c12383a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.292244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc0bd-ad48-4f9b-8c6c-b32c12383a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.292536 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc0bd-ad48-4f9b-8c6c-b32c12383a21 admin admin] PATH_INFO: `/v3/projects/a920cd2ab89341cd93d10d60a9bd9f79/users/74a045db1b014b2c884a5f0eb9fa617d/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.310412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cc0bd-ad48-4f9b-8c6c-b32c12383a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a920cd2ab89341cd93d10d60a9bd9f79, user_id=74a045db1b014b2c884a5f0eb9fa617d, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:19.313473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cc0bd-ad48-4f9b-8c6c-b32c12383a21 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:19.385793 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 801/1620] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:19 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:19.386299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792a9dd-9d2a-47c9-bd74-3b29d08692ab None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.386723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792a9dd-9d2a-47c9-bd74-3b29d08692ab None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.387402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792a9dd-9d2a-47c9-bd74-3b29d08692ab None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.389483 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 802/1621] 10.222.0.23 () {54 vars in 961 bytes} [Thu Jun 16 15:03:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:03:19.390528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792a9dd-9d2a-47c9-bd74-3b29d08692ab None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:19.459682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792a9dd-9d2a-47c9-bd74-3b29d08692ab None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:19.464881 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1141ba-7a3f-4728-9b0f-970487922809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:19.465592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1141ba-7a3f-4728-9b0f-970487922809 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.465900 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1141ba-7a3f-4728-9b0f-970487922809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.466166 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1141ba-7a3f-4728-9b0f-970487922809 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.466866 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1141ba-7a3f-4728-9b0f-970487922809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:19.470167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1141ba-7a3f-4728-9b0f-970487922809 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:19.483232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 820/1622] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:19 2022] PUT /identity/v3/projects/a920cd2ab89341cd93d10d60a9bd9f79/users/74a045db1b014b2c884a5f0eb9fa617d/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:19.485223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720a688-418e-4d79-ab81-4f43bc240b7e None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.485750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720a688-418e-4d79-ab81-4f43bc240b7e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.486523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720a688-418e-4d79-ab81-4f43bc240b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.506385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-6720a688-418e-4d79-ab81-4f43bc240b7e None None] MFA Rules not processed for user `60c2f1c63a674e3195c490ab5ad1318f`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:19.507777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6720a688-418e-4d79-ab81-4f43bc240b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:19.582075 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 821/1623] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Jun 16 15:03:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:19.582949 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720a688-418e-4d79-ab81-4f43bc240b7e None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:19.634429 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:19.657901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720a688-418e-4d79-ab81-4f43bc240b7e None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:19.664610 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb548617-0be8-4521-996e-2e7494352702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:19.665493 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb548617-0be8-4521-996e-2e7494352702 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.666321 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb548617-0be8-4521-996e-2e7494352702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.666321 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb548617-0be8-4521-996e-2e7494352702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.667067 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb548617-0be8-4521-996e-2e7494352702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:19.669157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb548617-0be8-4521-996e-2e7494352702 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:19.681216 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 822/1624] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:19.697410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 803/1625] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:19 2022] POST /identity/v3/users => generated 297 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:19.697666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb548617-0be8-4521-996e-2e7494352702 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:19.697773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1141ba-7a3f-4728-9b0f-970487922809 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:19.699698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1141ba-7a3f-4728-9b0f-970487922809 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:19.703954 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb548617-0be8-4521-996e-2e7494352702 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:19.707507 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a612c8-abcd-46fa-9f1a-e2c2738127d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:19.708806 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a612c8-abcd-46fa-9f1a-e2c2738127d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.709104 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a612c8-abcd-46fa-9f1a-e2c2738127d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.709432 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a612c8-abcd-46fa-9f1a-e2c2738127d5 admin admin] PATH_INFO: `/v3/projects/a920cd2ab89341cd93d10d60a9bd9f79/users/74a045db1b014b2c884a5f0eb9fa617d/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.711851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98d712-dc88-40a7-9eb9-14376eabd44f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:19.712023 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a612c8-abcd-46fa-9f1a-e2c2738127d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a920cd2ab89341cd93d10d60a9bd9f79, user_id=74a045db1b014b2c884a5f0eb9fa617d, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:19.712624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98d712-dc88-40a7-9eb9-14376eabd44f service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.713023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98d712-dc88-40a7-9eb9-14376eabd44f service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.713425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98d712-dc88-40a7-9eb9-14376eabd44f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.715414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a612c8-abcd-46fa-9f1a-e2c2738127d5 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:19.733575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 804/1626] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:19 2022] PUT /identity/v3/projects/a920cd2ab89341cd93d10d60a9bd9f79/users/74a045db1b014b2c884a5f0eb9fa617d/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:19.734427 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a612c8-abcd-46fa-9f1a-e2c2738127d5 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:19.814085 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98d712-dc88-40a7-9eb9-14376eabd44f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:19.818032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98d712-dc88-40a7-9eb9-14376eabd44f service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:19.834014 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 823/1627] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:19.834014 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4aff2-ef7e-4451-aab0-35071be6db74 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.834014 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4aff2-ef7e-4451-aab0-35071be6db74 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.834014 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4aff2-ef7e-4451-aab0-35071be6db74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.856460 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a612c8-abcd-46fa-9f1a-e2c2738127d5 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:19.871381 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169aa6f-ef53-4ee5-8f3e-1b1250056c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:19.872074 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169aa6f-ef53-4ee5-8f3e-1b1250056c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.872369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169aa6f-ef53-4ee5-8f3e-1b1250056c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.872653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169aa6f-ef53-4ee5-8f3e-1b1250056c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.873459 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169aa6f-ef53-4ee5-8f3e-1b1250056c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:19.875164 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169aa6f-ef53-4ee5-8f3e-1b1250056c44 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:19.879691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-a7f4aff2-ef7e-4451-aab0-35071be6db74 None None] MFA Rules not processed for user `74a045db1b014b2c884a5f0eb9fa617d`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:19.879691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a7f4aff2-ef7e-4451-aab0-35071be6db74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:19.900705 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 805/1628] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:19.907156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169aa6f-ef53-4ee5-8f3e-1b1250056c44 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:19.920538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:19.929093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169aa6f-ef53-4ee5-8f3e-1b1250056c44 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:19.940458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d120f83-31f6-45ca-99ed-9974d5f0b5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:19.941479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120f83-31f6-45ca-99ed-9974d5f0b5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:19.941824 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120f83-31f6-45ca-99ed-9974d5f0b5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:19.942111 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120f83-31f6-45ca-99ed-9974d5f0b5c3 admin admin] PATH_INFO: `/v3/projects/56ca759852fc4745baf8c93f886f48ea/users/16f5b762c77049e48983f5f240a2cd58/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:19.979404 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d120f83-31f6-45ca-99ed-9974d5f0b5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ca759852fc4745baf8c93f886f48ea, user_id=16f5b762c77049e48983f5f240a2cd58, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:20.004335 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d120f83-31f6-45ca-99ed-9974d5f0b5c3 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:20.042418 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 824/1629] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:20.058885 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4aff2-ef7e-4451-aab0-35071be6db74 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:20.181554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4aff2-ef7e-4451-aab0-35071be6db74 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:20.203282 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51192f7-b493-402e-9c71-a2a219660d65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:20.206632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 806/1630] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:19 2022] PUT /identity/v3/projects/56ca759852fc4745baf8c93f886f48ea/users/16f5b762c77049e48983f5f240a2cd58/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:20.207174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51192f7-b493-402e-9c71-a2a219660d65 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.207174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51192f7-b493-402e-9c71-a2a219660d65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.207174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51192f7-b493-402e-9c71-a2a219660d65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.208396 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d120f83-31f6-45ca-99ed-9974d5f0b5c3 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:20.226810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51192f7-b493-402e-9c71-a2a219660d65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:20.228587 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51192f7-b493-402e-9c71-a2a219660d65 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:20.241677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 825/1631] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:20.244827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77ecd0-c322-47b5-a2dc-431ff793ae89 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.244827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77ecd0-c322-47b5-a2dc-431ff793ae89 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.244827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77ecd0-c322-47b5-a2dc-431ff793ae89 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.245914 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 826/1632] 10.222.0.23 () {54 vars in 912 bytes} [Thu Jun 16 15:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:03:20.252162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dc796-e7da-4440-92d5-928bcc0827ee None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.252682 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dc796-e7da-4440-92d5-928bcc0827ee None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.253234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dc796-e7da-4440-92d5-928bcc0827ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.278399 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-200dc796-e7da-4440-92d5-928bcc0827ee None None] MFA Rules not processed for user `60c2f1c63a674e3195c490ab5ad1318f`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:20.279973 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-200dc796-e7da-4440-92d5-928bcc0827ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:20.298798 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d120f83-31f6-45ca-99ed-9974d5f0b5c3 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:20.313619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0373f-b354-4710-86bf-1c269878f7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:20.313808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0373f-b354-4710-86bf-1c269878f7bc admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.314192 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0373f-b354-4710-86bf-1c269878f7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.314743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0373f-b354-4710-86bf-1c269878f7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.319442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0373f-b354-4710-86bf-1c269878f7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:20.322877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0373f-b354-4710-86bf-1c269878f7bc admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:20.339554 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 807/1633] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:20.345549 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0373f-b354-4710-86bf-1c269878f7bc admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:20.356617 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0373f-b354-4710-86bf-1c269878f7bc admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:20.362804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:20.365373 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d56a8-1c9a-49ad-bfe8-fcdcd722188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:20.366338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d56a8-1c9a-49ad-bfe8-fcdcd722188c admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.366653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d56a8-1c9a-49ad-bfe8-fcdcd722188c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.366951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d56a8-1c9a-49ad-bfe8-fcdcd722188c admin admin] PATH_INFO: `/v3/projects/56ca759852fc4745baf8c93f886f48ea/users/16f5b762c77049e48983f5f240a2cd58/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.369198 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d56a8-1c9a-49ad-bfe8-fcdcd722188c admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ca759852fc4745baf8c93f886f48ea, user_id=16f5b762c77049e48983f5f240a2cd58, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:20.372886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d56a8-1c9a-49ad-bfe8-fcdcd722188c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:20.381891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 827/1634] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 16 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:03:20.393177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 808/1635] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:20 2022] PUT /identity/v3/projects/56ca759852fc4745baf8c93f886f48ea/users/16f5b762c77049e48983f5f240a2cd58/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:03:20.402611 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d56a8-1c9a-49ad-bfe8-fcdcd722188c admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:20.402856 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0534e8-7dfb-419e-8b2d-53312f2893a3 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.403168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0534e8-7dfb-419e-8b2d-53312f2893a3 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.404275 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0534e8-7dfb-419e-8b2d-53312f2893a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.449971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-2a0534e8-7dfb-419e-8b2d-53312f2893a3 None None] MFA Rules not processed for user `16f5b762c77049e48983f5f240a2cd58`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:20.451211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2a0534e8-7dfb-419e-8b2d-53312f2893a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:20.504584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d56a8-1c9a-49ad-bfe8-fcdcd722188c admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:20.508895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fc090-cdcc-4d2d-9a49-43fd78dc5b8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:20.509872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fc090-cdcc-4d2d-9a49-43fd78dc5b8d service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.515003 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fc090-cdcc-4d2d-9a49-43fd78dc5b8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.515003 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fc090-cdcc-4d2d-9a49-43fd78dc5b8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.571153 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 828/1636] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:20.598276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fc090-cdcc-4d2d-9a49-43fd78dc5b8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:20.600753 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fc090-cdcc-4d2d-9a49-43fd78dc5b8d service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:20.615332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 809/1637] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:03:20.658354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0534e8-7dfb-419e-8b2d-53312f2893a3 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:20.681112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0534e8-7dfb-419e-8b2d-53312f2893a3 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:20.687269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb81b3-c436-475c-8c4c-8f2eed57f1fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:20.688959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb81b3-c436-475c-8c4c-8f2eed57f1fa service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:20.689777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb81b3-c436-475c-8c4c-8f2eed57f1fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:20.690155 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb81b3-c436-475c-8c4c-8f2eed57f1fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:20.709750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb81b3-c436-475c-8c4c-8f2eed57f1fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:20.712124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb81b3-c436-475c-8c4c-8f2eed57f1fa service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:20.742786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 829/1638] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:20.989229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fc090-cdcc-4d2d-9a49-43fd78dc5b8d service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:20.997313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:21.002597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fc090-cdcc-4d2d-9a49-43fd78dc5b8d service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:21.006536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95175b3b-5e08-4aab-a7e5-7a2dbfcbf2e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:21.007283 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95175b3b-5e08-4aab-a7e5-7a2dbfcbf2e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:21.007484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95175b3b-5e08-4aab-a7e5-7a2dbfcbf2e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:21.007795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95175b3b-5e08-4aab-a7e5-7a2dbfcbf2e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:21.086548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95175b3b-5e08-4aab-a7e5-7a2dbfcbf2e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:21.088192 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95175b3b-5e08-4aab-a7e5-7a2dbfcbf2e9 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:21.098156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 810/1639] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:22.344482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18ad7a-168a-4ab9-b0f1-7d371964ce1a None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:22.345105 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18ad7a-168a-4ab9-b0f1-7d371964ce1a None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:22.345637 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18ad7a-168a-4ab9-b0f1-7d371964ce1a None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:22.347347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 830/1640] 10.222.0.23 () {54 vars in 961 bytes} [Thu Jun 16 15:03:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:03:22.377533 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9a511-1d9d-4ebf-a0e5-257de7fea39b None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:22.378082 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9a511-1d9d-4ebf-a0e5-257de7fea39b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:22.378202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9a511-1d9d-4ebf-a0e5-257de7fea39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:22.402492 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-9dc9a511-1d9d-4ebf-a0e5-257de7fea39b None None] MFA Rules not processed for user `60c2f1c63a674e3195c490ab5ad1318f`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:22.403842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-9dc9a511-1d9d-4ebf-a0e5-257de7fea39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:22.441811 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 811/1641] 10.222.0.23 () {58 vars in 1058 bytes} [Thu Jun 16 15:03:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:22.448216 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b17301-4738-4746-af46-24a800367ec8 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:22.448584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b17301-4738-4746-af46-24a800367ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:22.448977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b17301-4738-4746-af46-24a800367ec8 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:22.452143 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 831/1642] 10.222.0.23 () {54 vars in 912 bytes} [Thu Jun 16 15:03:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 15:03:22.822653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c5cc6-dea2-4e90-8de1-6b956c8ce80f None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:22.822653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c5cc6-dea2-4e90-8de1-6b956c8ce80f None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:22.822653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c5cc6-dea2-4e90-8de1-6b956c8ce80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:22.822653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-be2c5cc6-dea2-4e90-8de1-6b956c8ce80f None None] MFA Rules not processed for user `60c2f1c63a674e3195c490ab5ad1318f`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:22.822653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-be2c5cc6-dea2-4e90-8de1-6b956c8ce80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:22.822653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 812/1643] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 16 15:03:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:22.825022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b17301-4738-4746-af46-24a800367ec8 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:22.825022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b17301-4738-4746-af46-24a800367ec8 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:22.825022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4540d2d-e189-4535-890c-fc915bdf0a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:22.825022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4540d2d-e189-4535-890c-fc915bdf0a12 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:22.825948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4540d2d-e189-4535-890c-fc915bdf0a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:22.825948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4540d2d-e189-4535-890c-fc915bdf0a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:22.825948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4540d2d-e189-4535-890c-fc915bdf0a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:22.825948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4540d2d-e189-4535-890c-fc915bdf0a12 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:22.825948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 832/1644] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:23.057514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c5cc6-dea2-4e90-8de1-6b956c8ce80f None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:23.175910 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c5cc6-dea2-4e90-8de1-6b956c8ce80f None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:23.185406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a8d67-27c9-4a5d-ad62-e61366bda1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:23.187015 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a8d67-27c9-4a5d-ad62-e61366bda1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:23.187489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a8d67-27c9-4a5d-ad62-e61366bda1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:23.187983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a8d67-27c9-4a5d-ad62-e61366bda1f8 admin admin] PATH_INFO: `/v3/users/cf1ea7fd030a423e8a80f0ad6208b7d2` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:23.190639 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a8d67-27c9-4a5d-ad62-e61366bda1f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1ea7fd030a423e8a80f0ad6208b7d2)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:23.194853 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a8d67-27c9-4a5d-ad62-e61366bda1f8 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:23.695023 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-1f0a8d67-27c9-4a5d-ad62-e61366bda1f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1ea7fd030a423e8a80f0ad6208b7d2'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:23.699393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-1f0a8d67-27c9-4a5d-ad62-e61366bda1f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1ea7fd030a423e8a80f0ad6208b7d2'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:23.723518 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-1f0a8d67-27c9-4a5d-ad62-e61366bda1f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1ea7fd030a423e8a80f0ad6208b7d2'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:23.725599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-1f0a8d67-27c9-4a5d-ad62-e61366bda1f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1ea7fd030a423e8a80f0ad6208b7d2'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:23.927870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-1f0a8d67-27c9-4a5d-ad62-e61366bda1f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1ea7fd030a423e8a80f0ad6208b7d2'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:23.963234 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 813/1645] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:23 2022] DELETE /identity/v3/users/cf1ea7fd030a423e8a80f0ad6208b7d2 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:23.968983 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73dbc9-c0fa-429a-b045-bd384121a268 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:23.969556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73dbc9-c0fa-429a-b045-bd384121a268 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:23.969760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73dbc9-c0fa-429a-b045-bd384121a268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:24.006619 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-7d73dbc9-c0fa-429a-b045-bd384121a268 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:24.008308 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-7d73dbc9-c0fa-429a-b045-bd384121a268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:24.080556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:24.112450 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 833/1646] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:24.155111 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a8d67-27c9-4a5d-ad62-e61366bda1f8 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:24.158834 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-1f0a8d67-27c9-4a5d-ad62-e61366bda1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:24.196052 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:24.286731 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a8d67-27c9-4a5d-ad62-e61366bda1f8 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:24.292222 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e7de4-3a45-4eab-a898-ab1fcb2fd8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:24.292911 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e7de4-3a45-4eab-a898-ab1fcb2fd8cb service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:24.293630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e7de4-3a45-4eab-a898-ab1fcb2fd8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:24.293918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e7de4-3a45-4eab-a898-ab1fcb2fd8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:24.309827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e7de4-3a45-4eab-a898-ab1fcb2fd8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:24.325996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e7de4-3a45-4eab-a898-ab1fcb2fd8cb service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:24.326979 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 814/1647] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:26.136899 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73dbc9-c0fa-429a-b045-bd384121a268 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:26.141008 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-7d73dbc9-c0fa-429a-b045-bd384121a268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:26.197290 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73dbc9-c0fa-429a-b045-bd384121a268 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:26.246659 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efa5d3-b59a-4b4c-9e5d-586d56966788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:26.249757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efa5d3-b59a-4b4c-9e5d-586d56966788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:26.256848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efa5d3-b59a-4b4c-9e5d-586d56966788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:26.257499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efa5d3-b59a-4b4c-9e5d-586d56966788 admin admin] PATH_INFO: `/v3/projects/4ede9f5444c04b27b2ca855f5b1aaef2` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:26.260395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efa5d3-b59a-4b4c-9e5d-586d56966788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ede9f5444c04b27b2ca855f5b1aaef2)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:26.265634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efa5d3-b59a-4b4c-9e5d-586d56966788 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:26.558945 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-49efa5d3-b59a-4b4c-9e5d-586d56966788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ede9f5444c04b27b2ca855f5b1aaef2', 'request_id': 'req-49efa5d3-b59a-4b4c-9e5d-586d56966788'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:26.579155 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-49efa5d3-b59a-4b4c-9e5d-586d56966788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ede9f5444c04b27b2ca855f5b1aaef2', 'request_id': 'req-49efa5d3-b59a-4b4c-9e5d-586d56966788'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:26.585776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-49efa5d3-b59a-4b4c-9e5d-586d56966788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ede9f5444c04b27b2ca855f5b1aaef2', 'request_id': 'req-49efa5d3-b59a-4b4c-9e5d-586d56966788'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:26.791097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-49efa5d3-b59a-4b4c-9e5d-586d56966788 admin admin] The token cache is being invalidate because project 4ede9f5444c04b27b2ca855f5b1aaef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:26.791455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-49efa5d3-b59a-4b4c-9e5d-586d56966788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:26.797666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-49efa5d3-b59a-4b4c-9e5d-586d56966788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:26.799427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 834/1648] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:26 2022] DELETE /identity/v3/projects/4ede9f5444c04b27b2ca855f5b1aaef2 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:26.803890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e7de4-3a45-4eab-a898-ab1fcb2fd8cb service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:26.815050 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e7de4-3a45-4eab-a898-ab1fcb2fd8cb service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:26.958842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4368f4-5c24-4229-b95b-2e20c0c554ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:26.962983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4368f4-5c24-4229-b95b-2e20c0c554ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:26.973665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4368f4-5c24-4229-b95b-2e20c0c554ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:26.978310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4368f4-5c24-4229-b95b-2e20c0c554ce admin admin] PATH_INFO: `/v3/users/16f5b762c77049e48983f5f240a2cd58` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:26.987849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4368f4-5c24-4229-b95b-2e20c0c554ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f5b762c77049e48983f5f240a2cd58)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:26.991280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4368f4-5c24-4229-b95b-2e20c0c554ce admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:27.442264 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4b4368f4-5c24-4229-b95b-2e20c0c554ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f5b762c77049e48983f5f240a2cd58'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:27.448409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4b4368f4-5c24-4229-b95b-2e20c0c554ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f5b762c77049e48983f5f240a2cd58'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:27.471497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4b4368f4-5c24-4229-b95b-2e20c0c554ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f5b762c77049e48983f5f240a2cd58'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:27.472528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4b4368f4-5c24-4229-b95b-2e20c0c554ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f5b762c77049e48983f5f240a2cd58'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:27.589184 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4b4368f4-5c24-4229-b95b-2e20c0c554ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f5b762c77049e48983f5f240a2cd58'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:27.645302 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 815/1649] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:26 2022] DELETE /identity/v3/users/16f5b762c77049e48983f5f240a2cd58 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:29.103029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efa5d3-b59a-4b4c-9e5d-586d56966788 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:29.105305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-49efa5d3-b59a-4b4c-9e5d-586d56966788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:29.183340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efa5d3-b59a-4b4c-9e5d-586d56966788 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:29.385055 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6711883-62f3-478c-91c8-1bca15718196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:29.388345 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711883-62f3-478c-91c8-1bca15718196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:29.388907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711883-62f3-478c-91c8-1bca15718196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:29.390060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6711883-62f3-478c-91c8-1bca15718196 admin admin] PATH_INFO: `/v3/projects/56ca759852fc4745baf8c93f886f48ea` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:29.392960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6711883-62f3-478c-91c8-1bca15718196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ca759852fc4745baf8c93f886f48ea)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:29.404025 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6711883-62f3-478c-91c8-1bca15718196 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:29.499320 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4368f4-5c24-4229-b95b-2e20c0c554ce admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:29.500891 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4b4368f4-5c24-4229-b95b-2e20c0c554ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:29.518119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4368f4-5c24-4229-b95b-2e20c0c554ce admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:29.527911 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e19068-d8c7-4406-9066-4fc050390cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:29.529185 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e19068-d8c7-4406-9066-4fc050390cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:29.531453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e19068-d8c7-4406-9066-4fc050390cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:29.542539 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e19068-d8c7-4406-9066-4fc050390cd7 admin admin] PATH_INFO: `/v3/users/42bbdf56f24946da8b78f5f6227090bf` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:29.542539 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e19068-d8c7-4406-9066-4fc050390cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42bbdf56f24946da8b78f5f6227090bf)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:29.542539 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e19068-d8c7-4406-9066-4fc050390cd7 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:29.728132 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a6711883-62f3-478c-91c8-1bca15718196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ca759852fc4745baf8c93f886f48ea', 'request_id': 'req-a6711883-62f3-478c-91c8-1bca15718196'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.764645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a6711883-62f3-478c-91c8-1bca15718196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ca759852fc4745baf8c93f886f48ea', 'request_id': 'req-a6711883-62f3-478c-91c8-1bca15718196'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.780771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a6711883-62f3-478c-91c8-1bca15718196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ca759852fc4745baf8c93f886f48ea', 'request_id': 'req-a6711883-62f3-478c-91c8-1bca15718196'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.808522 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:29.906932 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a6711883-62f3-478c-91c8-1bca15718196 admin admin] The token cache is being invalidate because project 56ca759852fc4745baf8c93f886f48ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:29.907229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a6711883-62f3-478c-91c8-1bca15718196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.909977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a6711883-62f3-478c-91c8-1bca15718196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:29.912463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 835/1650] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:29 2022] DELETE /identity/v3/projects/56ca759852fc4745baf8c93f886f48ea => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:29.917612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60611d-1f56-4ac6-8628-786fc3e3f17c None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:29.917612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60611d-1f56-4ac6-8628-786fc3e3f17c None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:29.919361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60611d-1f56-4ac6-8628-786fc3e3f17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:29.993299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-dd60611d-1f56-4ac6-8628-786fc3e3f17c None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:29.996434 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-dd60611d-1f56-4ac6-8628-786fc3e3f17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:30.005107 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e5e19068-d8c7-4406-9066-4fc050390cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42bbdf56f24946da8b78f5f6227090bf'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:30.009103 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e5e19068-d8c7-4406-9066-4fc050390cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42bbdf56f24946da8b78f5f6227090bf'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:30.012150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:30.021961 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e5e19068-d8c7-4406-9066-4fc050390cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42bbdf56f24946da8b78f5f6227090bf'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:30.023812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e5e19068-d8c7-4406-9066-4fc050390cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42bbdf56f24946da8b78f5f6227090bf'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:30.137191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 836/1651] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:03:30.144119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674c32-1456-437a-925c-006c034bce63 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.144417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674c32-1456-437a-925c-006c034bce63 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.144740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674c32-1456-437a-925c-006c034bce63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.168205 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e5e19068-d8c7-4406-9066-4fc050390cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42bbdf56f24946da8b78f5f6227090bf'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:30.204250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-4e674c32-1456-437a-925c-006c034bce63 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:30.207011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4e674c32-1456-437a-925c-006c034bce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:30.223277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 816/1652] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:29 2022] DELETE /identity/v3/users/42bbdf56f24946da8b78f5f6227090bf => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:03:30.230180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e3dab-4640-45a5-b89a-713df656db14 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.231606 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e3dab-4640-45a5-b89a-713df656db14 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.232122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e3dab-4640-45a5-b89a-713df656db14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.238075 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 837/1653] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:03:30.246309 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e674c32-1456-437a-925c-006c034bce63 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.298316 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e674c32-1456-437a-925c-006c034bce63 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.303080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-2e4e3dab-4640-45a5-b89a-713df656db14 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:30.304724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2e4e3dab-4640-45a5-b89a-713df656db14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:30.602102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 817/1654] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:30.649982 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e543874-d53f-481d-ac29-4ba026b652c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.652330 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e543874-d53f-481d-ac29-4ba026b652c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.652706 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e543874-d53f-481d-ac29-4ba026b652c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.653947 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e543874-d53f-481d-ac29-4ba026b652c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.655362 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e543874-d53f-481d-ac29-4ba026b652c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:30.658748 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e543874-d53f-481d-ac29-4ba026b652c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.661586 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e3dab-4640-45a5-b89a-713df656db14 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.663886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2e4e3dab-4640-45a5-b89a-713df656db14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:30.673561 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e543874-d53f-481d-ac29-4ba026b652c0 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.733365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 838/1655] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:30.735716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e543874-d53f-481d-ac29-4ba026b652c0 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:30.775752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e543874-d53f-481d-ac29-4ba026b652c0 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.793046 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b49e3-6fb7-4fe1-854d-f1e303c98d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.800743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b49e3-6fb7-4fe1-854d-f1e303c98d00 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.800743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b49e3-6fb7-4fe1-854d-f1e303c98d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.800743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b49e3-6fb7-4fe1-854d-f1e303c98d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.800743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b49e3-6fb7-4fe1-854d-f1e303c98d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.800743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b49e3-6fb7-4fe1-854d-f1e303c98d00 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.840206 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e3dab-4640-45a5-b89a-713df656db14 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:30.847365 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da9501-4a9f-48f5-a092-b63f5a190e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:30.849505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da9501-4a9f-48f5-a092-b63f5a190e6a service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.849947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da9501-4a9f-48f5-a092-b63f5a190e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.850394 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da9501-4a9f-48f5-a092-b63f5a190e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.865976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da9501-4a9f-48f5-a092-b63f5a190e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:30.868718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da9501-4a9f-48f5-a092-b63f5a190e6a service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:30.890162 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 818/1656] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:30.892598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b126bb-e6dd-498e-a5eb-6e623b57ea21 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:30.893034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b126bb-e6dd-498e-a5eb-6e623b57ea21 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:30.893464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b126bb-e6dd-498e-a5eb-6e623b57ea21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:30.936316 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-55b126bb-e6dd-498e-a5eb-6e623b57ea21 None None] MFA Rules not processed for user `f6683ab715b3452a8a79b89be6b3bfce`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:30.938312 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-55b126bb-e6dd-498e-a5eb-6e623b57ea21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:31.004342 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 839/1657] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:30 2022] POST /identity/v3/projects => generated 369 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:31.005638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b49e3-6fb7-4fe1-854d-f1e303c98d00 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:31.093626 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 819/1658] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:31.110554 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b126bb-e6dd-498e-a5eb-6e623b57ea21 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:31.113867 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-55b126bb-e6dd-498e-a5eb-6e623b57ea21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:31.118134 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b49e3-6fb7-4fe1-854d-f1e303c98d00 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:31.130058 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac064718-ff4e-4cdd-b38b-25f9e8b405e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:31.130400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac064718-ff4e-4cdd-b38b-25f9e8b405e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:31.131879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac064718-ff4e-4cdd-b38b-25f9e8b405e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:31.132494 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac064718-ff4e-4cdd-b38b-25f9e8b405e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:31.138086 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac064718-ff4e-4cdd-b38b-25f9e8b405e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:31.139881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac064718-ff4e-4cdd-b38b-25f9e8b405e4 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:31.298204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 840/1659] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:31 2022] POST /identity/v3/users => generated 285 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:31.303417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac064718-ff4e-4cdd-b38b-25f9e8b405e4 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:31.322129 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac064718-ff4e-4cdd-b38b-25f9e8b405e4 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:31.329391 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291335de-f25a-48e4-aefa-197f0c7b4acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:31.330766 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291335de-f25a-48e4-aefa-197f0c7b4acd admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:31.331190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291335de-f25a-48e4-aefa-197f0c7b4acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:31.331623 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291335de-f25a-48e4-aefa-197f0c7b4acd admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:31.332511 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291335de-f25a-48e4-aefa-197f0c7b4acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:31.334565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291335de-f25a-48e4-aefa-197f0c7b4acd admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:31.350771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 841/1660] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:03:31.354657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291335de-f25a-48e4-aefa-197f0c7b4acd admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:31.370383 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291335de-f25a-48e4-aefa-197f0c7b4acd admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:31.382770 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0104eb-0b43-424b-8911-aeb256000479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:31.383603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0104eb-0b43-424b-8911-aeb256000479 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:31.385821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0104eb-0b43-424b-8911-aeb256000479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:31.386273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0104eb-0b43-424b-8911-aeb256000479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:31.387038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0104eb-0b43-424b-8911-aeb256000479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:31.388687 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0104eb-0b43-424b-8911-aeb256000479 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:31.395252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b126bb-e6dd-498e-a5eb-6e623b57ea21 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:31.411781 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 842/1661] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:31.412444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0104eb-0b43-424b-8911-aeb256000479 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:31.453126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0104eb-0b43-424b-8911-aeb256000479 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:31.462942 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb003e-a33f-42ba-8b6f-f69329b563a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:31.464040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb003e-a33f-42ba-8b6f-f69329b563a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:31.464487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb003e-a33f-42ba-8b6f-f69329b563a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:31.465731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb003e-a33f-42ba-8b6f-f69329b563a2 admin admin] PATH_INFO: `/v3/projects/358bba9a335648c3b83102018e0f0c77/users/0a42a40e2617454c98a8c8ffc8cd41f8/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:31.490873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb003e-a33f-42ba-8b6f-f69329b563a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=358bba9a335648c3b83102018e0f0c77, user_id=0a42a40e2617454c98a8c8ffc8cd41f8, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:31.492608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb003e-a33f-42ba-8b6f-f69329b563a2 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:31.538043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e5729-caee-4ff5-8ba2-99d1be7a992e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:31.539228 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e5729-caee-4ff5-8ba2-99d1be7a992e service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:31.539720 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e5729-caee-4ff5-8ba2-99d1be7a992e service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:31.540198 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e5729-caee-4ff5-8ba2-99d1be7a992e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:31.651485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 843/1662] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:31 2022] PUT /identity/v3/projects/358bba9a335648c3b83102018e0f0c77/users/0a42a40e2617454c98a8c8ffc8cd41f8/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:31.664092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bd5e2-2439-4441-a92f-73d584964527 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:31.669306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bd5e2-2439-4441-a92f-73d584964527 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:31.669596 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bd5e2-2439-4441-a92f-73d584964527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:31.717499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e5729-caee-4ff5-8ba2-99d1be7a992e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:31.719309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e5729-caee-4ff5-8ba2-99d1be7a992e service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:31.747615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 820/1663] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:31.763167 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-348bd5e2-2439-4441-a92f-73d584964527 None None] MFA Rules not processed for user `0a42a40e2617454c98a8c8ffc8cd41f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:31.774839 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-348bd5e2-2439-4441-a92f-73d584964527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:31.945296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 844/1664] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:31.955697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e5729-caee-4ff5-8ba2-99d1be7a992e service nova] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:31.957620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-9d1e5729-caee-4ff5-8ba2-99d1be7a992e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:32.084062 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e5729-caee-4ff5-8ba2-99d1be7a992e service nova] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:32.163295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13d357-9850-4288-9323-4f7befab40a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:32.167032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13d357-9850-4288-9323-4f7befab40a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:32.167032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13d357-9850-4288-9323-4f7befab40a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:32.167032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13d357-9850-4288-9323-4f7befab40a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:32.192453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13d357-9850-4288-9323-4f7befab40a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:32.195556 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13d357-9850-4288-9323-4f7befab40a5 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:32.222274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 821/1665] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:32.249328 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bd5e2-2439-4441-a92f-73d584964527 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:32.486817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bd5e2-2439-4441-a92f-73d584964527 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:32.510640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae39e3-b6af-4c26-a20d-877d14be26c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:32.514921 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae39e3-b6af-4c26-a20d-877d14be26c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:32.534319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae39e3-b6af-4c26-a20d-877d14be26c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:32.534870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae39e3-b6af-4c26-a20d-877d14be26c9 admin admin] PATH_INFO: `/v3/users/0a42a40e2617454c98a8c8ffc8cd41f8` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:32.537566 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae39e3-b6af-4c26-a20d-877d14be26c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a42a40e2617454c98a8c8ffc8cd41f8)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:32.542266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: WARNING py.warnings [None req-46ae39e3-b6af-4c26-a20d-877d14be26c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 15:03:32.542266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: warnings.warn(msg) Jun 16 15:03:32.542266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: Jun 16 15:03:32.543755 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae39e3-b6af-4c26-a20d-877d14be26c9 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:33.048423 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-46ae39e3-b6af-4c26-a20d-877d14be26c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a42a40e2617454c98a8c8ffc8cd41f8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:33.083596 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-46ae39e3-b6af-4c26-a20d-877d14be26c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a42a40e2617454c98a8c8ffc8cd41f8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:33.085258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-46ae39e3-b6af-4c26-a20d-877d14be26c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a42a40e2617454c98a8c8ffc8cd41f8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:33.125622 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-46ae39e3-b6af-4c26-a20d-877d14be26c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a42a40e2617454c98a8c8ffc8cd41f8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:33.127038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-46ae39e3-b6af-4c26-a20d-877d14be26c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a42a40e2617454c98a8c8ffc8cd41f8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:33.356804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 845/1666] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:32 2022] DELETE /identity/v3/users/0a42a40e2617454c98a8c8ffc8cd41f8 => generated 0 bytes in 1109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:33.362857 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa3e98-c1c8-4e8f-b0f5-d6d028a1e2cc None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:33.363734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa3e98-c1c8-4e8f-b0f5-d6d028a1e2cc None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:33.364136 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa3e98-c1c8-4e8f-b0f5-d6d028a1e2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:33.403569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-b7aa3e98-c1c8-4e8f-b0f5-d6d028a1e2cc None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:33.408630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b7aa3e98-c1c8-4e8f-b0f5-d6d028a1e2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:33.556847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 822/1667] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:33.655579 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae39e3-b6af-4c26-a20d-877d14be26c9 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:33.657316 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-46ae39e3-b6af-4c26-a20d-877d14be26c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:33.765162 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa3e98-c1c8-4e8f-b0f5-d6d028a1e2cc None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:33.771966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b7aa3e98-c1c8-4e8f-b0f5-d6d028a1e2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:33.793108 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa3e98-c1c8-4e8f-b0f5-d6d028a1e2cc None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:33.808559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9edbe9-52b7-4fdc-85ee-170cfb5f3fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:33.809671 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae39e3-b6af-4c26-a20d-877d14be26c9 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:33.810065 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9edbe9-52b7-4fdc-85ee-170cfb5f3fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:33.810583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9edbe9-52b7-4fdc-85ee-170cfb5f3fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:33.811093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9edbe9-52b7-4fdc-85ee-170cfb5f3fda admin admin] PATH_INFO: `/v3/projects/5c35633b627b4a8482f86692d3d706a9` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:33.813444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9edbe9-52b7-4fdc-85ee-170cfb5f3fda admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c35633b627b4a8482f86692d3d706a9)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:33.814726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: WARNING py.warnings [None req-ec9edbe9-52b7-4fdc-85ee-170cfb5f3fda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 15:03:33.814726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: warnings.warn(msg) Jun 16 15:03:33.814726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: Jun 16 15:03:33.821953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9edbe9-52b7-4fdc-85ee-170cfb5f3fda admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:33.823732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452273f-28d3-4646-b297-fabaa93cea23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:33.824412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452273f-28d3-4646-b297-fabaa93cea23 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:33.825276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452273f-28d3-4646-b297-fabaa93cea23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:33.825705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452273f-28d3-4646-b297-fabaa93cea23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:33.870635 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452273f-28d3-4646-b297-fabaa93cea23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:33.872198 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452273f-28d3-4646-b297-fabaa93cea23 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:33.937878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 846/1668] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:34.168729 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ec9edbe9-52b7-4fdc-85ee-170cfb5f3fda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c35633b627b4a8482f86692d3d706a9', 'request_id': 'req-ec9edbe9-52b7-4fdc-85ee-170cfb5f3fda'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:34.205217 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ec9edbe9-52b7-4fdc-85ee-170cfb5f3fda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c35633b627b4a8482f86692d3d706a9', 'request_id': 'req-ec9edbe9-52b7-4fdc-85ee-170cfb5f3fda'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:34.227024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ec9edbe9-52b7-4fdc-85ee-170cfb5f3fda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c35633b627b4a8482f86692d3d706a9', 'request_id': 'req-ec9edbe9-52b7-4fdc-85ee-170cfb5f3fda'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:34.404303 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ec9edbe9-52b7-4fdc-85ee-170cfb5f3fda admin admin] The token cache is being invalidate because project 5c35633b627b4a8482f86692d3d706a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:34.405931 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ec9edbe9-52b7-4fdc-85ee-170cfb5f3fda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:34.411909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ec9edbe9-52b7-4fdc-85ee-170cfb5f3fda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:34.418950 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 823/1669] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:33 2022] DELETE /identity/v3/projects/5c35633b627b4a8482f86692d3d706a9 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:34.427430 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9626e8-e89c-49c8-97b4-be8c7472201d None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.428820 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9626e8-e89c-49c8-97b4-be8c7472201d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.429408 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9626e8-e89c-49c8-97b4-be8c7472201d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.469891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-4d9626e8-e89c-49c8-97b4-be8c7472201d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:34.471519 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4d9626e8-e89c-49c8-97b4-be8c7472201d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:34.564975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 847/1670] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:34.565648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f126fc-83fa-4d88-b6c4-fe9f0bca9a66 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.566022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f126fc-83fa-4d88-b6c4-fe9f0bca9a66 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.566314 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f126fc-83fa-4d88-b6c4-fe9f0bca9a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.600046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-97f126fc-83fa-4d88-b6c4-fe9f0bca9a66 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:34.601833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-97f126fc-83fa-4d88-b6c4-fe9f0bca9a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:34.621612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9626e8-e89c-49c8-97b4-be8c7472201d None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:34.651937 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 824/1671] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:03:34.654568 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9626e8-e89c-49c8-97b4-be8c7472201d None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:34.661654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea6412-89a5-486c-af46-055de86153fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:34.662619 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea6412-89a5-486c-af46-055de86153fa admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.663119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea6412-89a5-486c-af46-055de86153fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.663541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea6412-89a5-486c-af46-055de86153fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.664513 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea6412-89a5-486c-af46-055de86153fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:34.664982 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea6412-89a5-486c-af46-055de86153fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:34.668232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea6412-89a5-486c-af46-055de86153fa admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:34.695111 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f126fc-83fa-4d88-b6c4-fe9f0bca9a66 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:34.706196 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 848/1672] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:34.709831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f126fc-83fa-4d88-b6c4-fe9f0bca9a66 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:34.715689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ac646-b6eb-4c11-8564-8bc195e50a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:34.716869 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ac646-b6eb-4c11-8564-8bc195e50a33 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:34.717377 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ac646-b6eb-4c11-8564-8bc195e50a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:34.717830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ac646-b6eb-4c11-8564-8bc195e50a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:34.719132 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ac646-b6eb-4c11-8564-8bc195e50a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:34.722714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ac646-b6eb-4c11-8564-8bc195e50a33 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:34.785217 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:34.975599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:34.975875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 825/1673] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:34 2022] POST /identity/v3/projects => generated 371 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:34.980188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea6412-89a5-486c-af46-055de86153fa admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:34.995029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea6412-89a5-486c-af46-055de86153fa admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.170048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b01f0e-a381-4f34-9914-b205eb22c4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.171302 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b01f0e-a381-4f34-9914-b205eb22c4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.171586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b01f0e-a381-4f34-9914-b205eb22c4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.171871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b01f0e-a381-4f34-9914-b205eb22c4f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.172572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b01f0e-a381-4f34-9914-b205eb22c4f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:35.175070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b01f0e-a381-4f34-9914-b205eb22c4f1 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:35.299068 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 849/1674] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:34 2022] POST /identity/v3/users => generated 286 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:35.303271 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ac646-b6eb-4c11-8564-8bc195e50a33 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:35.318178 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ac646-b6eb-4c11-8564-8bc195e50a33 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.329378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0e478-8f9f-4de7-b830-0b85b6abf975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.330155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0e478-8f9f-4de7-b830-0b85b6abf975 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.330449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0e478-8f9f-4de7-b830-0b85b6abf975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.330740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0e478-8f9f-4de7-b830-0b85b6abf975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.332017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0e478-8f9f-4de7-b830-0b85b6abf975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:35.338577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0e478-8f9f-4de7-b830-0b85b6abf975 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:35.367795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 826/1675] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:35.372349 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b01f0e-a381-4f34-9914-b205eb22c4f1 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:35.390530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b01f0e-a381-4f34-9914-b205eb22c4f1 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.399591 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9078b-2bee-4de7-a06e-6182414be0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.401225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9078b-2bee-4de7-a06e-6182414be0cc admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.401225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9078b-2bee-4de7-a06e-6182414be0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.401433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9078b-2bee-4de7-a06e-6182414be0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.402334 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9078b-2bee-4de7-a06e-6182414be0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:35.405450 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9078b-2bee-4de7-a06e-6182414be0cc admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:35.435139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 850/1676] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:35.436288 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0e478-8f9f-4de7-b830-0b85b6abf975 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:35.449520 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0e478-8f9f-4de7-b830-0b85b6abf975 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:35.480321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528d2fb-1bdd-4154-81ab-75ca337855a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:35.482225 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528d2fb-1bdd-4154-81ab-75ca337855a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.485999 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528d2fb-1bdd-4154-81ab-75ca337855a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.486615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528d2fb-1bdd-4154-81ab-75ca337855a0 admin admin] PATH_INFO: `/v3/projects/f07bdb086d61408ba7b3c252e2767479/users/460fac4b23a549d9bf08505001c077f8/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.554114 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528d2fb-1bdd-4154-81ab-75ca337855a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07bdb086d61408ba7b3c252e2767479, user_id=460fac4b23a549d9bf08505001c077f8, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:35.568526 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528d2fb-1bdd-4154-81ab-75ca337855a0 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:35.774531 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 827/1677] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:35 2022] PUT /identity/v3/projects/f07bdb086d61408ba7b3c252e2767479/users/460fac4b23a549d9bf08505001c077f8/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:35.787699 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e65cf1-943c-4f6f-ba49-ac7c85b63436 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:35.788002 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e65cf1-943c-4f6f-ba49-ac7c85b63436 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:35.788295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e65cf1-943c-4f6f-ba49-ac7c85b63436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:35.791387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528d2fb-1bdd-4154-81ab-75ca337855a0 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:35.794616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2528d2fb-1bdd-4154-81ab-75ca337855a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:35.879391 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-67e65cf1-943c-4f6f-ba49-ac7c85b63436 None None] MFA Rules not processed for user `460fac4b23a549d9bf08505001c077f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:35.882506 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-67e65cf1-943c-4f6f-ba49-ac7c85b63436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:36.083889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528d2fb-1bdd-4154-81ab-75ca337855a0 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:36.095957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51267f7f-bffc-420f-9a6f-aaabfb4678de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:36.096975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51267f7f-bffc-420f-9a6f-aaabfb4678de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:36.097317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51267f7f-bffc-420f-9a6f-aaabfb4678de admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:36.097676 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51267f7f-bffc-420f-9a6f-aaabfb4678de admin admin] PATH_INFO: `/v3/users/cb882ac10e17437fbb12844913d0026c` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:36.099498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51267f7f-bffc-420f-9a6f-aaabfb4678de admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb882ac10e17437fbb12844913d0026c)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:36.103990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51267f7f-bffc-420f-9a6f-aaabfb4678de admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:36.191677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 851/1678] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:36.193100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e65cf1-943c-4f6f-ba49-ac7c85b63436 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:36.209692 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e65cf1-943c-4f6f-ba49-ac7c85b63436 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:36.219325 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e2130-b7dc-4cb0-b4de-7f8d12726a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:36.220268 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e2130-b7dc-4cb0-b4de-7f8d12726a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:36.220747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e2130-b7dc-4cb0-b4de-7f8d12726a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:36.221810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e2130-b7dc-4cb0-b4de-7f8d12726a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:36.222692 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e2130-b7dc-4cb0-b4de-7f8d12726a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:36.235205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e2130-b7dc-4cb0-b4de-7f8d12726a51 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:36.383036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 852/1679] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:36 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:36.387356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e2130-b7dc-4cb0-b4de-7f8d12726a51 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:36.394125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0f2e2130-b7dc-4cb0-b4de-7f8d12726a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:36.617327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e2130-b7dc-4cb0-b4de-7f8d12726a51 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:36.634918 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e87ee0-2fe7-4841-93e7-366d3ceae4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:36.636258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e87ee0-2fe7-4841-93e7-366d3ceae4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:36.636698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e87ee0-2fe7-4841-93e7-366d3ceae4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:36.637124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e87ee0-2fe7-4841-93e7-366d3ceae4e1 admin admin] PATH_INFO: `/v3/projects/358bba9a335648c3b83102018e0f0c77` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:36.640464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e87ee0-2fe7-4841-93e7-366d3ceae4e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=358bba9a335648c3b83102018e0f0c77)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:36.642683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e87ee0-2fe7-4841-93e7-366d3ceae4e1 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:36.649266 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-51267f7f-bffc-420f-9a6f-aaabfb4678de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb882ac10e17437fbb12844913d0026c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:36.650052 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-51267f7f-bffc-420f-9a6f-aaabfb4678de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb882ac10e17437fbb12844913d0026c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:36.671805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-51267f7f-bffc-420f-9a6f-aaabfb4678de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb882ac10e17437fbb12844913d0026c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:36.672789 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-51267f7f-bffc-420f-9a6f-aaabfb4678de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb882ac10e17437fbb12844913d0026c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:36.860954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-51267f7f-bffc-420f-9a6f-aaabfb4678de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb882ac10e17437fbb12844913d0026c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:36.907194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-56e87ee0-2fe7-4841-93e7-366d3ceae4e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358bba9a335648c3b83102018e0f0c77', 'request_id': 'req-56e87ee0-2fe7-4841-93e7-366d3ceae4e1'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:36.943437 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-56e87ee0-2fe7-4841-93e7-366d3ceae4e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358bba9a335648c3b83102018e0f0c77', 'request_id': 'req-56e87ee0-2fe7-4841-93e7-366d3ceae4e1'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:36.961467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 828/1680] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:35 2022] DELETE /identity/v3/users/cb882ac10e17437fbb12844913d0026c => generated 0 bytes in 1166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:36.961467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51267f7f-bffc-420f-9a6f-aaabfb4678de admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:36.988191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-51267f7f-bffc-420f-9a6f-aaabfb4678de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:36.990038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-56e87ee0-2fe7-4841-93e7-366d3ceae4e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358bba9a335648c3b83102018e0f0c77', 'request_id': 'req-56e87ee0-2fe7-4841-93e7-366d3ceae4e1'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:37.139652 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-56e87ee0-2fe7-4841-93e7-366d3ceae4e1 admin admin] The token cache is being invalidate because project 358bba9a335648c3b83102018e0f0c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:37.140251 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-56e87ee0-2fe7-4841-93e7-366d3ceae4e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:37.142128 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-56e87ee0-2fe7-4841-93e7-366d3ceae4e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:37.145245 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 853/1681] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:36 2022] DELETE /identity/v3/projects/358bba9a335648c3b83102018e0f0c77 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:37.147112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d74fc-7ea7-4777-b50c-fb916a281ea3 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:37.147607 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d74fc-7ea7-4777-b50c-fb916a281ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:37.148042 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d74fc-7ea7-4777-b50c-fb916a281ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:37.219999 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-6e2d74fc-7ea7-4777-b50c-fb916a281ea3 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:37.230924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6e2d74fc-7ea7-4777-b50c-fb916a281ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:37.257897 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 854/1682] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:37.259815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7fb3b-1508-4350-8f6c-557c42b55858 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:37.263329 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7fb3b-1508-4350-8f6c-557c42b55858 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:37.263627 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51267f7f-bffc-420f-9a6f-aaabfb4678de admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:37.264732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7fb3b-1508-4350-8f6c-557c42b55858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:37.290540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a33a54-76d4-4406-a56a-b5f5f139aef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:37.299151 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a33a54-76d4-4406-a56a-b5f5f139aef2 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:37.302985 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a33a54-76d4-4406-a56a-b5f5f139aef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:37.308741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-30d7fb3b-1508-4350-8f6c-557c42b55858 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:37.310796 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-30d7fb3b-1508-4350-8f6c-557c42b55858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:37.312321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a33a54-76d4-4406-a56a-b5f5f139aef2 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:37.320814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a33a54-76d4-4406-a56a-b5f5f139aef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:37.327738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a33a54-76d4-4406-a56a-b5f5f139aef2 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:37.335010 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 855/1683] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:37.335994 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7fb3b-1508-4350-8f6c-557c42b55858 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:37.337741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-30d7fb3b-1508-4350-8f6c-557c42b55858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:37.438640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7fb3b-1508-4350-8f6c-557c42b55858 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:37.444948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd0174-fa91-496a-b627-ea4e338f7016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:37.445806 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd0174-fa91-496a-b627-ea4e338f7016 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:37.446228 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd0174-fa91-496a-b627-ea4e338f7016 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:37.446621 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd0174-fa91-496a-b627-ea4e338f7016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:37.465772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd0174-fa91-496a-b627-ea4e338f7016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:37.475002 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd0174-fa91-496a-b627-ea4e338f7016 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:37.500561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 829/1684] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:36 2022] POST /identity/v3/users => generated 291 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:37.500561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a33a54-76d4-4406-a56a-b5f5f139aef2 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:37.507888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 856/1685] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:37.510224 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfdfdf-8f7f-4833-bb42-d4fa7508e140 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:37.510651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfdfdf-8f7f-4833-bb42-d4fa7508e140 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:37.511012 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfdfdf-8f7f-4833-bb42-d4fa7508e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:37.521040 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d3a33a54-76d4-4406-a56a-b5f5f139aef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:37.552031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a33a54-76d4-4406-a56a-b5f5f139aef2 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:37.576558 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5391119-d3ad-4f8a-9b7b-f20527a941e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:37.578548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5391119-d3ad-4f8a-9b7b-f20527a941e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:37.578837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5391119-d3ad-4f8a-9b7b-f20527a941e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:37.579119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5391119-d3ad-4f8a-9b7b-f20527a941e6 admin admin] PATH_INFO: `/v3/users/b970e6cc62d14619b0df478574755d6d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:37.580475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5391119-d3ad-4f8a-9b7b-f20527a941e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b970e6cc62d14619b0df478574755d6d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:37.582468 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5391119-d3ad-4f8a-9b7b-f20527a941e6 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:37.602019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-48dfdfdf-8f7f-4833-bb42-d4fa7508e140 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:37.606602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-48dfdfdf-8f7f-4833-bb42-d4fa7508e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:37.640219 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 857/1686] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:37.646069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfdfdf-8f7f-4833-bb42-d4fa7508e140 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:37.650371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-48dfdfdf-8f7f-4833-bb42-d4fa7508e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:37.699392 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfdfdf-8f7f-4833-bb42-d4fa7508e140 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:37.725597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854ccc8-1eb4-4aaf-ac11-60c4b5ee1a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:37.727060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854ccc8-1eb4-4aaf-ac11-60c4b5ee1a60 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:37.728985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854ccc8-1eb4-4aaf-ac11-60c4b5ee1a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:37.734125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854ccc8-1eb4-4aaf-ac11-60c4b5ee1a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:37.735344 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854ccc8-1eb4-4aaf-ac11-60c4b5ee1a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:37.750812 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854ccc8-1eb4-4aaf-ac11-60c4b5ee1a60 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:37.798235 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 858/1687] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:37.806341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854ccc8-1eb4-4aaf-ac11-60c4b5ee1a60 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:37.892158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854ccc8-1eb4-4aaf-ac11-60c4b5ee1a60 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:37.941456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b5391119-d3ad-4f8a-9b7b-f20527a941e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b970e6cc62d14619b0df478574755d6d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:37.943938 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b5391119-d3ad-4f8a-9b7b-f20527a941e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b970e6cc62d14619b0df478574755d6d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:37.946182 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b93a6-e6f5-4c1c-b116-dd6b70550cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:37.951911 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b93a6-e6f5-4c1c-b116-dd6b70550cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:37.952311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b93a6-e6f5-4c1c-b116-dd6b70550cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:37.952554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b93a6-e6f5-4c1c-b116-dd6b70550cb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:37.957600 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b93a6-e6f5-4c1c-b116-dd6b70550cb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:37.959009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b93a6-e6f5-4c1c-b116-dd6b70550cb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:37.978487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b93a6-e6f5-4c1c-b116-dd6b70550cb1 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:37.999690 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 859/1688] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:38.001734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f48189-7d2d-4cac-bd1c-b38580c11923 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.002174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f48189-7d2d-4cac-bd1c-b38580c11923 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.002612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f48189-7d2d-4cac-bd1c-b38580c11923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.013937 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b5391119-d3ad-4f8a-9b7b-f20527a941e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b970e6cc62d14619b0df478574755d6d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:38.020870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b5391119-d3ad-4f8a-9b7b-f20527a941e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b970e6cc62d14619b0df478574755d6d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:38.045398 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-80f48189-7d2d-4cac-bd1c-b38580c11923 None None] MFA Rules not processed for user `0d3510e93cba44078ede0016f88d1032`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:38.047773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-80f48189-7d2d-4cac-bd1c-b38580c11923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:38.191211 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b5391119-d3ad-4f8a-9b7b-f20527a941e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b970e6cc62d14619b0df478574755d6d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:38.234595 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 830/1689] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:37 2022] DELETE /identity/v3/users/b970e6cc62d14619b0df478574755d6d => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:38.236523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5391119-d3ad-4f8a-9b7b-f20527a941e6 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:38.244116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b5391119-d3ad-4f8a-9b7b-f20527a941e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:38.308833 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 860/1690] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:38.312749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4de39-9d35-44a9-a8e9-ac892693f98d None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.313392 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4de39-9d35-44a9-a8e9-ac892693f98d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.313813 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4de39-9d35-44a9-a8e9-ac892693f98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.366350 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:38.454246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-8ae4de39-9d35-44a9-a8e9-ac892693f98d None None] MFA Rules not processed for user `46e1408cf45241208f6c7f485fb4a182`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:38.456487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-8ae4de39-9d35-44a9-a8e9-ac892693f98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:38.463129 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5391119-d3ad-4f8a-9b7b-f20527a941e6 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:38.474307 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d3062-3282-41ac-ba9b-62bee824372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:38.474307 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d3062-3282-41ac-ba9b-62bee824372e admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.474307 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d3062-3282-41ac-ba9b-62bee824372e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.474307 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d3062-3282-41ac-ba9b-62bee824372e admin admin] PATH_INFO: `/v3/projects/d49a0c1a926848f78b178266e90a1e78/users/64684c0667d042ae90c78de65fa12f78/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.528992 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d3062-3282-41ac-ba9b-62bee824372e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d49a0c1a926848f78b178266e90a1e78, user_id=64684c0667d042ae90c78de65fa12f78, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:38.538535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d3062-3282-41ac-ba9b-62bee824372e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:38.692455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 831/1691] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:38 2022] PUT /identity/v3/projects/d49a0c1a926848f78b178266e90a1e78/users/64684c0667d042ae90c78de65fa12f78/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:38.693649 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d3062-3282-41ac-ba9b-62bee824372e admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:38.704387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b27d3062-3282-41ac-ba9b-62bee824372e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:38.706459 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 861/1692] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:38.709470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51de1af-3b61-4bfa-a517-7a8f3a4c4809 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.709470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51de1af-3b61-4bfa-a517-7a8f3a4c4809 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.709673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51de1af-3b61-4bfa-a517-7a8f3a4c4809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.743318 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-c51de1af-3b61-4bfa-a517-7a8f3a4c4809 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:38.744932 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c51de1af-3b61-4bfa-a517-7a8f3a4c4809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:38.877387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d3062-3282-41ac-ba9b-62bee824372e admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:38.885675 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e909f3-0519-4ded-a1ba-8eaa4931d16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:38.893102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e909f3-0519-4ded-a1ba-8eaa4931d16a admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.893102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e909f3-0519-4ded-a1ba-8eaa4931d16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.893102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e909f3-0519-4ded-a1ba-8eaa4931d16a admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.893102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e909f3-0519-4ded-a1ba-8eaa4931d16a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:38.895391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e909f3-0519-4ded-a1ba-8eaa4931d16a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:38.909649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 862/1693] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:38.915506 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775f459-9f03-4798-930e-6e9b767239a1 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:38.915806 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775f459-9f03-4798-930e-6e9b767239a1 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:38.916178 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775f459-9f03-4798-930e-6e9b767239a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:38.946371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-a775f459-9f03-4798-930e-6e9b767239a1 None None] MFA Rules not processed for user `0d3510e93cba44078ede0016f88d1032`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:38.951259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a775f459-9f03-4798-930e-6e9b767239a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:39.092334 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 863/1694] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:39.094904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68baa97-ff88-4cd3-a325-260539105b72 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.095458 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68baa97-ff88-4cd3-a325-260539105b72 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.096070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68baa97-ff88-4cd3-a325-260539105b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.128547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 832/1695] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:38 2022] POST /identity/v3/projects => generated 385 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:39.131179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e909f3-0519-4ded-a1ba-8eaa4931d16a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:39.162044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-e68baa97-ff88-4cd3-a325-260539105b72 None None] MFA Rules not processed for user `538cc13998f14a3ba870184f18648526`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:39.163778 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e68baa97-ff88-4cd3-a325-260539105b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:39.225787 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e909f3-0519-4ded-a1ba-8eaa4931d16a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:39.232671 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8c5b0-1d70-4e20-8c16-0530bb8b388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:39.233909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c5b0-1d70-4e20-8c16-0530bb8b388c admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.234502 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c5b0-1d70-4e20-8c16-0530bb8b388c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.235003 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c5b0-1d70-4e20-8c16-0530bb8b388c admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.236015 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8c5b0-1d70-4e20-8c16-0530bb8b388c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:39.238656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8c5b0-1d70-4e20-8c16-0530bb8b388c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:39.253252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 833/1696] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:39.255787 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae499428-1add-4215-a4b9-93e23f3a5b3b None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.256593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae499428-1add-4215-a4b9-93e23f3a5b3b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.257106 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae499428-1add-4215-a4b9-93e23f3a5b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.296938 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-ae499428-1add-4215-a4b9-93e23f3a5b3b None None] MFA Rules not processed for user `46e1408cf45241208f6c7f485fb4a182`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:39.298725 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ae499428-1add-4215-a4b9-93e23f3a5b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:39.373837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 864/1697] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:39.373837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68baa97-ff88-4cd3-a325-260539105b72 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:39.373837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e68baa97-ff88-4cd3-a325-260539105b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:39.401929 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68baa97-ff88-4cd3-a325-260539105b72 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:39.410003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c092edb-8b00-4289-aea0-0cc2b9aec436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:39.411442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c092edb-8b00-4289-aea0-0cc2b9aec436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.413093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c092edb-8b00-4289-aea0-0cc2b9aec436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.413608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c092edb-8b00-4289-aea0-0cc2b9aec436 admin admin] PATH_INFO: `/v3/projects/ccd1cf1ca65c44af9dc3dcd4f85c2586` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.415326 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c092edb-8b00-4289-aea0-0cc2b9aec436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd1cf1ca65c44af9dc3dcd4f85c2586)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:39.418194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c092edb-8b00-4289-aea0-0cc2b9aec436 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:39.440580 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 834/1698] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:39.441967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae499428-1add-4215-a4b9-93e23f3a5b3b None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:39.449720 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ae499428-1add-4215-a4b9-93e23f3a5b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:39.485765 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:39.566356 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae499428-1add-4215-a4b9-93e23f3a5b3b None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:39.575521 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60261f2-530d-4ea3-ac4d-fe5ccc77c7e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:39.579757 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60261f2-530d-4ea3-ac4d-fe5ccc77c7e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.580692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60261f2-530d-4ea3-ac4d-fe5ccc77c7e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.580903 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60261f2-530d-4ea3-ac4d-fe5ccc77c7e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.593773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60261f2-530d-4ea3-ac4d-fe5ccc77c7e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:39.595518 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60261f2-530d-4ea3-ac4d-fe5ccc77c7e6 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:39.620728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 835/1699] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:39.624173 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60261f2-530d-4ea3-ac4d-fe5ccc77c7e6 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:39.629340 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a60261f2-530d-4ea3-ac4d-fe5ccc77c7e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:39.634458 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-4c092edb-8b00-4289-aea0-0cc2b9aec436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd1cf1ca65c44af9dc3dcd4f85c2586', 'request_id': 'req-4c092edb-8b00-4289-aea0-0cc2b9aec436'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:39.656188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-4c092edb-8b00-4289-aea0-0cc2b9aec436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd1cf1ca65c44af9dc3dcd4f85c2586', 'request_id': 'req-4c092edb-8b00-4289-aea0-0cc2b9aec436'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:39.665454 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-4c092edb-8b00-4289-aea0-0cc2b9aec436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd1cf1ca65c44af9dc3dcd4f85c2586', 'request_id': 'req-4c092edb-8b00-4289-aea0-0cc2b9aec436'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:39.771220 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60261f2-530d-4ea3-ac4d-fe5ccc77c7e6 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:39.791387 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-4c092edb-8b00-4289-aea0-0cc2b9aec436 admin admin] The token cache is being invalidate because project ccd1cf1ca65c44af9dc3dcd4f85c2586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:39.791387 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-4c092edb-8b00-4289-aea0-0cc2b9aec436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:39.791387 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-4c092edb-8b00-4289-aea0-0cc2b9aec436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:39.791387 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 865/1700] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:39 2022] DELETE /identity/v3/projects/ccd1cf1ca65c44af9dc3dcd4f85c2586 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:39.791387 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c092edb-8b00-4289-aea0-0cc2b9aec436 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:39.792023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4c092edb-8b00-4289-aea0-0cc2b9aec436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:39.950372 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca468f-65a0-4823-9109-5655d631fd9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:39.952057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca468f-65a0-4823-9109-5655d631fd9f service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.953753 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca468f-65a0-4823-9109-5655d631fd9f service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.954394 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c092edb-8b00-4289-aea0-0cc2b9aec436 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:39.954820 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca468f-65a0-4823-9109-5655d631fd9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.966503 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c01067-ca6e-46e8-afa9-d05b2948c1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:39.968571 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c01067-ca6e-46e8-afa9-d05b2948c1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:39.969106 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c01067-ca6e-46e8-afa9-d05b2948c1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:39.977095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c01067-ca6e-46e8-afa9-d05b2948c1d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:39.977095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c01067-ca6e-46e8-afa9-d05b2948c1d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:39.977095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c01067-ca6e-46e8-afa9-d05b2948c1d5 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:39.982700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e0ca468f-65a0-4823-9109-5655d631fd9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:40.093824 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 866/1701] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:39 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:40.095314 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c01067-ca6e-46e8-afa9-d05b2948c1d5 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:40.100705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-99c01067-ca6e-46e8-afa9-d05b2948c1d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:40.142880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca468f-65a0-4823-9109-5655d631fd9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:40.145039 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca468f-65a0-4823-9109-5655d631fd9f service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:40.145756 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c01067-ca6e-46e8-afa9-d05b2948c1d5 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:40.153219 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9e256-a0f2-4267-8eb9-68e345376fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:40.154207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e256-a0f2-4267-8eb9-68e345376fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:40.154487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e256-a0f2-4267-8eb9-68e345376fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:40.155347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9e256-a0f2-4267-8eb9-68e345376fbb admin admin] PATH_INFO: `/v3/projects/d49a0c1a926848f78b178266e90a1e78/users/64684c0667d042ae90c78de65fa12f78/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:40.157614 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 836/1702] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:40.158238 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e256-a0f2-4267-8eb9-68e345376fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d49a0c1a926848f78b178266e90a1e78, user_id=64684c0667d042ae90c78de65fa12f78, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:40.158596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca468f-65a0-4823-9109-5655d631fd9f service nova] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:40.160673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e0ca468f-65a0-4823-9109-5655d631fd9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:40.161271 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9e256-a0f2-4267-8eb9-68e345376fbb admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:40.195344 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 867/1703] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:40 2022] PUT /identity/v3/projects/d49a0c1a926848f78b178266e90a1e78/users/64684c0667d042ae90c78de65fa12f78/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:40.195544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca468f-65a0-4823-9109-5655d631fd9f service nova] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:40.195670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe94aa-7b07-44c4-930c-d466345016a4 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:40.195670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe94aa-7b07-44c4-930c-d466345016a4 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:40.195670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe94aa-7b07-44c4-930c-d466345016a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:40.220860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-7cfe94aa-7b07-44c4-930c-d466345016a4 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:40.223786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-7cfe94aa-7b07-44c4-930c-d466345016a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:40.321396 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70024e-81b1-4084-a3b3-b0e6a6a64ddd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:40.322190 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70024e-81b1-4084-a3b3-b0e6a6a64ddd service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:40.322545 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70024e-81b1-4084-a3b3-b0e6a6a64ddd service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:40.322895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70024e-81b1-4084-a3b3-b0e6a6a64ddd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:40.322999 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 868/1704] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:40.324338 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabbfdc-c2fc-4314-b9c5-2957fd167311 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:40.324794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabbfdc-c2fc-4314-b9c5-2957fd167311 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:40.325085 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabbfdc-c2fc-4314-b9c5-2957fd167311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:40.333801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-bb70024e-81b1-4084-a3b3-b0e6a6a64ddd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:40.390489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-5eabbfdc-c2fc-4314-b9c5-2957fd167311 None None] MFA Rules not processed for user `f6683ab715b3452a8a79b89be6b3bfce`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:40.390489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5eabbfdc-c2fc-4314-b9c5-2957fd167311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:40.462827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70024e-81b1-4084-a3b3-b0e6a6a64ddd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:40.464609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70024e-81b1-4084-a3b3-b0e6a6a64ddd service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:40.493357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 869/1705] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:40.494542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabbfdc-c2fc-4314-b9c5-2957fd167311 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:40.500965 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 837/1706] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:40.508061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4997f73-e2c5-4e00-bcca-d432fc13f9dc None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:40.508517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4997f73-e2c5-4e00-bcca-d432fc13f9dc None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:40.509248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4997f73-e2c5-4e00-bcca-d432fc13f9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:40.510670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabbfdc-c2fc-4314-b9c5-2957fd167311 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:40.530777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddd5e7-e619-430d-89b1-a1ddffab258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:40.531489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddd5e7-e619-430d-89b1-a1ddffab258a admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:40.531784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddd5e7-e619-430d-89b1-a1ddffab258a admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:40.534829 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddd5e7-e619-430d-89b1-a1ddffab258a admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:40.534961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddd5e7-e619-430d-89b1-a1ddffab258a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:40.540307 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddd5e7-e619-430d-89b1-a1ddffab258a admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:40.564234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 870/1707] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:40.565176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e48597-8c5c-4b89-b979-4f4d6227aa6e None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:40.566055 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e48597-8c5c-4b89-b979-4f4d6227aa6e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:40.567948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e48597-8c5c-4b89-b979-4f4d6227aa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:40.581027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-e4997f73-e2c5-4e00-bcca-d432fc13f9dc None None] MFA Rules not processed for user `64684c0667d042ae90c78de65fa12f78`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:40.582592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e4997f73-e2c5-4e00-bcca-d432fc13f9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:40.610874 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-20e48597-8c5c-4b89-b979-4f4d6227aa6e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:40.614532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-20e48597-8c5c-4b89-b979-4f4d6227aa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:40.659088 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 871/1708] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:40.660248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e48597-8c5c-4b89-b979-4f4d6227aa6e None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:40.662840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-20e48597-8c5c-4b89-b979-4f4d6227aa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:40.687899 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e48597-8c5c-4b89-b979-4f4d6227aa6e None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:40.703201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c00040-7609-474e-aed9-1ec6f87c6e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:40.704237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c00040-7609-474e-aed9-1ec6f87c6e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:40.704600 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c00040-7609-474e-aed9-1ec6f87c6e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:40.704994 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c00040-7609-474e-aed9-1ec6f87c6e3a admin admin] PATH_INFO: `/v3/projects/65b33bec47c34bf19a23b28f5db7696b` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:40.706880 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c00040-7609-474e-aed9-1ec6f87c6e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b33bec47c34bf19a23b28f5db7696b)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:40.716393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c00040-7609-474e-aed9-1ec6f87c6e3a admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:40.782439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 838/1709] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:40 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:40.782439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4997f73-e2c5-4e00-bcca-d432fc13f9dc None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:40.812299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4997f73-e2c5-4e00-bcca-d432fc13f9dc None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:40.818934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709891f-6fa1-4d4a-8e9e-0279d30f32d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:40.832773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709891f-6fa1-4d4a-8e9e-0279d30f32d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:40.832773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709891f-6fa1-4d4a-8e9e-0279d30f32d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:40.832773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709891f-6fa1-4d4a-8e9e-0279d30f32d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:40.832773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709891f-6fa1-4d4a-8e9e-0279d30f32d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:40.832773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709891f-6fa1-4d4a-8e9e-0279d30f32d7 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:40.840758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 839/1710] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:40.843613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709891f-6fa1-4d4a-8e9e-0279d30f32d7 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:40.857402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709891f-6fa1-4d4a-8e9e-0279d30f32d7 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:40.864829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20e633-9104-4d8e-b7b4-969b16abda09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:40.865568 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20e633-9104-4d8e-b7b4-969b16abda09 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:40.865891 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20e633-9104-4d8e-b7b4-969b16abda09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:40.867745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20e633-9104-4d8e-b7b4-969b16abda09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:40.868424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20e633-9104-4d8e-b7b4-969b16abda09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:40.868784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20e633-9104-4d8e-b7b4-969b16abda09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:40.871403 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20e633-9104-4d8e-b7b4-969b16abda09 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:40.892906 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 840/1711] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:40.895875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20e633-9104-4d8e-b7b4-969b16abda09 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:40.899212 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-db20e633-9104-4d8e-b7b4-969b16abda09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:40.997404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-c5c00040-7609-474e-aed9-1ec6f87c6e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b33bec47c34bf19a23b28f5db7696b', 'request_id': 'req-c5c00040-7609-474e-aed9-1ec6f87c6e3a'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.002120 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20e633-9104-4d8e-b7b4-969b16abda09 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:41.008604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-c5c00040-7609-474e-aed9-1ec6f87c6e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b33bec47c34bf19a23b28f5db7696b', 'request_id': 'req-c5c00040-7609-474e-aed9-1ec6f87c6e3a'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.014690 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-c5c00040-7609-474e-aed9-1ec6f87c6e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b33bec47c34bf19a23b28f5db7696b', 'request_id': 'req-c5c00040-7609-474e-aed9-1ec6f87c6e3a'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.053503 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:41.099178 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f82d3-6e62-4e5f-9158-5798ead45726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:41.100111 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f82d3-6e62-4e5f-9158-5798ead45726 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:41.100428 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f82d3-6e62-4e5f-9158-5798ead45726 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:41.100713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f82d3-6e62-4e5f-9158-5798ead45726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:41.232212 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-c5c00040-7609-474e-aed9-1ec6f87c6e3a admin admin] The token cache is being invalidate because project 65b33bec47c34bf19a23b28f5db7696b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:41.232935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-c5c00040-7609-474e-aed9-1ec6f87c6e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.234244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-c5c00040-7609-474e-aed9-1ec6f87c6e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:41.240020 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 872/1712] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:40 2022] DELETE /identity/v3/projects/65b33bec47c34bf19a23b28f5db7696b => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:41.241510 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c00040-7609-474e-aed9-1ec6f87c6e3a admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:41.243777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c5c00040-7609-474e-aed9-1ec6f87c6e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:41.386927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c00040-7609-474e-aed9-1ec6f87c6e3a admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:41.401907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd966736-c592-4980-beaa-3d65635fd697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:41.402512 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd966736-c592-4980-beaa-3d65635fd697 service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:41.402810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd966736-c592-4980-beaa-3d65635fd697 service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:41.403092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd966736-c592-4980-beaa-3d65635fd697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:41.408973 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-bd966736-c592-4980-beaa-3d65635fd697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:41.444274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f82d3-6e62-4e5f-9158-5798ead45726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:41.446556 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f82d3-6e62-4e5f-9158-5798ead45726 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:41.462534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 841/1713] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:40 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:41.463644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f82d3-6e62-4e5f-9158-5798ead45726 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:41.560604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd966736-c592-4980-beaa-3d65635fd697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:41.564844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd966736-c592-4980-beaa-3d65635fd697 service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:41.576333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f82d3-6e62-4e5f-9158-5798ead45726 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:41.590238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8311514-90d8-4ef9-846b-87a8af70a472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:41.591443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8311514-90d8-4ef9-846b-87a8af70a472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:41.591443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8311514-90d8-4ef9-846b-87a8af70a472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:41.591609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8311514-90d8-4ef9-846b-87a8af70a472 admin admin] PATH_INFO: `/v3/projects/75fa7072a06f426c8e26df97c22ef6ec/users/7301235bbc9942bca12702a423f73106/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:41.600933 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 873/1714] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:41.601770 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd966736-c592-4980-beaa-3d65635fd697 service nova] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:41.605389 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-bd966736-c592-4980-beaa-3d65635fd697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:41.628504 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8311514-90d8-4ef9-846b-87a8af70a472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75fa7072a06f426c8e26df97c22ef6ec, user_id=7301235bbc9942bca12702a423f73106, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:41.631904 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8311514-90d8-4ef9-846b-87a8af70a472 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:41.650119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd966736-c592-4980-beaa-3d65635fd697 service nova] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:41.660365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1d338-f10c-4b13-aa09-732e7686b35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:41.661635 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1d338-f10c-4b13-aa09-732e7686b35d admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:41.662166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1d338-f10c-4b13-aa09-732e7686b35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:41.662656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1d338-f10c-4b13-aa09-732e7686b35d admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:41.663995 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1d338-f10c-4b13-aa09-732e7686b35d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:41.668642 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1d338-f10c-4b13-aa09-732e7686b35d admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:41.821388 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 842/1715] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:41 2022] PUT /identity/v3/projects/75fa7072a06f426c8e26df97c22ef6ec/users/7301235bbc9942bca12702a423f73106/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:41.832623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc8201-ccc6-449c-a0d8-4dedc0a65a91 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:41.832623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc8201-ccc6-449c-a0d8-4dedc0a65a91 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:41.832623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc8201-ccc6-449c-a0d8-4dedc0a65a91 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:41.832623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 843/1716] 10.222.0.23 () {54 vars in 912 bytes} [Thu Jun 16 15:03:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:03:41.832623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc8201-ccc6-449c-a0d8-4dedc0a65a91 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:41.837730 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-21cc8201-ccc6-449c-a0d8-4dedc0a65a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:41.854753 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 874/1717] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:41 2022] POST /identity/v3/projects => generated 371 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:41.857767 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b9a3a-58b2-407a-8d7b-a5de367f42d9 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:41.857982 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b9a3a-58b2-407a-8d7b-a5de367f42d9 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:41.858487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b9a3a-58b2-407a-8d7b-a5de367f42d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:41.909684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-7a0b9a3a-58b2-407a-8d7b-a5de367f42d9 None None] MFA Rules not processed for user `7301235bbc9942bca12702a423f73106`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:41.912113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-7a0b9a3a-58b2-407a-8d7b-a5de367f42d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:41.948544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc8201-ccc6-449c-a0d8-4dedc0a65a91 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:41.959412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb5b35-4e56-4190-aed4-fcbdecb4d22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:41.961126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb5b35-4e56-4190-aed4-fcbdecb4d22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:41.964929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb5b35-4e56-4190-aed4-fcbdecb4d22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:41.964929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb5b35-4e56-4190-aed4-fcbdecb4d22b admin admin] PATH_INFO: `/v3/users/74a045db1b014b2c884a5f0eb9fa617d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:41.976416 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb5b35-4e56-4190-aed4-fcbdecb4d22b admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a045db1b014b2c884a5f0eb9fa617d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:41.976416 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb5b35-4e56-4190-aed4-fcbdecb4d22b admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:42.079165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 875/1718] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:42.089112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5cd70-d6da-444b-886f-4f9bacbdb4c6 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:42.089112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5cd70-d6da-444b-886f-4f9bacbdb4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:42.089112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5cd70-d6da-444b-886f-4f9bacbdb4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:42.151158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-dec5cd70-d6da-444b-886f-4f9bacbdb4c6 None None] MFA Rules not processed for user `db3b603ceffb43bc99684e0d2319e3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:42.152389 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-dec5cd70-d6da-444b-886f-4f9bacbdb4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:42.218161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 876/1719] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 16 15:03:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:42.219026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5cd70-d6da-444b-886f-4f9bacbdb4c6 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:42.231830 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5cd70-d6da-444b-886f-4f9bacbdb4c6 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:42.241527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ce697-b067-4349-9dd2-23eb463edf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:42.242301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ce697-b067-4349-9dd2-23eb463edf47 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:42.242665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ce697-b067-4349-9dd2-23eb463edf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:42.243017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ce697-b067-4349-9dd2-23eb463edf47 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:42.243803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ce697-b067-4349-9dd2-23eb463edf47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:42.246159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ce697-b067-4349-9dd2-23eb463edf47 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:42.398670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 877/1720] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:42 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:42.399633 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ce697-b067-4349-9dd2-23eb463edf47 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:42.406676 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ee7ce697-b067-4349-9dd2-23eb463edf47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:42.421985 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-42fb5b35-4e56-4190-aed4-fcbdecb4d22b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a045db1b014b2c884a5f0eb9fa617d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:42.422821 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-42fb5b35-4e56-4190-aed4-fcbdecb4d22b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a045db1b014b2c884a5f0eb9fa617d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:42.440296 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-42fb5b35-4e56-4190-aed4-fcbdecb4d22b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a045db1b014b2c884a5f0eb9fa617d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:42.450224 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-42fb5b35-4e56-4190-aed4-fcbdecb4d22b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a045db1b014b2c884a5f0eb9fa617d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:42.537948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ce697-b067-4349-9dd2-23eb463edf47 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:42.552538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4113c9-6b46-4a41-9978-f58f93a1c838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:42.553389 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4113c9-6b46-4a41-9978-f58f93a1c838 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:42.553792 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4113c9-6b46-4a41-9978-f58f93a1c838 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:42.554191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4113c9-6b46-4a41-9978-f58f93a1c838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:42.558264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-7c4113c9-6b46-4a41-9978-f58f93a1c838 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:42.676186 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-42fb5b35-4e56-4190-aed4-fcbdecb4d22b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a045db1b014b2c884a5f0eb9fa617d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:42.724452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 844/1721] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:41 2022] DELETE /identity/v3/users/74a045db1b014b2c884a5f0eb9fa617d => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:42.726240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb5b35-4e56-4190-aed4-fcbdecb4d22b admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:42.732158 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-42fb5b35-4e56-4190-aed4-fcbdecb4d22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:42.787154 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4113c9-6b46-4a41-9978-f58f93a1c838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:42.790361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4113c9-6b46-4a41-9978-f58f93a1c838 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:42.806298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 878/1722] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:42.808074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4113c9-6b46-4a41-9978-f58f93a1c838 service cinder] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:42.811068 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-7c4113c9-6b46-4a41-9978-f58f93a1c838 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:42.851814 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4113c9-6b46-4a41-9978-f58f93a1c838 service cinder] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:42.935655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb5b35-4e56-4190-aed4-fcbdecb4d22b admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:42.948499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514e15d-2b48-46ed-a3b1-825c1980dd8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:42.949206 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514e15d-2b48-46ed-a3b1-825c1980dd8a service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:42.949866 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514e15d-2b48-46ed-a3b1-825c1980dd8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:42.950103 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514e15d-2b48-46ed-a3b1-825c1980dd8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:42.954037 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-5514e15d-2b48-46ed-a3b1-825c1980dd8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:43.006685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:43.036057 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8bc2c-2a90-43cc-88a8-e317f6440b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:43.040144 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8bc2c-2a90-43cc-88a8-e317f6440b47 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:43.041710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8bc2c-2a90-43cc-88a8-e317f6440b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:43.042239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8bc2c-2a90-43cc-88a8-e317f6440b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:43.046219 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0bc8bc2c-2a90-43cc-88a8-e317f6440b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:43.063077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8bc2c-2a90-43cc-88a8-e317f6440b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:43.065295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8bc2c-2a90-43cc-88a8-e317f6440b47 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:43.077582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 879/1723] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:43.078614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8bc2c-2a90-43cc-88a8-e317f6440b47 service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:43.080359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0bc8bc2c-2a90-43cc-88a8-e317f6440b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:43.138627 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514e15d-2b48-46ed-a3b1-825c1980dd8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:43.141025 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514e15d-2b48-46ed-a3b1-825c1980dd8a service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:43.166520 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 845/1724] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:43.174108 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea7df1-b101-4124-aedd-440f438d569e None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:43.174108 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea7df1-b101-4124-aedd-440f438d569e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:43.174108 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea7df1-b101-4124-aedd-440f438d569e None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:43.175796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 846/1725] 10.222.0.23 () {54 vars in 912 bytes} [Thu Jun 16 15:03:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:03:43.183080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b229c7-d1b0-4ba7-9695-660dc01181b2 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:43.184590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b229c7-d1b0-4ba7-9695-660dc01181b2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:43.184812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b229c7-d1b0-4ba7-9695-660dc01181b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:43.232652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-e7b229c7-d1b0-4ba7-9695-660dc01181b2 None None] MFA Rules not processed for user `db3b603ceffb43bc99684e0d2319e3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:43.234189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e7b229c7-d1b0-4ba7-9695-660dc01181b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:43.235643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8bc2c-2a90-43cc-88a8-e317f6440b47 service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:43.250099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 847/1726] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 16 15:03:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:43.263699 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc31d4f-5408-48fe-8902-5e3f4753a381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:43.263699 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc31d4f-5408-48fe-8902-5e3f4753a381 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:43.264446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b229c7-d1b0-4ba7-9695-660dc01181b2 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:43.264543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc31d4f-5408-48fe-8902-5e3f4753a381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:43.264543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc31d4f-5408-48fe-8902-5e3f4753a381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:43.265528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e7b229c7-d1b0-4ba7-9695-660dc01181b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:43.268483 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc31d4f-5408-48fe-8902-5e3f4753a381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:43.275872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc31d4f-5408-48fe-8902-5e3f4753a381 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:43.287071 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b229c7-d1b0-4ba7-9695-660dc01181b2 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:43.307108 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 880/1727] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:43.308291 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc31d4f-5408-48fe-8902-5e3f4753a381 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:43.311482 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c7465-7fe5-4b92-9305-54c559820bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:43.314734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7465-7fe5-4b92-9305-54c559820bbf service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:43.324374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7465-7fe5-4b92-9305-54c559820bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:43.324374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c7465-7fe5-4b92-9305-54c559820bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:43.359034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c7465-7fe5-4b92-9305-54c559820bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:43.360732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c7465-7fe5-4b92-9305-54c559820bbf service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:43.369294 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc31d4f-5408-48fe-8902-5e3f4753a381 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:43.373841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d5c2c-a73a-497a-ba12-e0dd535d3ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:43.374593 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d5c2c-a73a-497a-ba12-e0dd535d3ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:43.374888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d5c2c-a73a-497a-ba12-e0dd535d3ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:43.375172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d5c2c-a73a-497a-ba12-e0dd535d3ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:43.376139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d5c2c-a73a-497a-ba12-e0dd535d3ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:43.379372 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d5c2c-a73a-497a-ba12-e0dd535d3ab5 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:43.390945 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 848/1728] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:03:43.396533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 881/1729] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:43.397909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c7465-7fe5-4b92-9305-54c559820bbf service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:43.437274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c7465-7fe5-4b92-9305-54c559820bbf service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:43.438936 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad958664-1588-4e7a-a3d4-d4998824509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:43.439947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad958664-1588-4e7a-a3d4-d4998824509a admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:43.440309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad958664-1588-4e7a-a3d4-d4998824509a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:43.440664 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad958664-1588-4e7a-a3d4-d4998824509a admin admin] PATH_INFO: `/v3/projects/9f4bc583211d434284e7b4200dbb8360/users/49ba5ad092384a3f89ce6118f2fff558/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:43.496706 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad958664-1588-4e7a-a3d4-d4998824509a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f4bc583211d434284e7b4200dbb8360, user_id=49ba5ad092384a3f89ce6118f2fff558, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:43.506919 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad958664-1588-4e7a-a3d4-d4998824509a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:43.656477 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 849/1730] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:43 2022] PUT /identity/v3/projects/9f4bc583211d434284e7b4200dbb8360/users/49ba5ad092384a3f89ce6118f2fff558/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:43.675835 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c3d5c-1a25-42c2-adc2-597c6157b1f4 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:43.677455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c3d5c-1a25-42c2-adc2-597c6157b1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:43.677890 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c3d5c-1a25-42c2-adc2-597c6157b1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:43.783714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-701c3d5c-1a25-42c2-adc2-597c6157b1f4 None None] MFA Rules not processed for user `49ba5ad092384a3f89ce6118f2fff558`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:43.790502 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-701c3d5c-1a25-42c2-adc2-597c6157b1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:43.989214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 882/1731] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:44.212135 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad958664-1588-4e7a-a3d4-d4998824509a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:44.214198 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ad958664-1588-4e7a-a3d4-d4998824509a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:44.340806 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad958664-1588-4e7a-a3d4-d4998824509a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:44.361068 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c3d5c-1a25-42c2-adc2-597c6157b1f4 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:44.361710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc3719-2f0a-42a4-a5ce-ca86b1657c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:44.362992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-701c3d5c-1a25-42c2-adc2-597c6157b1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:44.366488 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc3719-2f0a-42a4-a5ce-ca86b1657c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:44.366847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc3719-2f0a-42a4-a5ce-ca86b1657c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:44.367145 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc3719-2f0a-42a4-a5ce-ca86b1657c06 admin admin] PATH_INFO: `/v3/projects/a920cd2ab89341cd93d10d60a9bd9f79` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:44.369377 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc3719-2f0a-42a4-a5ce-ca86b1657c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a920cd2ab89341cd93d10d60a9bd9f79)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:44.378359 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc3719-2f0a-42a4-a5ce-ca86b1657c06 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:44.525279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c3d5c-1a25-42c2-adc2-597c6157b1f4 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:44.531597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5314d33-1091-4958-9c64-533321df857f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:44.532386 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5314d33-1091-4958-9c64-533321df857f service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:44.532617 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5314d33-1091-4958-9c64-533321df857f service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:44.532905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5314d33-1091-4958-9c64-533321df857f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:44.541943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5314d33-1091-4958-9c64-533321df857f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:44.543578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5314d33-1091-4958-9c64-533321df857f service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:44.555759 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 883/1732] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:44.557223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dee5d6-447b-44e8-868f-133a9f199856 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:44.557634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dee5d6-447b-44e8-868f-133a9f199856 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:44.557921 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dee5d6-447b-44e8-868f-133a9f199856 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:44.559713 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 884/1733] 10.222.0.23 () {54 vars in 960 bytes} [Thu Jun 16 15:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:03:44.560626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dee5d6-447b-44e8-868f-133a9f199856 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:44.563954 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-30dee5d6-447b-44e8-868f-133a9f199856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:44.656216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-90fc3719-2f0a-42a4-a5ce-ca86b1657c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a920cd2ab89341cd93d10d60a9bd9f79', 'request_id': 'req-90fc3719-2f0a-42a4-a5ce-ca86b1657c06'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.676110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-90fc3719-2f0a-42a4-a5ce-ca86b1657c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a920cd2ab89341cd93d10d60a9bd9f79', 'request_id': 'req-90fc3719-2f0a-42a4-a5ce-ca86b1657c06'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.683346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-90fc3719-2f0a-42a4-a5ce-ca86b1657c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a920cd2ab89341cd93d10d60a9bd9f79', 'request_id': 'req-90fc3719-2f0a-42a4-a5ce-ca86b1657c06'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.711207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dee5d6-447b-44e8-868f-133a9f199856 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:44.838800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-90fc3719-2f0a-42a4-a5ce-ca86b1657c06 admin admin] The token cache is being invalidate because project a920cd2ab89341cd93d10d60a9bd9f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:44.839384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-90fc3719-2f0a-42a4-a5ce-ca86b1657c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.858429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-90fc3719-2f0a-42a4-a5ce-ca86b1657c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:44.858429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 850/1734] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:44 2022] DELETE /identity/v3/projects/a920cd2ab89341cd93d10d60a9bd9f79 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:44.863993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74f733-8d89-4464-9139-e3c1113c085b None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:44.865500 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74f733-8d89-4464-9139-e3c1113c085b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:44.866603 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74f733-8d89-4464-9139-e3c1113c085b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:44.953741 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-eb74f733-8d89-4464-9139-e3c1113c085b None None] MFA Rules not processed for user `534035b2e8cf4f769e3dbbaabc0f6ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:44.955604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c5122-23df-464b-9f3a-e65d3812fc8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534035b2e8cf4f769e3dbbaabc0f6ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:44.955912 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-eb74f733-8d89-4464-9139-e3c1113c085b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:44.955993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c5122-23df-464b-9f3a-e65d3812fc8d service placement] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:44.956524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c5122-23df-464b-9f3a-e65d3812fc8d service placement] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:44.956524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c5122-23df-464b-9f3a-e65d3812fc8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:44.965757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-129c5122-23df-464b-9f3a-e65d3812fc8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:44.972655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 851/1735] 10.222.0.23 () {58 vars in 1057 bytes} [Thu Jun 16 15:03:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:44.974839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036d54b-5aaa-4c30-903f-12e4cebe2c1e None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:44.974839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036d54b-5aaa-4c30-903f-12e4cebe2c1e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:44.975088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036d54b-5aaa-4c30-903f-12e4cebe2c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.014943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c5122-23df-464b-9f3a-e65d3812fc8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:45.016695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-0036d54b-5aaa-4c30-903f-12e4cebe2c1e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:45.017967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-0036d54b-5aaa-4c30-903f-12e4cebe2c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:45.020146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c5122-23df-464b-9f3a-e65d3812fc8d service placement] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:45.042374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 885/1736] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:45.044134 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75566a0b-9795-44cd-a88a-1cbac637a3af None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.044428 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75566a0b-9795-44cd-a88a-1cbac637a3af None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.044816 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75566a0b-9795-44cd-a88a-1cbac637a3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.086112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-75566a0b-9795-44cd-a88a-1cbac637a3af None None] MFA Rules not processed for user `0d3510e93cba44078ede0016f88d1032`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:45.089168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-75566a0b-9795-44cd-a88a-1cbac637a3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:45.268747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 852/1737] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:45.268747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036d54b-5aaa-4c30-903f-12e4cebe2c1e None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:45.303374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036d54b-5aaa-4c30-903f-12e4cebe2c1e None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:45.320794 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ba60e-06ea-48df-aaa9-675430c2b8a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534035b2e8cf4f769e3dbbaabc0f6ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:45.321811 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ba60e-06ea-48df-aaa9-675430c2b8a5 service placement] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.322167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ba60e-06ea-48df-aaa9-675430c2b8a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.322555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ba60e-06ea-48df-aaa9-675430c2b8a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.338421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 886/1738] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:45.344818 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ba60e-06ea-48df-aaa9-675430c2b8a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:45.346536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ba60e-06ea-48df-aaa9-675430c2b8a5 service placement] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:45.352909 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42bd35-4cca-44eb-a526-64a758284c2d None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.353247 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42bd35-4cca-44eb-a526-64a758284c2d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.359794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42bd35-4cca-44eb-a526-64a758284c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.407754 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 853/1739] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:45.449374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-9e42bd35-4cca-44eb-a526-64a758284c2d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:45.453492 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9e42bd35-4cca-44eb-a526-64a758284c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:45.493591 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 887/1740] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:45.497627 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ba60e-06ea-48df-aaa9-675430c2b8a5 service placement] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:45.512375 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ba60e-06ea-48df-aaa9-675430c2b8a5 service placement] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:45.542639 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ff8ea-9ea9-412b-8fbc-0bafef46ea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:45.543334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ff8ea-9ea9-412b-8fbc-0bafef46ea08 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.543620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ff8ea-9ea9-412b-8fbc-0bafef46ea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.544149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ff8ea-9ea9-412b-8fbc-0bafef46ea08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.544896 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ff8ea-9ea9-412b-8fbc-0bafef46ea08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:45.545273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ff8ea-9ea9-412b-8fbc-0bafef46ea08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:45.546890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ff8ea-9ea9-412b-8fbc-0bafef46ea08 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:45.582619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 854/1741] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:45.586820 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42bd35-4cca-44eb-a526-64a758284c2d None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:45.603504 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42bd35-4cca-44eb-a526-64a758284c2d None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:45.642066 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520991ec-f8ba-441a-8749-3072a17ade59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:45.644604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520991ec-f8ba-441a-8749-3072a17ade59 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:45.645433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520991ec-f8ba-441a-8749-3072a17ade59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:45.646476 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520991ec-f8ba-441a-8749-3072a17ade59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:45.649080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520991ec-f8ba-441a-8749-3072a17ade59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:45.671955 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520991ec-f8ba-441a-8749-3072a17ade59 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:45.791203 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:45.832835 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 888/1742] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:45 2022] POST /identity/v3/projects => generated 355 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:45.837366 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ff8ea-9ea9-412b-8fbc-0bafef46ea08 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:45.865654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ff8ea-9ea9-412b-8fbc-0bafef46ea08 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:46.068460 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d67c5-fabd-42e1-95e7-2e7d51af9dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:46.069674 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d67c5-fabd-42e1-95e7-2e7d51af9dcf admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:46.070159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d67c5-fabd-42e1-95e7-2e7d51af9dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:46.070583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d67c5-fabd-42e1-95e7-2e7d51af9dcf admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:46.080041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d67c5-fabd-42e1-95e7-2e7d51af9dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:46.080041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d67c5-fabd-42e1-95e7-2e7d51af9dcf admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:46.220102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 855/1743] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:45 2022] POST /identity/v3/users => generated 278 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:46.222575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520991ec-f8ba-441a-8749-3072a17ade59 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:46.271518 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520991ec-f8ba-441a-8749-3072a17ade59 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:46.295101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e507a6-91b0-4b2e-951f-8dcf1d98c0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:46.296414 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e507a6-91b0-4b2e-951f-8dcf1d98c0ca admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:46.296841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e507a6-91b0-4b2e-951f-8dcf1d98c0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:46.297301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e507a6-91b0-4b2e-951f-8dcf1d98c0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:46.298486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e507a6-91b0-4b2e-951f-8dcf1d98c0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:46.300252 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e507a6-91b0-4b2e-951f-8dcf1d98c0ca admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:46.383237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 889/1744] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:46.387323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d67c5-fabd-42e1-95e7-2e7d51af9dcf admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:46.403706 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d67c5-fabd-42e1-95e7-2e7d51af9dcf admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:46.415871 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20875969-e8cc-4ba9-b76f-8ae75f89ce26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:46.418040 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20875969-e8cc-4ba9-b76f-8ae75f89ce26 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:46.418668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20875969-e8cc-4ba9-b76f-8ae75f89ce26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:46.419744 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20875969-e8cc-4ba9-b76f-8ae75f89ce26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:46.421685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20875969-e8cc-4ba9-b76f-8ae75f89ce26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:46.425850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20875969-e8cc-4ba9-b76f-8ae75f89ce26 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:46.453594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 856/1745] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:46.468688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b072435-6116-4a5e-b69f-677e0d551d8a None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:46.469749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b072435-6116-4a5e-b69f-677e0d551d8a None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:46.470351 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b072435-6116-4a5e-b69f-677e0d551d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:46.480788 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20875969-e8cc-4ba9-b76f-8ae75f89ce26 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:46.514736 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20875969-e8cc-4ba9-b76f-8ae75f89ce26 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:46.516000 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-0b072435-6116-4a5e-b69f-677e0d551d8a None None] MFA Rules not processed for user `538cc13998f14a3ba870184f18648526`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:46.518535 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0b072435-6116-4a5e-b69f-677e0d551d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:46.549396 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c18ed-c62d-4ec3-9bac-f5899356f394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:46.566616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c18ed-c62d-4ec3-9bac-f5899356f394 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:46.567054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c18ed-c62d-4ec3-9bac-f5899356f394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:46.567224 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c18ed-c62d-4ec3-9bac-f5899356f394 admin admin] PATH_INFO: `/v3/projects/572f9321cb6848bf93e26eb8ab3efb00/users/ecde93d4fd3142a6984dc0fb85c7bf17/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:46.656954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c18ed-c62d-4ec3-9bac-f5899356f394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=572f9321cb6848bf93e26eb8ab3efb00, user_id=ecde93d4fd3142a6984dc0fb85c7bf17, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:46.673849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c18ed-c62d-4ec3-9bac-f5899356f394 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:46.830684 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 857/1746] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:46 2022] PUT /identity/v3/projects/572f9321cb6848bf93e26eb8ab3efb00/users/ecde93d4fd3142a6984dc0fb85c7bf17/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:46.838986 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c18ed-c62d-4ec3-9bac-f5899356f394 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:46.847377 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-598c18ed-c62d-4ec3-9bac-f5899356f394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:46.873337 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 890/1747] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:46.879004 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd8c1d-b009-4357-92e7-76f07614d23a None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:46.881555 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd8c1d-b009-4357-92e7-76f07614d23a None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:46.881881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd8c1d-b009-4357-92e7-76f07614d23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:46.948923 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-c6cd8c1d-b009-4357-92e7-76f07614d23a None None] MFA Rules not processed for user `ecde93d4fd3142a6984dc0fb85c7bf17`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:46.950112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c6cd8c1d-b009-4357-92e7-76f07614d23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:47.049223 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c18ed-c62d-4ec3-9bac-f5899356f394 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:47.064578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e204db-1301-42e4-b452-4238b0fb3e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:47.086829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e204db-1301-42e4-b452-4238b0fb3e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:47.086829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e204db-1301-42e4-b452-4238b0fb3e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:47.086829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e204db-1301-42e4-b452-4238b0fb3e39 admin admin] PATH_INFO: `/v3/users/49ba5ad092384a3f89ce6118f2fff558` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:47.093438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e204db-1301-42e4-b452-4238b0fb3e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49ba5ad092384a3f89ce6118f2fff558)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:47.098700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e204db-1301-42e4-b452-4238b0fb3e39 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:47.273020 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 891/1748] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:46 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:47.289972 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd8c1d-b009-4357-92e7-76f07614d23a None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:47.328430 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd8c1d-b009-4357-92e7-76f07614d23a None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:47.336574 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9ca89-3067-40f1-a02d-d20e1485b4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:47.337685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9ca89-3067-40f1-a02d-d20e1485b4be admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:47.337991 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9ca89-3067-40f1-a02d-d20e1485b4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:47.338446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9ca89-3067-40f1-a02d-d20e1485b4be admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:47.339340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9ca89-3067-40f1-a02d-d20e1485b4be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:47.342162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9ca89-3067-40f1-a02d-d20e1485b4be admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:47.542142 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 892/1749] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:47 2022] POST /identity/v3/projects => generated 355 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:47.548023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9ca89-3067-40f1-a02d-d20e1485b4be admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:47.595550 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b2e204db-1301-42e4-b452-4238b0fb3e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49ba5ad092384a3f89ce6118f2fff558'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:47.595550 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b2e204db-1301-42e4-b452-4238b0fb3e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49ba5ad092384a3f89ce6118f2fff558'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:47.595550 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b2e204db-1301-42e4-b452-4238b0fb3e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49ba5ad092384a3f89ce6118f2fff558'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:47.596604 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b2e204db-1301-42e4-b452-4238b0fb3e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49ba5ad092384a3f89ce6118f2fff558'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:47.722015 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b2e204db-1301-42e4-b452-4238b0fb3e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49ba5ad092384a3f89ce6118f2fff558'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:47.783285 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9ca89-3067-40f1-a02d-d20e1485b4be admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:47.795516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe631fe-8f0b-4840-93c7-5614a5f8b08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:47.797219 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe631fe-8f0b-4840-93c7-5614a5f8b08b admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:47.798216 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe631fe-8f0b-4840-93c7-5614a5f8b08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:47.798683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe631fe-8f0b-4840-93c7-5614a5f8b08b admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:47.799751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe631fe-8f0b-4840-93c7-5614a5f8b08b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:47.802963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe631fe-8f0b-4840-93c7-5614a5f8b08b admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:47.843484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 858/1750] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:46 2022] DELETE /identity/v3/users/49ba5ad092384a3f89ce6118f2fff558 => generated 0 bytes in 1012 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:47.851767 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315b714-4717-4a9b-bc91-50a2ad01c164 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:47.852845 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315b714-4717-4a9b-bc91-50a2ad01c164 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:47.866753 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315b714-4717-4a9b-bc91-50a2ad01c164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:47.944110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-3315b714-4717-4a9b-bc91-50a2ad01c164 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:47.949736 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3315b714-4717-4a9b-bc91-50a2ad01c164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:48.039816 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 893/1751] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:47 2022] POST /identity/v3/users => generated 284 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:48.046698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe631fe-8f0b-4840-93c7-5614a5f8b08b admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:48.051787 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-3fe631fe-8f0b-4840-93c7-5614a5f8b08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:48.115056 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe631fe-8f0b-4840-93c7-5614a5f8b08b admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:48.146766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 859/1752] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:48.155095 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315b714-4717-4a9b-bc91-50a2ad01c164 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:48.157028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3315b714-4717-4a9b-bc91-50a2ad01c164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:48.361857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c83fd8-938b-4650-8b96-bee14d9019b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:48.362943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c83fd8-938b-4650-8b96-bee14d9019b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:48.363628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c83fd8-938b-4650-8b96-bee14d9019b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:48.364135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c83fd8-938b-4650-8b96-bee14d9019b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:48.365357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c83fd8-938b-4650-8b96-bee14d9019b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:48.369243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c83fd8-938b-4650-8b96-bee14d9019b2 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:48.400025 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 894/1753] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:48.401126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c83fd8-938b-4650-8b96-bee14d9019b2 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:48.432037 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c83fd8-938b-4650-8b96-bee14d9019b2 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:48.456613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315b714-4717-4a9b-bc91-50a2ad01c164 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:48.458196 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446f375-ec73-42d8-8fa9-4b82cae42397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:48.467051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446f375-ec73-42d8-8fa9-4b82cae42397 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:48.469247 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:48.470759 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b3c11-3186-40ab-9f17-165b16f72702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:48.471876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446f375-ec73-42d8-8fa9-4b82cae42397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:48.472240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446f375-ec73-42d8-8fa9-4b82cae42397 admin admin] PATH_INFO: `/v3/projects/a6472e44e932409791cdeef0abb3a7b0/users/0fe21a842e2f447aad434dfca3f078e7/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:48.473108 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b3c11-3186-40ab-9f17-165b16f72702 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:48.474289 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b3c11-3186-40ab-9f17-165b16f72702 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:48.474805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b3c11-3186-40ab-9f17-165b16f72702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:48.501801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b3c11-3186-40ab-9f17-165b16f72702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:48.503736 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b3c11-3186-40ab-9f17-165b16f72702 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:48.531582 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 860/1754] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:03:48.534289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446f375-ec73-42d8-8fa9-4b82cae42397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6472e44e932409791cdeef0abb3a7b0, user_id=0fe21a842e2f447aad434dfca3f078e7, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:48.543797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446f375-ec73-42d8-8fa9-4b82cae42397 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:48.830552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b3c11-3186-40ab-9f17-165b16f72702 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:48.837170 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 895/1755] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:48 2022] PUT /identity/v3/projects/a6472e44e932409791cdeef0abb3a7b0/users/0fe21a842e2f447aad434dfca3f078e7/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:48.852984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b3c11-3186-40ab-9f17-165b16f72702 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:49.018461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b56a30-b3a6-45be-b312-462a6219dcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:49.019179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b56a30-b3a6-45be-b312-462a6219dcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:49.019474 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b56a30-b3a6-45be-b312-462a6219dcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:49.019758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b56a30-b3a6-45be-b312-462a6219dcc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:49.020508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b56a30-b3a6-45be-b312-462a6219dcc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:49.022200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b56a30-b3a6-45be-b312-462a6219dcc0 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:49.048737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 861/1756] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:49.055502 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446f375-ec73-42d8-8fa9-4b82cae42397 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:49.068187 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446f375-ec73-42d8-8fa9-4b82cae42397 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:49.086844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfb251-15a0-47b2-aeeb-afd69b9ebbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:49.092727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfb251-15a0-47b2-aeeb-afd69b9ebbd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:49.093286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfb251-15a0-47b2-aeeb-afd69b9ebbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:49.093595 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfb251-15a0-47b2-aeeb-afd69b9ebbd6 admin admin] PATH_INFO: `/v3/projects/a6472e44e932409791cdeef0abb3a7b0/users/0fe21a842e2f447aad434dfca3f078e7/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:49.096410 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfb251-15a0-47b2-aeeb-afd69b9ebbd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6472e44e932409791cdeef0abb3a7b0, user_id=0fe21a842e2f447aad434dfca3f078e7, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:49.101269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfb251-15a0-47b2-aeeb-afd69b9ebbd6 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:49.136053 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 896/1757] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:49 2022] PUT /identity/v3/projects/a6472e44e932409791cdeef0abb3a7b0/users/0fe21a842e2f447aad434dfca3f078e7/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:49.147498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1a26a-654c-47f3-86ac-c9b7e204adf2 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:49.148024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1a26a-654c-47f3-86ac-c9b7e204adf2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:49.148459 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1a26a-654c-47f3-86ac-c9b7e204adf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:49.196122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-4ff1a26a-654c-47f3-86ac-c9b7e204adf2 None None] MFA Rules not processed for user `0fe21a842e2f447aad434dfca3f078e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:49.197656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4ff1a26a-654c-47f3-86ac-c9b7e204adf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:49.310538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 862/1758] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:49 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:49.334330 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfb251-15a0-47b2-aeeb-afd69b9ebbd6 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:49.337176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-3cdfb251-15a0-47b2-aeeb-afd69b9ebbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:49.353935 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1a26a-654c-47f3-86ac-c9b7e204adf2 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:49.355618 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4ff1a26a-654c-47f3-86ac-c9b7e204adf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:49.492555 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfb251-15a0-47b2-aeeb-afd69b9ebbd6 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:49.499165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4f9e5-3c2d-4710-bf1e-1ef844547e94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:49.500132 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4f9e5-3c2d-4710-bf1e-1ef844547e94 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:49.500278 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4f9e5-3c2d-4710-bf1e-1ef844547e94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:49.500470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4f9e5-3c2d-4710-bf1e-1ef844547e94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:49.523406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4f9e5-3c2d-4710-bf1e-1ef844547e94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:49.526586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4f9e5-3c2d-4710-bf1e-1ef844547e94 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:49.537075 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1a26a-654c-47f3-86ac-c9b7e204adf2 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:49.543526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 897/1759] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:49 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:49.560439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d164d3-7909-480d-ae1f-3841e3896b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:49.561678 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d164d3-7909-480d-ae1f-3841e3896b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:49.562088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d164d3-7909-480d-ae1f-3841e3896b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:49.562464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d164d3-7909-480d-ae1f-3841e3896b68 admin admin] PATH_INFO: `/v3/projects/9f4bc583211d434284e7b4200dbb8360` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:49.566858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d164d3-7909-480d-ae1f-3841e3896b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f4bc583211d434284e7b4200dbb8360)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:49.568781 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d164d3-7909-480d-ae1f-3841e3896b68 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:49.823828 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-26d164d3-7909-480d-ae1f-3841e3896b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f4bc583211d434284e7b4200dbb8360', 'request_id': 'req-26d164d3-7909-480d-ae1f-3841e3896b68'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:49.840226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-26d164d3-7909-480d-ae1f-3841e3896b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f4bc583211d434284e7b4200dbb8360', 'request_id': 'req-26d164d3-7909-480d-ae1f-3841e3896b68'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:49.850732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-26d164d3-7909-480d-ae1f-3841e3896b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f4bc583211d434284e7b4200dbb8360', 'request_id': 'req-26d164d3-7909-480d-ae1f-3841e3896b68'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:50.049995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-26d164d3-7909-480d-ae1f-3841e3896b68 admin admin] The token cache is being invalidate because project 9f4bc583211d434284e7b4200dbb8360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:03:50.050659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-26d164d3-7909-480d-ae1f-3841e3896b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:50.053933 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-26d164d3-7909-480d-ae1f-3841e3896b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:50.058090 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 863/1760] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:03:49 2022] DELETE /identity/v3/projects/9f4bc583211d434284e7b4200dbb8360 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:03:50.065629 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ef22a-4132-433c-ab41-921f61ab7f0b None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.066201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ef22a-4132-433c-ab41-921f61ab7f0b None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.067670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ef22a-4132-433c-ab41-921f61ab7f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.099095 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d164d3-7909-480d-ae1f-3841e3896b68 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:50.101005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-26d164d3-7909-480d-ae1f-3841e3896b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:50.116374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-515ef22a-4132-433c-ab41-921f61ab7f0b None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:50.121435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-515ef22a-4132-433c-ab41-921f61ab7f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:50.180620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d164d3-7909-480d-ae1f-3841e3896b68 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:50.189600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d6063-485a-404c-ad0f-bf09f6f36647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:50.190525 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d6063-485a-404c-ad0f-bf09f6f36647 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.190808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d6063-485a-404c-ad0f-bf09f6f36647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.191431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d6063-485a-404c-ad0f-bf09f6f36647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.193773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-cb8d6063-485a-404c-ad0f-bf09f6f36647 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:50.210589 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 898/1761] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:50.220288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefd8ae-6d59-41f1-8c35-e8ffa6e5cbf0 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.220825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefd8ae-6d59-41f1-8c35-e8ffa6e5cbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.221111 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefd8ae-6d59-41f1-8c35-e8ffa6e5cbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.249625 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-0aefd8ae-6d59-41f1-8c35-e8ffa6e5cbf0 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:50.251841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0aefd8ae-6d59-41f1-8c35-e8ffa6e5cbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:50.263034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 899/1762] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:50.268181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefd8ae-6d59-41f1-8c35-e8ffa6e5cbf0 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:50.291166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefd8ae-6d59-41f1-8c35-e8ffa6e5cbf0 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:50.300320 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea97220-a0c9-4712-b542-dda41a584c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:50.301159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea97220-a0c9-4712-b542-dda41a584c6b admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.301478 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea97220-a0c9-4712-b542-dda41a584c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.301802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea97220-a0c9-4712-b542-dda41a584c6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.302426 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d6063-485a-404c-ad0f-bf09f6f36647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:50.307572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea97220-a0c9-4712-b542-dda41a584c6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:03:50.307572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea97220-a0c9-4712-b542-dda41a584c6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:50.307773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d6063-485a-404c-ad0f-bf09f6f36647 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:50.307857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea97220-a0c9-4712-b542-dda41a584c6b admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:50.318141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 864/1763] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:50 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:03:50.319806 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 900/1764] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:03:50.324195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d6063-485a-404c-ad0f-bf09f6f36647 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:50.341827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d6063-485a-404c-ad0f-bf09f6f36647 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:50.347844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29b89b-9765-4f0f-be04-02a79eefebbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:50.348716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29b89b-9765-4f0f-be04-02a79eefebbb admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.349006 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29b89b-9765-4f0f-be04-02a79eefebbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.349514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29b89b-9765-4f0f-be04-02a79eefebbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.353422 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29b89b-9765-4f0f-be04-02a79eefebbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:50.353422 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29b89b-9765-4f0f-be04-02a79eefebbb admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:50.486327 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 865/1765] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:50 2022] POST /identity/v3/projects => generated 405 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:50.489061 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea97220-a0c9-4712-b542-dda41a584c6b admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:50.508305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea97220-a0c9-4712-b542-dda41a584c6b admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:50.586707 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1bd62-18c7-4a08-bbbc-6f945e4188cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:50.587392 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1bd62-18c7-4a08-bbbc-6f945e4188cb admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.587827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1bd62-18c7-4a08-bbbc-6f945e4188cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.588112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1bd62-18c7-4a08-bbbc-6f945e4188cb admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.588833 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1bd62-18c7-4a08-bbbc-6f945e4188cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:50.590917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1bd62-18c7-4a08-bbbc-6f945e4188cb admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:50.769895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 901/1766] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:50 2022] POST /identity/v3/users => generated 303 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:50.776227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29b89b-9765-4f0f-be04-02a79eefebbb admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:50.797102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29b89b-9765-4f0f-be04-02a79eefebbb admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:50.810615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cff526-7c6a-4df1-9497-7deeef6b9551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:50.811888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cff526-7c6a-4df1-9497-7deeef6b9551 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.812179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cff526-7c6a-4df1-9497-7deeef6b9551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.812446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cff526-7c6a-4df1-9497-7deeef6b9551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.813408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cff526-7c6a-4df1-9497-7deeef6b9551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:50.815185 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cff526-7c6a-4df1-9497-7deeef6b9551 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:50.827248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 866/1767] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:50.835536 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1bd62-18c7-4a08-bbbc-6f945e4188cb admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:50.854394 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1bd62-18c7-4a08-bbbc-6f945e4188cb admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:50.865843 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348391b-3fdf-4ad7-9701-aa0f11bae936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:50.867001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348391b-3fdf-4ad7-9701-aa0f11bae936 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.867534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348391b-3fdf-4ad7-9701-aa0f11bae936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.868028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348391b-3fdf-4ad7-9701-aa0f11bae936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.869459 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348391b-3fdf-4ad7-9701-aa0f11bae936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:50.872647 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348391b-3fdf-4ad7-9701-aa0f11bae936 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:50.893796 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 902/1768] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:50.897686 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cff526-7c6a-4df1-9497-7deeef6b9551 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:50.911567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cff526-7c6a-4df1-9497-7deeef6b9551 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:50.918276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ff9e9-6970-4c3b-89f8-65e0ce7eab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:50.919524 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ff9e9-6970-4c3b-89f8-65e0ce7eab81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:50.919993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ff9e9-6970-4c3b-89f8-65e0ce7eab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:50.921187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ff9e9-6970-4c3b-89f8-65e0ce7eab81 admin admin] PATH_INFO: `/v3/projects/43e228576c1845d9ad764b607de88cc0/users/a70ac5ac6a414fd58a907e5fcd55afc6/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:50.941307 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ff9e9-6970-4c3b-89f8-65e0ce7eab81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e228576c1845d9ad764b607de88cc0, user_id=a70ac5ac6a414fd58a907e5fcd55afc6, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:50.945010 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ff9e9-6970-4c3b-89f8-65e0ce7eab81 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:51.101555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 867/1769] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:50 2022] PUT /identity/v3/projects/43e228576c1845d9ad764b607de88cc0/users/a70ac5ac6a414fd58a907e5fcd55afc6/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:03:51.108358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6be4d-1223-4cf7-9e65-55fd731e6449 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:51.109241 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6be4d-1223-4cf7-9e65-55fd731e6449 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:51.109241 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6be4d-1223-4cf7-9e65-55fd731e6449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:51.129900 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-fda6be4d-1223-4cf7-9e65-55fd731e6449 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:51.131217 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fda6be4d-1223-4cf7-9e65-55fd731e6449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:51.220613 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 903/1770] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:51.234250 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ff9e9-6970-4c3b-89f8-65e0ce7eab81 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:51.236902 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-8e4ff9e9-6970-4c3b-89f8-65e0ce7eab81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:51.349157 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ff9e9-6970-4c3b-89f8-65e0ce7eab81 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:51.353874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef15227-a954-44f1-a697-a57f4d85d0e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:51.354554 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef15227-a954-44f1-a697-a57f4d85d0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:51.354838 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef15227-a954-44f1-a697-a57f4d85d0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:51.355291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef15227-a954-44f1-a697-a57f4d85d0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:51.367803 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef15227-a954-44f1-a697-a57f4d85d0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:51.370246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef15227-a954-44f1-a697-a57f4d85d0e1 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:51.383596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 868/1771] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:51.648140 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:52.395451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0c2e0-899f-4cf6-b65f-b3eb303cdef6 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:52.395946 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0c2e0-899f-4cf6-b65f-b3eb303cdef6 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:52.396032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0c2e0-899f-4cf6-b65f-b3eb303cdef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:52.441917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-5ef0c2e0-899f-4cf6-b65f-b3eb303cdef6 None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:52.443162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5ef0c2e0-899f-4cf6-b65f-b3eb303cdef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:52.554719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 904/1772] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 16 15:03:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:52.952926 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ae77b-29b0-4b4a-8f1a-ffa2628e08ad None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:52.953822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ae77b-29b0-4b4a-8f1a-ffa2628e08ad None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:52.954262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ae77b-29b0-4b4a-8f1a-ffa2628e08ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:52.994691 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-432ae77b-29b0-4b4a-8f1a-ffa2628e08ad None None] MFA Rules not processed for user `db3b603ceffb43bc99684e0d2319e3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:52.999285 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-432ae77b-29b0-4b4a-8f1a-ffa2628e08ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:53.017654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 869/1773] 10.222.0.79 () {58 vars in 1015 bytes} [Thu Jun 16 15:03:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:53.052337 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0c2e0-899f-4cf6-b65f-b3eb303cdef6 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:53.064794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0c2e0-899f-4cf6-b65f-b3eb303cdef6 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:53.070041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65c055-9e6a-4fa2-8748-ce2d33998abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:53.071006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65c055-9e6a-4fa2-8748-ce2d33998abb service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:53.079685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65c055-9e6a-4fa2-8748-ce2d33998abb service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:53.079685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65c055-9e6a-4fa2-8748-ce2d33998abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:53.086578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65c055-9e6a-4fa2-8748-ce2d33998abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:53.091370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65c055-9e6a-4fa2-8748-ce2d33998abb service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:53.113311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 905/1774] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:53.204995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ae77b-29b0-4b4a-8f1a-ffa2628e08ad None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:53.206783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-432ae77b-29b0-4b4a-8f1a-ffa2628e08ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:53.319074 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ae77b-29b0-4b4a-8f1a-ffa2628e08ad None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:53.329232 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6040a0-7473-4a19-85c0-790bf5f97961 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:53.329232 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6040a0-7473-4a19-85c0-790bf5f97961 service swift] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:53.335965 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6040a0-7473-4a19-85c0-790bf5f97961 service swift] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:53.336468 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6040a0-7473-4a19-85c0-790bf5f97961 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:53.377390 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6040a0-7473-4a19-85c0-790bf5f97961 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:53.380183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6040a0-7473-4a19-85c0-790bf5f97961 service swift] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:53.426486 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 870/1775] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 15:03:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:03:53.946870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:55.076002 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65c055-9e6a-4fa2-8748-ce2d33998abb service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:55.078382 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-1e65c055-9e6a-4fa2-8748-ce2d33998abb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:55.106986 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65c055-9e6a-4fa2-8748-ce2d33998abb service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:55.113869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a44c0-00d0-4a76-9045-2436fd2a41e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:55.114949 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a44c0-00d0-4a76-9045-2436fd2a41e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:55.115240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a44c0-00d0-4a76-9045-2436fd2a41e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:55.132152 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a44c0-00d0-4a76-9045-2436fd2a41e7 admin admin] PATH_INFO: `/v3/users/7301235bbc9942bca12702a423f73106` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:55.133639 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a44c0-00d0-4a76-9045-2436fd2a41e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7301235bbc9942bca12702a423f73106)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:55.140284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a44c0-00d0-4a76-9045-2436fd2a41e7 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:57.397756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92951d94-0efc-45f6-8500-307c1007e684 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:57.398809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92951d94-0efc-45f6-8500-307c1007e684 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:57.399276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92951d94-0efc-45f6-8500-307c1007e684 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:57.401943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 871/1776] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 16 15:03:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 15:03:57.428885 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0101e-0051-484b-b7b5-7ebdc1aaaee1 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:57.429541 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0101e-0051-484b-b7b5-7ebdc1aaaee1 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:57.446184 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0101e-0051-484b-b7b5-7ebdc1aaaee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:57.481656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-63b0101e-0051-484b-b7b5-7ebdc1aaaee1 None None] MFA Rules not processed for user `60c2f1c63a674e3195c490ab5ad1318f`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:57.488609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-63b0101e-0051-484b-b7b5-7ebdc1aaaee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:57.510042 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2a0a44c0-00d0-4a76-9045-2436fd2a41e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7301235bbc9942bca12702a423f73106'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:57.543942 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2a0a44c0-00d0-4a76-9045-2436fd2a41e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7301235bbc9942bca12702a423f73106'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:57.545425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2a0a44c0-00d0-4a76-9045-2436fd2a41e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7301235bbc9942bca12702a423f73106'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:57.600649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2a0a44c0-00d0-4a76-9045-2436fd2a41e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7301235bbc9942bca12702a423f73106'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:57.603178 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2a0a44c0-00d0-4a76-9045-2436fd2a41e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7301235bbc9942bca12702a423f73106'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:03:57.672924 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 872/1777] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 16 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:57.677710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1db405-fb8f-4273-8aa4-11dfbdc2356d None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:57.681038 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1db405-fb8f-4273-8aa4-11dfbdc2356d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:57.681344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1db405-fb8f-4273-8aa4-11dfbdc2356d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:57.792728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-4d1db405-fb8f-4273-8aa4-11dfbdc2356d None None] MFA Rules not processed for user `a70ac5ac6a414fd58a907e5fcd55afc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:57.795063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4d1db405-fb8f-4273-8aa4-11dfbdc2356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:57.876804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 906/1778] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:03:55 2022] DELETE /identity/v3/users/7301235bbc9942bca12702a423f73106 => generated 0 bytes in 2801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:57.881515 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ac7c1-f31a-43b8-9395-5d674212eab4 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:57.881810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ac7c1-f31a-43b8-9395-5d674212eab4 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:57.882272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ac7c1-f31a-43b8-9395-5d674212eab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:57.917241 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-211ac7c1-f31a-43b8-9395-5d674212eab4 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:03:57.919514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-211ac7c1-f31a-43b8-9395-5d674212eab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:57.959622 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 873/1779] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:57.965107 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1db405-fb8f-4273-8aa4-11dfbdc2356d None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:57.974899 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4d1db405-fb8f-4273-8aa4-11dfbdc2356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:58.099012 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1db405-fb8f-4273-8aa4-11dfbdc2356d None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:58.237173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 907/1780] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:03:58.244319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ac7c1-f31a-43b8-9395-5d674212eab4 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:58.251895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-211ac7c1-f31a-43b8-9395-5d674212eab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:58.313668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3a84b-895a-46f4-b8d1-9bc8dc0c87b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:58.314537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3a84b-895a-46f4-b8d1-9bc8dc0c87b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:58.314810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3a84b-895a-46f4-b8d1-9bc8dc0c87b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:58.315087 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3a84b-895a-46f4-b8d1-9bc8dc0c87b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:58.315815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3a84b-895a-46f4-b8d1-9bc8dc0c87b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:58.341915 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3a84b-895a-46f4-b8d1-9bc8dc0c87b7 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:58.443373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ac7c1-f31a-43b8-9395-5d674212eab4 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:58.466028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a7ee8-8ec8-4107-bf20-918b75b25a26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:58.469682 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a7ee8-8ec8-4107-bf20-918b75b25a26 service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:58.470217 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a7ee8-8ec8-4107-bf20-918b75b25a26 service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:58.473577 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a7ee8-8ec8-4107-bf20-918b75b25a26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:58.507485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a7ee8-8ec8-4107-bf20-918b75b25a26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:58.512271 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a7ee8-8ec8-4107-bf20-918b75b25a26 service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:58.535421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 874/1781] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:03:57 2022] POST /identity/v3/projects => generated 405 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:58.536955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3a84b-895a-46f4-b8d1-9bc8dc0c87b7 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:58.541381 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-cac3a84b-895a-46f4-b8d1-9bc8dc0c87b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:03:58.553741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 908/1782] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:58.554990 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a7ee8-8ec8-4107-bf20-918b75b25a26 service nova] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:58.594994 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a7ee8-8ec8-4107-bf20-918b75b25a26 service nova] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:58.678443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3a84b-895a-46f4-b8d1-9bc8dc0c87b7 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:58.686453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2bb4b-0d4c-4095-a41b-72918516814b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:58.687161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2bb4b-0d4c-4095-a41b-72918516814b service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:58.687448 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2bb4b-0d4c-4095-a41b-72918516814b service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:58.687782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2bb4b-0d4c-4095-a41b-72918516814b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:58.854350 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9e738-d09e-4eaf-a1ff-f4f9f4b59049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:58.859804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9e738-d09e-4eaf-a1ff-f4f9f4b59049 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:58.859804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9e738-d09e-4eaf-a1ff-f4f9f4b59049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:58.859804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9e738-d09e-4eaf-a1ff-f4f9f4b59049 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:58.861910 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9e738-d09e-4eaf-a1ff-f4f9f4b59049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:58.869479 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9e738-d09e-4eaf-a1ff-f4f9f4b59049 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:58.902496 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2bb4b-0d4c-4095-a41b-72918516814b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:58.904015 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2bb4b-0d4c-4095-a41b-72918516814b service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:58.928561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 875/1783] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:03:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:03:59.012474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 909/1784] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:03:58 2022] POST /identity/v3/users => generated 309 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:03:59.016853 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2bb4b-0d4c-4095-a41b-72918516814b service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:59.028735 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2bb4b-0d4c-4095-a41b-72918516814b service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:59.045524 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173de41-74f4-424e-9f61-6783aeb8a39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:59.046226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173de41-74f4-424e-9f61-6783aeb8a39a admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:59.046512 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173de41-74f4-424e-9f61-6783aeb8a39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:59.046795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173de41-74f4-424e-9f61-6783aeb8a39a admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:59.047783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173de41-74f4-424e-9f61-6783aeb8a39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:59.049319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173de41-74f4-424e-9f61-6783aeb8a39a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:59.071309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 876/1785] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:59.075980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9e738-d09e-4eaf-a1ff-f4f9f4b59049 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:59.094976 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9e738-d09e-4eaf-a1ff-f4f9f4b59049 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:59.101728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1606a07-680f-4e82-8318-b685d742bb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:59.103446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1606a07-680f-4e82-8318-b685d742bb03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:59.104654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1606a07-680f-4e82-8318-b685d742bb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:59.105240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1606a07-680f-4e82-8318-b685d742bb03 admin admin] PATH_INFO: `/v3/projects/c0e61d57117f43a8be2bceb1d61b4401/users/23218b3f377948bcb32e8afa965a542c/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:59.166616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1606a07-680f-4e82-8318-b685d742bb03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e61d57117f43a8be2bceb1d61b4401, user_id=23218b3f377948bcb32e8afa965a542c, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:59.173995 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1606a07-680f-4e82-8318-b685d742bb03 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:59.308627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 910/1786] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:59 2022] PUT /identity/v3/projects/c0e61d57117f43a8be2bceb1d61b4401/users/23218b3f377948bcb32e8afa965a542c/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:03:59.312579 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173de41-74f4-424e-9f61-6783aeb8a39a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:59.325572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173de41-74f4-424e-9f61-6783aeb8a39a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:59.405410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94296df9-4ab7-4489-8d7b-1db2c453253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:59.405985 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94296df9-4ab7-4489-8d7b-1db2c453253e admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:59.406271 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94296df9-4ab7-4489-8d7b-1db2c453253e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:59.406731 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94296df9-4ab7-4489-8d7b-1db2c453253e admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:59.407624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94296df9-4ab7-4489-8d7b-1db2c453253e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:59.410555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94296df9-4ab7-4489-8d7b-1db2c453253e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:59.427206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1606a07-680f-4e82-8318-b685d742bb03 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:03:59.428595 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 877/1787] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:03:59.441472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1606a07-680f-4e82-8318-b685d742bb03 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:03:59.448464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:59.451047 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f82e58-6f64-4040-8da2-a4bc19d91659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:03:59.453544 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f82e58-6f64-4040-8da2-a4bc19d91659 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:03:59.454171 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f82e58-6f64-4040-8da2-a4bc19d91659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:03:59.454612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f82e58-6f64-4040-8da2-a4bc19d91659 admin admin] PATH_INFO: `/v3/projects/c0e61d57117f43a8be2bceb1d61b4401/users/23218b3f377948bcb32e8afa965a542c/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:03:59.457466 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f82e58-6f64-4040-8da2-a4bc19d91659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e61d57117f43a8be2bceb1d61b4401, user_id=23218b3f377948bcb32e8afa965a542c, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:03:59.460761 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f82e58-6f64-4040-8da2-a4bc19d91659 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:03:59.475978 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 911/1788] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:03:59 2022] PUT /identity/v3/projects/c0e61d57117f43a8be2bceb1d61b4401/users/23218b3f377948bcb32e8afa965a542c/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:01.866740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:02.338693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94296df9-4ab7-4489-8d7b-1db2c453253e admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:02.340910 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-94296df9-4ab7-4489-8d7b-1db2c453253e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:02.375892 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94296df9-4ab7-4489-8d7b-1db2c453253e admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:02.495529 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2910954-8e84-4009-99d2-182290d351f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:02.499688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2910954-8e84-4009-99d2-182290d351f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:02.500686 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2910954-8e84-4009-99d2-182290d351f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:02.501541 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2910954-8e84-4009-99d2-182290d351f9 admin admin] PATH_INFO: `/v3/projects/75fa7072a06f426c8e26df97c22ef6ec` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:02.505365 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2910954-8e84-4009-99d2-182290d351f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75fa7072a06f426c8e26df97c22ef6ec)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:02.509005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2910954-8e84-4009-99d2-182290d351f9 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:02.818391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c2910954-8e84-4009-99d2-182290d351f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75fa7072a06f426c8e26df97c22ef6ec', 'request_id': 'req-c2910954-8e84-4009-99d2-182290d351f9'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:02.847344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c2910954-8e84-4009-99d2-182290d351f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75fa7072a06f426c8e26df97c22ef6ec', 'request_id': 'req-c2910954-8e84-4009-99d2-182290d351f9'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:02.871371 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c2910954-8e84-4009-99d2-182290d351f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75fa7072a06f426c8e26df97c22ef6ec', 'request_id': 'req-c2910954-8e84-4009-99d2-182290d351f9'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:03.044628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c2910954-8e84-4009-99d2-182290d351f9 admin admin] The token cache is being invalidate because project 75fa7072a06f426c8e26df97c22ef6ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:03.045245 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c2910954-8e84-4009-99d2-182290d351f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:03.047065 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c2910954-8e84-4009-99d2-182290d351f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:03.052172 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 878/1789] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:02 2022] DELETE /identity/v3/projects/75fa7072a06f426c8e26df97c22ef6ec => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:03.059159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c2645-1030-4245-8d6d-c7310f9e8df7 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:03.061055 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c2645-1030-4245-8d6d-c7310f9e8df7 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:03.062226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c2645-1030-4245-8d6d-c7310f9e8df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:03.126270 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-4f4c2645-1030-4245-8d6d-c7310f9e8df7 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:03.126935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4f4c2645-1030-4245-8d6d-c7310f9e8df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:03.302876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 912/1790] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:03.315945 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8a323-b3ab-46ef-9db1-11b206519dce None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:03.315945 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8a323-b3ab-46ef-9db1-11b206519dce None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:03.315945 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8a323-b3ab-46ef-9db1-11b206519dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:03.360036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edc1f0-3df2-4572-884c-b7c84e17f6e1 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:03.361334 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edc1f0-3df2-4572-884c-b7c84e17f6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:03.361334 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edc1f0-3df2-4572-884c-b7c84e17f6e1 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:03.362232 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-26f8a323-b3ab-46ef-9db1-11b206519dce None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:03.366392 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-26f8a323-b3ab-46ef-9db1-11b206519dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:03.370531 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 913/1791] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 16 15:04:03 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 15:04:03.384900 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 879/1792] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:03.391010 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edc1f0-3df2-4572-884c-b7c84e17f6e1 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:03.418059 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edc1f0-3df2-4572-884c-b7c84e17f6e1 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:03.448517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2281cf1-5cd7-4722-84ad-fe457ddec1f9 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:03.449046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2281cf1-5cd7-4722-84ad-fe457ddec1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:03.449469 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2281cf1-5cd7-4722-84ad-fe457ddec1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:03.462848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1afba7-d879-4d18-a4de-3564fb25b753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:03.465268 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1afba7-d879-4d18-a4de-3564fb25b753 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:03.465575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1afba7-d879-4d18-a4de-3564fb25b753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:03.465858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1afba7-d879-4d18-a4de-3564fb25b753 admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:03.469836 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1afba7-d879-4d18-a4de-3564fb25b753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:04:03.470340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1afba7-d879-4d18-a4de-3564fb25b753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:03.474998 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1afba7-d879-4d18-a4de-3564fb25b753 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:03.515043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-c2281cf1-5cd7-4722-84ad-fe457ddec1f9 None None] MFA Rules not processed for user `60c2f1c63a674e3195c490ab5ad1318f`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:03.516534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 914/1793] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:04:03.517731 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c2281cf1-5cd7-4722-84ad-fe457ddec1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:03.522789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1afba7-d879-4d18-a4de-3564fb25b753 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:03.556571 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1afba7-d879-4d18-a4de-3564fb25b753 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:03.566149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf1503-d252-400e-8db7-ff6d7cdd07d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:03.574702 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1503-d252-400e-8db7-ff6d7cdd07d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:03.574702 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1503-d252-400e-8db7-ff6d7cdd07d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:03.578525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1503-d252-400e-8db7-ff6d7cdd07d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:03.579417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf1503-d252-400e-8db7-ff6d7cdd07d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:03.581673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf1503-d252-400e-8db7-ff6d7cdd07d1 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:03.686255 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 880/1794] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 16 15:04:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:03.880269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 915/1795] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:03 2022] POST /identity/v3/projects => generated 373 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:03.881866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf1503-d252-400e-8db7-ff6d7cdd07d1 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:03.885619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56b9cd-a5e4-4572-9eb7-2c42d5b918a0 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:03.886563 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56b9cd-a5e4-4572-9eb7-2c42d5b918a0 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:03.887237 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56b9cd-a5e4-4572-9eb7-2c42d5b918a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:03.970875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-bf56b9cd-a5e4-4572-9eb7-2c42d5b918a0 None None] MFA Rules not processed for user `23218b3f377948bcb32e8afa965a542c`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:03.974490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-bf56b9cd-a5e4-4572-9eb7-2c42d5b918a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:04.049239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf1503-d252-400e-8db7-ff6d7cdd07d1 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:04.056601 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86617715-c978-4c38-af91-73d2306c7009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:04.057498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86617715-c978-4c38-af91-73d2306c7009 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:04.058011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86617715-c978-4c38-af91-73d2306c7009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:04.059142 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86617715-c978-4c38-af91-73d2306c7009 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:04.060407 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86617715-c978-4c38-af91-73d2306c7009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:04.063960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86617715-c978-4c38-af91-73d2306c7009 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:04.162230 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 881/1796] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:03 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:04.163503 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56b9cd-a5e4-4572-9eb7-2c42d5b918a0 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:04.165505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-bf56b9cd-a5e4-4572-9eb7-2c42d5b918a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:04.259819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 916/1797] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:03 2022] POST /identity/v3/users => generated 287 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:04.272142 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86617715-c978-4c38-af91-73d2306c7009 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:04.301109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86617715-c978-4c38-af91-73d2306c7009 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:04.308537 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443982bf-1c30-4ad6-85ae-2350d1275385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:04.309816 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443982bf-1c30-4ad6-85ae-2350d1275385 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:04.310336 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443982bf-1c30-4ad6-85ae-2350d1275385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:04.310876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443982bf-1c30-4ad6-85ae-2350d1275385 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:04.312694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443982bf-1c30-4ad6-85ae-2350d1275385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:04.316671 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:04.316852 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443982bf-1c30-4ad6-85ae-2350d1275385 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:04.330303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 917/1798] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:04.334745 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443982bf-1c30-4ad6-85ae-2350d1275385 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:04.363675 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443982bf-1c30-4ad6-85ae-2350d1275385 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:04.372149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c084a-958f-41ac-b972-b658e01ccb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:04.373187 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c084a-958f-41ac-b972-b658e01ccb51 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:04.373778 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c084a-958f-41ac-b972-b658e01ccb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:04.374259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c084a-958f-41ac-b972-b658e01ccb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:04.375339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c084a-958f-41ac-b972-b658e01ccb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:04.381795 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c084a-958f-41ac-b972-b658e01ccb51 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:04.414140 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56b9cd-a5e4-4572-9eb7-2c42d5b918a0 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:04.431909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea58289-1465-426c-abee-29e8bebe6a93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:04.431909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea58289-1465-426c-abee-29e8bebe6a93 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:04.431909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea58289-1465-426c-abee-29e8bebe6a93 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:04.431909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea58289-1465-426c-abee-29e8bebe6a93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:04.437726 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:04.440798 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 918/1799] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:04.444229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c084a-958f-41ac-b972-b658e01ccb51 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:04.450434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea58289-1465-426c-abee-29e8bebe6a93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:04.453182 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea58289-1465-426c-abee-29e8bebe6a93 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:04.470948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c084a-958f-41ac-b972-b658e01ccb51 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:04.494154 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2c4d8-6303-4db1-804c-1d2340cb4a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:04.495238 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2c4d8-6303-4db1-804c-1d2340cb4a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:04.495531 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2c4d8-6303-4db1-804c-1d2340cb4a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:04.495811 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2c4d8-6303-4db1-804c-1d2340cb4a9b admin admin] PATH_INFO: `/v3/projects/bc098017f37d4e60935206b3aa9a91ce/users/cfe5fa7501b340d29ab4402c59b8359c/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:04.498395 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 882/1800] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:04.599851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2c4d8-6303-4db1-804c-1d2340cb4a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc098017f37d4e60935206b3aa9a91ce, user_id=cfe5fa7501b340d29ab4402c59b8359c, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:04.602611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2c4d8-6303-4db1-804c-1d2340cb4a9b admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:04.865549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 919/1801] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:04 2022] PUT /identity/v3/projects/bc098017f37d4e60935206b3aa9a91ce/users/cfe5fa7501b340d29ab4402c59b8359c/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:04.876912 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2d5a5-37f0-4edd-8158-c709270e9586 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:04.877109 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2d5a5-37f0-4edd-8158-c709270e9586 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:04.877417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2d5a5-37f0-4edd-8158-c709270e9586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:04.972881 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-f7e2d5a5-37f0-4edd-8158-c709270e9586 None None] MFA Rules not processed for user `cfe5fa7501b340d29ab4402c59b8359c`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:04.978040 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f7e2d5a5-37f0-4edd-8158-c709270e9586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:05.180498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2c4d8-6303-4db1-804c-1d2340cb4a9b admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:05.191444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 883/1802] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:05.367299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2c4d8-6303-4db1-804c-1d2340cb4a9b admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:05.376523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179a7e9-07fb-4862-a8bb-ea21e890abf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:05.377581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179a7e9-07fb-4862-a8bb-ea21e890abf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:05.378049 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179a7e9-07fb-4862-a8bb-ea21e890abf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:05.378534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179a7e9-07fb-4862-a8bb-ea21e890abf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:05.379410 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179a7e9-07fb-4862-a8bb-ea21e890abf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:05.381667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179a7e9-07fb-4862-a8bb-ea21e890abf7 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:05.667377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 920/1803] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:05 2022] POST /identity/v3/projects => generated 373 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:05.671652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2d5a5-37f0-4edd-8158-c709270e9586 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:05.689665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2d5a5-37f0-4edd-8158-c709270e9586 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:05.837531 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c296b8-c4b2-41c9-ba06-c7425fcc00b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:05.838445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c296b8-c4b2-41c9-ba06-c7425fcc00b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:05.839081 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c296b8-c4b2-41c9-ba06-c7425fcc00b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:05.839509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c296b8-c4b2-41c9-ba06-c7425fcc00b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:05.840398 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c296b8-c4b2-41c9-ba06-c7425fcc00b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:05.843373 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c296b8-c4b2-41c9-ba06-c7425fcc00b6 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:06.220741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6608c-3693-4dbe-8c98-d86693150fec None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:06.221662 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6608c-3693-4dbe-8c98-d86693150fec None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:06.221662 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6608c-3693-4dbe-8c98-d86693150fec None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:06.223278 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 921/1804] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 16 15:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 15:04:06.235264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc6ea8-a03e-42a0-af5b-60b9c67b3904 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:06.235844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc6ea8-a03e-42a0-af5b-60b9c67b3904 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:06.237567 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc6ea8-a03e-42a0-af5b-60b9c67b3904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:06.279619 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-ecfc6ea8-a03e-42a0-af5b-60b9c67b3904 None None] MFA Rules not processed for user `534035b2e8cf4f769e3dbbaabc0f6ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:06.285838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ecfc6ea8-a03e-42a0-af5b-60b9c67b3904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:06.373433 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 884/1805] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:05 2022] POST /identity/v3/users => generated 293 bytes in 703 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:06.376666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 922/1806] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 16 15:04:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:06.386276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c296b8-c4b2-41c9-ba06-c7425fcc00b6 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:06.390839 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc6ea8-a03e-42a0-af5b-60b9c67b3904 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:06.392299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ecfc6ea8-a03e-42a0-af5b-60b9c67b3904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:06.397589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c296b8-c4b2-41c9-ba06-c7425fcc00b6 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:06.402892 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c329d-3bf8-4416-b342-a0a09835657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:06.403583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c329d-3bf8-4416-b342-a0a09835657f admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:06.403917 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c329d-3bf8-4416-b342-a0a09835657f admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:06.404214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c329d-3bf8-4416-b342-a0a09835657f admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:06.405474 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c329d-3bf8-4416-b342-a0a09835657f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:06.407249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c329d-3bf8-4416-b342-a0a09835657f admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:06.407454 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc6ea8-a03e-42a0-af5b-60b9c67b3904 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:06.417519 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bd952-860d-4883-8a68-e0b3b83453bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534035b2e8cf4f769e3dbbaabc0f6ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:06.418256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bd952-860d-4883-8a68-e0b3b83453bf service placement] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:06.418469 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bd952-860d-4883-8a68-e0b3b83453bf service placement] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:06.418746 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bd952-860d-4883-8a68-e0b3b83453bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:06.422313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 885/1807] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:06.423165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c329d-3bf8-4416-b342-a0a09835657f admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:06.433115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bd952-860d-4883-8a68-e0b3b83453bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:06.433666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c329d-3bf8-4416-b342-a0a09835657f admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:06.435356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bd952-860d-4883-8a68-e0b3b83453bf service placement] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:06.443992 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c85a8-237b-486c-a8e3-eee538200be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:06.445225 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c85a8-237b-486c-a8e3-eee538200be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:06.445514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c85a8-237b-486c-a8e3-eee538200be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:06.445795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c85a8-237b-486c-a8e3-eee538200be1 admin admin] PATH_INFO: `/v3/projects/0d556b4b89384d969b7b392a377bbc88/users/43dd70d346eb48cca6bcec1fc465dc01/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:06.446148 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 923/1808] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:04:06.465046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c85a8-237b-486c-a8e3-eee538200be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d556b4b89384d969b7b392a377bbc88, user_id=43dd70d346eb48cca6bcec1fc465dc01, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:06.475054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c85a8-237b-486c-a8e3-eee538200be1 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:06.644588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 886/1809] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:06 2022] PUT /identity/v3/projects/0d556b4b89384d969b7b392a377bbc88/users/43dd70d346eb48cca6bcec1fc465dc01/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:06.648527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bd952-860d-4883-8a68-e0b3b83453bf service placement] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:06.662678 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bd952-860d-4883-8a68-e0b3b83453bf service placement] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:06.779523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de9251-474c-4413-a122-70205a687ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:06.780786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de9251-474c-4413-a122-70205a687ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:06.781093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de9251-474c-4413-a122-70205a687ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:06.781394 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de9251-474c-4413-a122-70205a687ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:06.782191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de9251-474c-4413-a122-70205a687ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:06.783949 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de9251-474c-4413-a122-70205a687ba5 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:06.797609 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 924/1810] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:06.801615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c85a8-237b-486c-a8e3-eee538200be1 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:06.814229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c85a8-237b-486c-a8e3-eee538200be1 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:06.820130 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a151d-71e0-4159-a424-8e80e9af118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:06.821499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a151d-71e0-4159-a424-8e80e9af118b admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:06.821992 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a151d-71e0-4159-a424-8e80e9af118b admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:06.822469 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a151d-71e0-4159-a424-8e80e9af118b admin admin] PATH_INFO: `/v3/projects/0d556b4b89384d969b7b392a377bbc88/users/43dd70d346eb48cca6bcec1fc465dc01/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:06.824797 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a151d-71e0-4159-a424-8e80e9af118b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d556b4b89384d969b7b392a377bbc88, user_id=43dd70d346eb48cca6bcec1fc465dc01, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:06.828036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a151d-71e0-4159-a424-8e80e9af118b admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:06.852214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 887/1811] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:06 2022] PUT /identity/v3/projects/0d556b4b89384d969b7b392a377bbc88/users/43dd70d346eb48cca6bcec1fc465dc01/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:06.854125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a404a-b033-4b8c-a805-4c2a528dfb9f None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:06.854424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a404a-b033-4b8c-a805-4c2a528dfb9f None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:06.854707 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a404a-b033-4b8c-a805-4c2a528dfb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:06.884687 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-b26a404a-b033-4b8c-a805-4c2a528dfb9f None None] MFA Rules not processed for user `43dd70d346eb48cca6bcec1fc465dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:06.886014 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b26a404a-b033-4b8c-a805-4c2a528dfb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:06.966237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 925/1812] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:06.980616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a151d-71e0-4159-a424-8e80e9af118b admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:06.982792 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4e2a151d-71e0-4159-a424-8e80e9af118b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:07.060403 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a151d-71e0-4159-a424-8e80e9af118b admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:07.065271 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450761ea-848b-40c3-8dc9-fb048eb4307b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:07.066145 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450761ea-848b-40c3-8dc9-fb048eb4307b service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:07.068180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450761ea-848b-40c3-8dc9-fb048eb4307b service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:07.068635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450761ea-848b-40c3-8dc9-fb048eb4307b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:07.150840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450761ea-848b-40c3-8dc9-fb048eb4307b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:07.152307 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450761ea-848b-40c3-8dc9-fb048eb4307b service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:07.163690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 888/1813] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:07.220019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:07.487475 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a404a-b033-4b8c-a805-4c2a528dfb9f None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:07.489694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b26a404a-b033-4b8c-a805-4c2a528dfb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:07.614604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a404a-b033-4b8c-a805-4c2a528dfb9f None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:07.621929 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc815cd-9b85-4f8c-b18f-773472e1e041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:07.622895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc815cd-9b85-4f8c-b18f-773472e1e041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:07.623212 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc815cd-9b85-4f8c-b18f-773472e1e041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:07.624390 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc815cd-9b85-4f8c-b18f-773472e1e041 admin admin] PATH_INFO: `/v3/users/a70ac5ac6a414fd58a907e5fcd55afc6` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:07.625912 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc815cd-9b85-4f8c-b18f-773472e1e041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a70ac5ac6a414fd58a907e5fcd55afc6)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:07.628077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc815cd-9b85-4f8c-b18f-773472e1e041 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:07.924003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-3fc815cd-9b85-4f8c-b18f-773472e1e041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a70ac5ac6a414fd58a907e5fcd55afc6'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:07.931086 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-3fc815cd-9b85-4f8c-b18f-773472e1e041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a70ac5ac6a414fd58a907e5fcd55afc6'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:07.931959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-3fc815cd-9b85-4f8c-b18f-773472e1e041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a70ac5ac6a414fd58a907e5fcd55afc6'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:07.944626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-3fc815cd-9b85-4f8c-b18f-773472e1e041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a70ac5ac6a414fd58a907e5fcd55afc6'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:07.945477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-3fc815cd-9b85-4f8c-b18f-773472e1e041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a70ac5ac6a414fd58a907e5fcd55afc6'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:08.032743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 926/1814] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:07 2022] DELETE /identity/v3/users/a70ac5ac6a414fd58a907e5fcd55afc6 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:08.382337 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450761ea-848b-40c3-8dc9-fb048eb4307b service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:08.401946 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450761ea-848b-40c3-8dc9-fb048eb4307b service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:08.471674 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a105a-226e-4fdf-b32e-2fae207178f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:08.472556 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a105a-226e-4fdf-b32e-2fae207178f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:08.472844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a105a-226e-4fdf-b32e-2fae207178f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:08.473140 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a105a-226e-4fdf-b32e-2fae207178f0 admin admin] PATH_INFO: `/v3/projects/43e228576c1845d9ad764b607de88cc0` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:08.474363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a105a-226e-4fdf-b32e-2fae207178f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e228576c1845d9ad764b607de88cc0)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:08.476808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a105a-226e-4fdf-b32e-2fae207178f0 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:08.685723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-278a105a-226e-4fdf-b32e-2fae207178f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e228576c1845d9ad764b607de88cc0', 'request_id': 'req-278a105a-226e-4fdf-b32e-2fae207178f0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:08.694177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-278a105a-226e-4fdf-b32e-2fae207178f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e228576c1845d9ad764b607de88cc0', 'request_id': 'req-278a105a-226e-4fdf-b32e-2fae207178f0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:08.700978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-278a105a-226e-4fdf-b32e-2fae207178f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e228576c1845d9ad764b607de88cc0', 'request_id': 'req-278a105a-226e-4fdf-b32e-2fae207178f0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:08.818251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-278a105a-226e-4fdf-b32e-2fae207178f0 admin admin] The token cache is being invalidate because project 43e228576c1845d9ad764b607de88cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:08.818885 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-278a105a-226e-4fdf-b32e-2fae207178f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:08.819883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-278a105a-226e-4fdf-b32e-2fae207178f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:08.832316 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc815cd-9b85-4f8c-b18f-773472e1e041 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:08.833369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 889/1815] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:08 2022] DELETE /identity/v3/projects/43e228576c1845d9ad764b607de88cc0 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:08.835113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-3fc815cd-9b85-4f8c-b18f-773472e1e041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:08.855847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc815cd-9b85-4f8c-b18f-773472e1e041 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:08.932674 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4e943-2597-4a0b-8fec-bef07bc5af63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:08.934140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4e943-2597-4a0b-8fec-bef07bc5af63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:08.934433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4e943-2597-4a0b-8fec-bef07bc5af63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:08.934552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:08.934741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4e943-2597-4a0b-8fec-bef07bc5af63 admin admin] PATH_INFO: `/v3/users/23218b3f377948bcb32e8afa965a542c` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:08.936860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4e943-2597-4a0b-8fec-bef07bc5af63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23218b3f377948bcb32e8afa965a542c)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:08.939033 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4e943-2597-4a0b-8fec-bef07bc5af63 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:09.273676 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-bdc4e943-2597-4a0b-8fec-bef07bc5af63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23218b3f377948bcb32e8afa965a542c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:09.284050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-bdc4e943-2597-4a0b-8fec-bef07bc5af63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23218b3f377948bcb32e8afa965a542c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:09.294338 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-bdc4e943-2597-4a0b-8fec-bef07bc5af63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23218b3f377948bcb32e8afa965a542c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:09.304469 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-bdc4e943-2597-4a0b-8fec-bef07bc5af63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23218b3f377948bcb32e8afa965a542c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:09.305289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-bdc4e943-2597-4a0b-8fec-bef07bc5af63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23218b3f377948bcb32e8afa965a542c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:09.451607 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 927/1816] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:08 2022] DELETE /identity/v3/users/23218b3f377948bcb32e8afa965a542c => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:09.787242 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a105a-226e-4fdf-b32e-2fae207178f0 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:09.788800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-278a105a-226e-4fdf-b32e-2fae207178f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:09.824025 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a105a-226e-4fdf-b32e-2fae207178f0 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:09.901307 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49381212-a0f6-4688-9922-d3d26dc58023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:09.902332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49381212-a0f6-4688-9922-d3d26dc58023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:09.902706 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49381212-a0f6-4688-9922-d3d26dc58023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:09.903241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49381212-a0f6-4688-9922-d3d26dc58023 admin admin] PATH_INFO: `/v3/projects/c0e61d57117f43a8be2bceb1d61b4401` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:09.904557 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49381212-a0f6-4688-9922-d3d26dc58023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e61d57117f43a8be2bceb1d61b4401)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:09.907297 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49381212-a0f6-4688-9922-d3d26dc58023 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:10.202234 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-49381212-a0f6-4688-9922-d3d26dc58023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e61d57117f43a8be2bceb1d61b4401', 'request_id': 'req-49381212-a0f6-4688-9922-d3d26dc58023'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:10.209433 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-49381212-a0f6-4688-9922-d3d26dc58023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e61d57117f43a8be2bceb1d61b4401', 'request_id': 'req-49381212-a0f6-4688-9922-d3d26dc58023'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:10.215600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-49381212-a0f6-4688-9922-d3d26dc58023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e61d57117f43a8be2bceb1d61b4401', 'request_id': 'req-49381212-a0f6-4688-9922-d3d26dc58023'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:10.374831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-49381212-a0f6-4688-9922-d3d26dc58023 admin admin] The token cache is being invalidate because project c0e61d57117f43a8be2bceb1d61b4401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:10.375054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-49381212-a0f6-4688-9922-d3d26dc58023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:10.375758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-49381212-a0f6-4688-9922-d3d26dc58023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:10.377706 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 890/1817] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:09 2022] DELETE /identity/v3/projects/c0e61d57117f43a8be2bceb1d61b4401 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:10.382664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873015ec-094a-49b7-99ee-2200dfb0216f None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:10.383155 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873015ec-094a-49b7-99ee-2200dfb0216f None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:10.383491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873015ec-094a-49b7-99ee-2200dfb0216f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:10.403267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-873015ec-094a-49b7-99ee-2200dfb0216f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:10.404488 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-873015ec-094a-49b7-99ee-2200dfb0216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:10.464914 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 928/1818] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:10.472693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c492f-b25b-4e0d-92e5-9b9e094946f1 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:10.472983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c492f-b25b-4e0d-92e5-9b9e094946f1 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:10.473315 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c492f-b25b-4e0d-92e5-9b9e094946f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:10.492752 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-c30c492f-b25b-4e0d-92e5-9b9e094946f1 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:10.494009 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c30c492f-b25b-4e0d-92e5-9b9e094946f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:10.502711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 891/1819] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:10.507046 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873015ec-094a-49b7-99ee-2200dfb0216f None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:10.517235 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873015ec-094a-49b7-99ee-2200dfb0216f None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:10.522209 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a480f1b-6adc-4314-9a0c-a0453376cbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:10.522894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a480f1b-6adc-4314-9a0c-a0453376cbaa admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:10.523186 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a480f1b-6adc-4314-9a0c-a0453376cbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:10.523470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a480f1b-6adc-4314-9a0c-a0453376cbaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:10.524214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a480f1b-6adc-4314-9a0c-a0453376cbaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:04:10.524534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a480f1b-6adc-4314-9a0c-a0453376cbaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:10.526197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a480f1b-6adc-4314-9a0c-a0453376cbaa admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:10.543298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 929/1820] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:04:10.546799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c492f-b25b-4e0d-92e5-9b9e094946f1 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:10.556810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c492f-b25b-4e0d-92e5-9b9e094946f1 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:10.564110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15cb14-d2b0-410b-9330-3c517abab4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:10.565572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15cb14-d2b0-410b-9330-3c517abab4dc admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:10.565572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15cb14-d2b0-410b-9330-3c517abab4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:10.565572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15cb14-d2b0-410b-9330-3c517abab4dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:10.566137 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15cb14-d2b0-410b-9330-3c517abab4dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:10.568142 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15cb14-d2b0-410b-9330-3c517abab4dc admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:10.629743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a480f1b-6adc-4314-9a0c-a0453376cbaa admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:10.631724 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-7a480f1b-6adc-4314-9a0c-a0453376cbaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:10.653633 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a480f1b-6adc-4314-9a0c-a0453376cbaa admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:10.659455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f72a3d-7b0d-45e9-9cb6-e1846f1c559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:10.660486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f72a3d-7b0d-45e9-9cb6-e1846f1c559f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:10.660834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f72a3d-7b0d-45e9-9cb6-e1846f1c559f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:10.661402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f72a3d-7b0d-45e9-9cb6-e1846f1c559f admin admin] PATH_INFO: `/v3/users/cfe5fa7501b340d29ab4402c59b8359c` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:10.662752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f72a3d-7b0d-45e9-9cb6-e1846f1c559f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe5fa7501b340d29ab4402c59b8359c)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:10.665011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f72a3d-7b0d-45e9-9cb6-e1846f1c559f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:10.748119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:10.748119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 892/1821] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:10 2022] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:10.749748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15cb14-d2b0-410b-9330-3c517abab4dc admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:10.828863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15cb14-d2b0-410b-9330-3c517abab4dc admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:10.835492 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bc3f9-5f1f-4ee4-a94d-1a1748dee753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:10.839429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bc3f9-5f1f-4ee4-a94d-1a1748dee753 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:10.839429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bc3f9-5f1f-4ee4-a94d-1a1748dee753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:10.839429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bc3f9-5f1f-4ee4-a94d-1a1748dee753 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:10.839429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bc3f9-5f1f-4ee4-a94d-1a1748dee753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:10.839812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bc3f9-5f1f-4ee4-a94d-1a1748dee753 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:11.466913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 893/1822] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:10 2022] POST /identity/v3/users => generated 283 bytes in 718 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:11.471600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bc3f9-5f1f-4ee4-a94d-1a1748dee753 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:11.488888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bc3f9-5f1f-4ee4-a94d-1a1748dee753 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:11.497708 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611ebac-9016-4579-b3e2-60bb5057ba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:11.498862 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611ebac-9016-4579-b3e2-60bb5057ba43 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:11.499187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611ebac-9016-4579-b3e2-60bb5057ba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:11.499475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611ebac-9016-4579-b3e2-60bb5057ba43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:11.500303 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611ebac-9016-4579-b3e2-60bb5057ba43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:11.501966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611ebac-9016-4579-b3e2-60bb5057ba43 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:11.514042 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 894/1823] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:04:11.518528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611ebac-9016-4579-b3e2-60bb5057ba43 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:11.530351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611ebac-9016-4579-b3e2-60bb5057ba43 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:11.535442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61db89-82f1-44e2-b0b5-5b1e3c2d54b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:11.536235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61db89-82f1-44e2-b0b5-5b1e3c2d54b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:11.536681 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61db89-82f1-44e2-b0b5-5b1e3c2d54b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:11.536966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61db89-82f1-44e2-b0b5-5b1e3c2d54b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:11.537765 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61db89-82f1-44e2-b0b5-5b1e3c2d54b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:11.539516 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61db89-82f1-44e2-b0b5-5b1e3c2d54b9 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:11.562443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 895/1824] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:04:11.633781 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61db89-82f1-44e2-b0b5-5b1e3c2d54b9 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:11.647588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61db89-82f1-44e2-b0b5-5b1e3c2d54b9 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:11.658151 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a13cd4-79c3-43a4-9492-6625aefcff22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:11.660978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a13cd4-79c3-43a4-9492-6625aefcff22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:11.661537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a13cd4-79c3-43a4-9492-6625aefcff22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:11.661963 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a13cd4-79c3-43a4-9492-6625aefcff22 admin admin] PATH_INFO: `/v3/projects/e14bdcffed8f4862971363476de311ac/users/f4197a7f4071474a809db8711765d60c/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:11.692760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a13cd4-79c3-43a4-9492-6625aefcff22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14bdcffed8f4862971363476de311ac, user_id=f4197a7f4071474a809db8711765d60c, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:11.706816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a13cd4-79c3-43a4-9492-6625aefcff22 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:11.878027 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:11.899469 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-f6f72a3d-7b0d-45e9-9cb6-e1846f1c559f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe5fa7501b340d29ab4402c59b8359c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:11.915273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-f6f72a3d-7b0d-45e9-9cb6-e1846f1c559f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe5fa7501b340d29ab4402c59b8359c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:11.916438 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-f6f72a3d-7b0d-45e9-9cb6-e1846f1c559f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe5fa7501b340d29ab4402c59b8359c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:11.940679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-f6f72a3d-7b0d-45e9-9cb6-e1846f1c559f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe5fa7501b340d29ab4402c59b8359c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:11.941521 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-f6f72a3d-7b0d-45e9-9cb6-e1846f1c559f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe5fa7501b340d29ab4402c59b8359c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:12.247870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 896/1825] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:11 2022] PUT /identity/v3/projects/e14bdcffed8f4862971363476de311ac/users/f4197a7f4071474a809db8711765d60c/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:12.255225 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2625d8-10ae-4d6b-99c3-e69c30780704 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:12.255415 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 930/1826] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:10 2022] DELETE /identity/v3/users/cfe5fa7501b340d29ab4402c59b8359c => generated 0 bytes in 1621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:12.256005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2625d8-10ae-4d6b-99c3-e69c30780704 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:12.256435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2625d8-10ae-4d6b-99c3-e69c30780704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:12.267106 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201ec8f-7f43-4a9a-8c8e-22883e8df7cd None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:12.267918 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201ec8f-7f43-4a9a-8c8e-22883e8df7cd None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:12.268658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201ec8f-7f43-4a9a-8c8e-22883e8df7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:12.297468 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-fb2625d8-10ae-4d6b-99c3-e69c30780704 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:12.299031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-fb2625d8-10ae-4d6b-99c3-e69c30780704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:12.328289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-5201ec8f-7f43-4a9a-8c8e-22883e8df7cd None None] MFA Rules not processed for user `f4197a7f4071474a809db8711765d60c`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:12.332550 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5201ec8f-7f43-4a9a-8c8e-22883e8df7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:12.376225 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 897/1827] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:12.386243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2625d8-10ae-4d6b-99c3-e69c30780704 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:12.387986 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-fb2625d8-10ae-4d6b-99c3-e69c30780704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:12.458101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 931/1828] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:12.463389 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201ec8f-7f43-4a9a-8c8e-22883e8df7cd None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:12.466249 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5201ec8f-7f43-4a9a-8c8e-22883e8df7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:12.475313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2625d8-10ae-4d6b-99c3-e69c30780704 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:12.482558 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201ec8f-7f43-4a9a-8c8e-22883e8df7cd None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:12.485295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d23e08-013a-445f-a62a-ff7b33668930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:12.486777 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d23e08-013a-445f-a62a-ff7b33668930 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:12.488023 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d23e08-013a-445f-a62a-ff7b33668930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:12.488475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d23e08-013a-445f-a62a-ff7b33668930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:12.489396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42920b9-c53f-428b-95cf-841095bf47f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:12.490303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42920b9-c53f-428b-95cf-841095bf47f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:12.490706 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42920b9-c53f-428b-95cf-841095bf47f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:12.491079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42920b9-c53f-428b-95cf-841095bf47f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:12.491914 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42920b9-c53f-428b-95cf-841095bf47f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:12.493990 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42920b9-c53f-428b-95cf-841095bf47f1 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:12.501672 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d23e08-013a-445f-a62a-ff7b33668930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:12.503574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d23e08-013a-445f-a62a-ff7b33668930 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:12.518155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 898/1829] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:04:12.788521 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 932/1830] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:12 2022] POST /identity/v3/projects => generated 363 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:12.793856 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d23e08-013a-445f-a62a-ff7b33668930 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:12.808319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d23e08-013a-445f-a62a-ff7b33668930 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:12.996698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818070-a2e8-4e6d-b2f5-94b0c9f97219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:12.997369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818070-a2e8-4e6d-b2f5-94b0c9f97219 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:12.997660 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818070-a2e8-4e6d-b2f5-94b0c9f97219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:12.997945 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818070-a2e8-4e6d-b2f5-94b0c9f97219 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:12.999227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818070-a2e8-4e6d-b2f5-94b0c9f97219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:13.001629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818070-a2e8-4e6d-b2f5-94b0c9f97219 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:13.178769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 899/1831] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:12 2022] POST /identity/v3/users => generated 288 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:13.180080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42920b9-c53f-428b-95cf-841095bf47f1 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:13.191866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42920b9-c53f-428b-95cf-841095bf47f1 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:13.196620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4345d73-c9fc-48ec-9af1-1618472a6e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:13.197345 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345d73-c9fc-48ec-9af1-1618472a6e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:13.197805 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345d73-c9fc-48ec-9af1-1618472a6e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:13.198308 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4345d73-c9fc-48ec-9af1-1618472a6e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:13.199918 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4345d73-c9fc-48ec-9af1-1618472a6e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:13.210894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4345d73-c9fc-48ec-9af1-1618472a6e54 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:13.221437 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 933/1832] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:13.226562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818070-a2e8-4e6d-b2f5-94b0c9f97219 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:13.238464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818070-a2e8-4e6d-b2f5-94b0c9f97219 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:13.243850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae052a1-dbbf-4a43-a6e6-b903c25ad034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:13.245335 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae052a1-dbbf-4a43-a6e6-b903c25ad034 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:13.245335 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae052a1-dbbf-4a43-a6e6-b903c25ad034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:13.245547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae052a1-dbbf-4a43-a6e6-b903c25ad034 admin admin] PATH_INFO: `/v3/projects/41be0bce6d36414a98855f775a8e068b/users/2277c9bea8a64ea1bd1d141cdc2502e7/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:13.276112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae052a1-dbbf-4a43-a6e6-b903c25ad034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41be0bce6d36414a98855f775a8e068b, user_id=2277c9bea8a64ea1bd1d141cdc2502e7, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:13.277705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4345d73-c9fc-48ec-9af1-1618472a6e54 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:13.281204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-d4345d73-c9fc-48ec-9af1-1618472a6e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:13.286170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae052a1-dbbf-4a43-a6e6-b903c25ad034 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:13.317230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4345d73-c9fc-48ec-9af1-1618472a6e54 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:13.325995 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc1770-94b9-441e-9b4c-599191f04683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:13.327134 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc1770-94b9-441e-9b4c-599191f04683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:13.327494 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc1770-94b9-441e-9b4c-599191f04683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:13.327784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc1770-94b9-441e-9b4c-599191f04683 admin admin] PATH_INFO: `/v3/projects/bc098017f37d4e60935206b3aa9a91ce` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:13.330289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc1770-94b9-441e-9b4c-599191f04683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc098017f37d4e60935206b3aa9a91ce)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:13.340698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc1770-94b9-441e-9b4c-599191f04683 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:13.378426 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 900/1833] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:13 2022] PUT /identity/v3/projects/41be0bce6d36414a98855f775a8e068b/users/2277c9bea8a64ea1bd1d141cdc2502e7/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:13.382887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae052a1-dbbf-4a43-a6e6-b903c25ad034 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:13.522728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-4dbc1770-94b9-441e-9b4c-599191f04683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc098017f37d4e60935206b3aa9a91ce', 'request_id': 'req-4dbc1770-94b9-441e-9b4c-599191f04683'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:13.535883 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-4dbc1770-94b9-441e-9b4c-599191f04683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc098017f37d4e60935206b3aa9a91ce', 'request_id': 'req-4dbc1770-94b9-441e-9b4c-599191f04683'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:13.560508 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-4dbc1770-94b9-441e-9b4c-599191f04683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc098017f37d4e60935206b3aa9a91ce', 'request_id': 'req-4dbc1770-94b9-441e-9b4c-599191f04683'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:13.583011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae052a1-dbbf-4a43-a6e6-b903c25ad034 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:13.695597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-4dbc1770-94b9-441e-9b4c-599191f04683 admin admin] The token cache is being invalidate because project bc098017f37d4e60935206b3aa9a91ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:13.698888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-4dbc1770-94b9-441e-9b4c-599191f04683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:13.698888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-4dbc1770-94b9-441e-9b4c-599191f04683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:13.704049 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 934/1834] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:13 2022] DELETE /identity/v3/projects/bc098017f37d4e60935206b3aa9a91ce => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:13.705431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc1770-94b9-441e-9b4c-599191f04683 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:13.707489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4dbc1770-94b9-441e-9b4c-599191f04683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:13.708177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9629f-50d5-40e1-869c-93ba5662e1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:13.708901 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9629f-50d5-40e1-869c-93ba5662e1fd admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:13.709309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9629f-50d5-40e1-869c-93ba5662e1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:13.709595 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9629f-50d5-40e1-869c-93ba5662e1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:13.710356 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9629f-50d5-40e1-869c-93ba5662e1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:13.712021 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9629f-50d5-40e1-869c-93ba5662e1fd admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:13.724912 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc1770-94b9-441e-9b4c-599191f04683 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:13.743772 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 901/1835] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:13.744777 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9629f-50d5-40e1-869c-93ba5662e1fd admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:13.747504 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-83e9629f-50d5-40e1-869c-93ba5662e1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:13.754689 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5a8d5-af8b-4d68-9fca-e65d3080a806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:13.755569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5a8d5-af8b-4d68-9fca-e65d3080a806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:13.755569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5a8d5-af8b-4d68-9fca-e65d3080a806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:13.755569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5a8d5-af8b-4d68-9fca-e65d3080a806 admin admin] PATH_INFO: `/v3/users/43dd70d346eb48cca6bcec1fc465dc01` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:13.767949 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9629f-50d5-40e1-869c-93ba5662e1fd admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:13.770031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5a8d5-af8b-4d68-9fca-e65d3080a806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43dd70d346eb48cca6bcec1fc465dc01)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:13.772055 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5a8d5-af8b-4d68-9fca-e65d3080a806 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:13.774666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb26df1-3873-4d9f-bde1-62f3131f5a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:13.776125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb26df1-3873-4d9f-bde1-62f3131f5a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:13.776414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb26df1-3873-4d9f-bde1-62f3131f5a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:13.777059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb26df1-3873-4d9f-bde1-62f3131f5a9d admin admin] PATH_INFO: `/v3/projects/41be0bce6d36414a98855f775a8e068b/users/2277c9bea8a64ea1bd1d141cdc2502e7/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:13.784242 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb26df1-3873-4d9f-bde1-62f3131f5a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=41be0bce6d36414a98855f775a8e068b, user_id=2277c9bea8a64ea1bd1d141cdc2502e7, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:13.784242 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb26df1-3873-4d9f-bde1-62f3131f5a9d admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:13.798055 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 902/1836] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:13 2022] PUT /identity/v3/projects/41be0bce6d36414a98855f775a8e068b/users/2277c9bea8a64ea1bd1d141cdc2502e7/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:13.808900 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388304-80a9-4360-89c2-f4c11123fe14 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:13.810051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388304-80a9-4360-89c2-f4c11123fe14 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:13.810910 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388304-80a9-4360-89c2-f4c11123fe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:13.844739 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-76388304-80a9-4360-89c2-f4c11123fe14 None None] MFA Rules not processed for user `2277c9bea8a64ea1bd1d141cdc2502e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:13.846214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-76388304-80a9-4360-89c2-f4c11123fe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:13.962163 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 903/1837] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:13 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:13.987214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388304-80a9-4360-89c2-f4c11123fe14 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:13.988776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-76388304-80a9-4360-89c2-f4c11123fe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:14.076250 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388304-80a9-4360-89c2-f4c11123fe14 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:14.076428 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b4f5a8d5-af8b-4d68-9fca-e65d3080a806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43dd70d346eb48cca6bcec1fc465dc01'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:14.083343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465fa87-ffe5-4a58-9c8a-570cee47909a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:14.084634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465fa87-ffe5-4a58-9c8a-570cee47909a service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:14.084819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465fa87-ffe5-4a58-9c8a-570cee47909a service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:14.085097 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465fa87-ffe5-4a58-9c8a-570cee47909a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:14.086363 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b4f5a8d5-af8b-4d68-9fca-e65d3080a806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43dd70d346eb48cca6bcec1fc465dc01'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:14.087707 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b4f5a8d5-af8b-4d68-9fca-e65d3080a806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43dd70d346eb48cca6bcec1fc465dc01'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:14.100255 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465fa87-ffe5-4a58-9c8a-570cee47909a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:14.106053 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465fa87-ffe5-4a58-9c8a-570cee47909a service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:14.118410 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b4f5a8d5-af8b-4d68-9fca-e65d3080a806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43dd70d346eb48cca6bcec1fc465dc01'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:14.120145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b4f5a8d5-af8b-4d68-9fca-e65d3080a806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43dd70d346eb48cca6bcec1fc465dc01'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:14.125915 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 904/1838] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:13 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:04:14.230122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 935/1839] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:13 2022] DELETE /identity/v3/users/43dd70d346eb48cca6bcec1fc465dc01 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:14.739924 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465fa87-ffe5-4a58-9c8a-570cee47909a service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:14.756078 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465fa87-ffe5-4a58-9c8a-570cee47909a service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:14.828836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698ad37-0dfb-4342-bae2-228f6f490020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:14.829679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698ad37-0dfb-4342-bae2-228f6f490020 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:14.830180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698ad37-0dfb-4342-bae2-228f6f490020 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:14.847034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698ad37-0dfb-4342-bae2-228f6f490020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:14.847034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-0698ad37-0dfb-4342-bae2-228f6f490020 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:14.910871 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698ad37-0dfb-4342-bae2-228f6f490020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:14.912453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698ad37-0dfb-4342-bae2-228f6f490020 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:14.923705 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 905/1840] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:15.402427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5a8d5-af8b-4d68-9fca-e65d3080a806 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:15.404920 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b4f5a8d5-af8b-4d68-9fca-e65d3080a806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:15.538776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5a8d5-af8b-4d68-9fca-e65d3080a806 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:15.544289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d2556-5086-4340-9f34-329f17d479a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:15.545251 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d2556-5086-4340-9f34-329f17d479a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:15.546082 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d2556-5086-4340-9f34-329f17d479a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:15.546377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d2556-5086-4340-9f34-329f17d479a7 admin admin] PATH_INFO: `/v3/projects/0d556b4b89384d969b7b392a377bbc88` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:15.548787 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d2556-5086-4340-9f34-329f17d479a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d556b4b89384d969b7b392a377bbc88)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:15.551088 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d2556-5086-4340-9f34-329f17d479a7 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:15.839555 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-267d2556-5086-4340-9f34-329f17d479a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d556b4b89384d969b7b392a377bbc88', 'request_id': 'req-267d2556-5086-4340-9f34-329f17d479a7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:15.854816 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-267d2556-5086-4340-9f34-329f17d479a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d556b4b89384d969b7b392a377bbc88', 'request_id': 'req-267d2556-5086-4340-9f34-329f17d479a7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:15.865616 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-267d2556-5086-4340-9f34-329f17d479a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d556b4b89384d969b7b392a377bbc88', 'request_id': 'req-267d2556-5086-4340-9f34-329f17d479a7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:16.070204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-267d2556-5086-4340-9f34-329f17d479a7 admin admin] The token cache is being invalidate because project 0d556b4b89384d969b7b392a377bbc88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:16.070433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-267d2556-5086-4340-9f34-329f17d479a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:16.071370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-267d2556-5086-4340-9f34-329f17d479a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:16.084529 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 936/1841] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:15 2022] DELETE /identity/v3/projects/0d556b4b89384d969b7b392a377bbc88 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:16.086750 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c45a07-9467-4d26-ba0d-686d06233e36 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:16.087900 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c45a07-9467-4d26-ba0d-686d06233e36 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:16.088362 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c45a07-9467-4d26-ba0d-686d06233e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:16.092064 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a68d15-d833-4a07-bbc6-38004c23a3f7 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:16.093249 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a68d15-d833-4a07-bbc6-38004c23a3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:16.095803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a68d15-d833-4a07-bbc6-38004c23a3f7 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:16.107388 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 937/1842] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 16 15:04:16 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:04:16.114778 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62007a56-8fe4-408e-8481-41f04de184d4 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:16.115365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62007a56-8fe4-408e-8481-41f04de184d4 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:16.115735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62007a56-8fe4-408e-8481-41f04de184d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:16.118793 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-74c45a07-9467-4d26-ba0d-686d06233e36 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:16.120372 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-74c45a07-9467-4d26-ba0d-686d06233e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:16.142893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-62007a56-8fe4-408e-8481-41f04de184d4 None None] MFA Rules not processed for user `60c2f1c63a674e3195c490ab5ad1318f`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:16.144581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-62007a56-8fe4-408e-8481-41f04de184d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:16.229113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 906/1843] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:16.246908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf801a1d-3f10-4a10-a548-3a27a8ed01bc None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:16.247446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf801a1d-3f10-4a10-a548-3a27a8ed01bc None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:16.247894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf801a1d-3f10-4a10-a548-3a27a8ed01bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:16.271487 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-cf801a1d-3f10-4a10-a548-3a27a8ed01bc None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:16.273654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-cf801a1d-3f10-4a10-a548-3a27a8ed01bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:16.291345 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 907/1844] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:16.294082 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf801a1d-3f10-4a10-a548-3a27a8ed01bc None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:16.302011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 938/1845] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 16 15:04:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:16.307094 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf801a1d-3f10-4a10-a548-3a27a8ed01bc None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:16.314706 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd81990-b073-4b53-a4c0-7a8204354a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:16.315775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd81990-b073-4b53-a4c0-7a8204354a71 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:16.316223 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd81990-b073-4b53-a4c0-7a8204354a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:16.316534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd81990-b073-4b53-a4c0-7a8204354a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:16.317354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd81990-b073-4b53-a4c0-7a8204354a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:04:16.317852 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd81990-b073-4b53-a4c0-7a8204354a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:16.319443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd81990-b073-4b53-a4c0-7a8204354a71 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:16.339890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 908/1846] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:04:16.344300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62007a56-8fe4-408e-8481-41f04de184d4 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:16.365311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62007a56-8fe4-408e-8481-41f04de184d4 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:16.371097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e10cf-ca1d-4bec-a01e-822f974b7848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:16.371801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e10cf-ca1d-4bec-a01e-822f974b7848 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:16.372089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e10cf-ca1d-4bec-a01e-822f974b7848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:16.372443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e10cf-ca1d-4bec-a01e-822f974b7848 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:16.373238 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e10cf-ca1d-4bec-a01e-822f974b7848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:16.375317 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e10cf-ca1d-4bec-a01e-822f974b7848 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:16.447598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd81990-b073-4b53-a4c0-7a8204354a71 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:16.449843 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-0bd81990-b073-4b53-a4c0-7a8204354a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:16.472149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd81990-b073-4b53-a4c0-7a8204354a71 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:16.478553 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a4c75-575d-4f6a-b222-72a478aab0f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:16.481398 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a4c75-575d-4f6a-b222-72a478aab0f2 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:16.482300 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a4c75-575d-4f6a-b222-72a478aab0f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:16.484786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a4c75-575d-4f6a-b222-72a478aab0f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:16.497715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 939/1847] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:16 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:16.501114 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a4c75-575d-4f6a-b222-72a478aab0f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:16.503004 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e10cf-ca1d-4bec-a01e-822f974b7848 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:16.503165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a4c75-575d-4f6a-b222-72a478aab0f2 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:16.516839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 909/1848] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:16.589472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e10cf-ca1d-4bec-a01e-822f974b7848 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:16.596928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164c0e9-fd37-42fd-b2af-f486c33ad907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:16.598058 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164c0e9-fd37-42fd-b2af-f486c33ad907 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:16.598348 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164c0e9-fd37-42fd-b2af-f486c33ad907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:16.598626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164c0e9-fd37-42fd-b2af-f486c33ad907 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:16.599371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164c0e9-fd37-42fd-b2af-f486c33ad907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:16.601526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164c0e9-fd37-42fd-b2af-f486c33ad907 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:16.741684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 940/1849] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:16 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:16.744436 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a4c75-575d-4f6a-b222-72a478aab0f2 service nova] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:16.761213 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a4c75-575d-4f6a-b222-72a478aab0f2 service nova] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:16.768728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e5d00-3fe7-4722-8469-0768e5043657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:16.769456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e5d00-3fe7-4722-8469-0768e5043657 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:16.769745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e5d00-3fe7-4722-8469-0768e5043657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:16.770020 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e5d00-3fe7-4722-8469-0768e5043657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:16.770840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e5d00-3fe7-4722-8469-0768e5043657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:16.772626 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e5d00-3fe7-4722-8469-0768e5043657 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:16.785583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 910/1850] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:16.790145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164c0e9-fd37-42fd-b2af-f486c33ad907 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:16.801592 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164c0e9-fd37-42fd-b2af-f486c33ad907 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:16.807652 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0be74-96c7-40ce-859c-b66951b71c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:16.808571 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0be74-96c7-40ce-859c-b66951b71c2d admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:16.808879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0be74-96c7-40ce-859c-b66951b71c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:16.809163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0be74-96c7-40ce-859c-b66951b71c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:16.809930 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0be74-96c7-40ce-859c-b66951b71c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:16.811682 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0be74-96c7-40ce-859c-b66951b71c2d admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:16.833032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 941/1851] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:04:16.838301 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e5d00-3fe7-4722-8469-0768e5043657 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:16.865638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e5d00-3fe7-4722-8469-0768e5043657 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:16.873169 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a179a-0902-461e-b775-28be7f14365c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:16.874291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a179a-0902-461e-b775-28be7f14365c admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:16.874676 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a179a-0902-461e-b775-28be7f14365c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:16.875056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a179a-0902-461e-b775-28be7f14365c admin admin] PATH_INFO: `/v3/projects/d9aeb955c56a4aecb32d5008527703fc/users/7531cd92a155460fa615581cb26ac550/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:16.904864 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a179a-0902-461e-b775-28be7f14365c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9aeb955c56a4aecb32d5008527703fc, user_id=7531cd92a155460fa615581cb26ac550, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:16.909264 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a179a-0902-461e-b775-28be7f14365c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:17.056085 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 911/1852] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:16 2022] PUT /identity/v3/projects/d9aeb955c56a4aecb32d5008527703fc/users/7531cd92a155460fa615581cb26ac550/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:17.067122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d2689-d22c-4115-ae81-8a4b94bc388e None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:17.067417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d2689-d22c-4115-ae81-8a4b94bc388e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:17.067714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d2689-d22c-4115-ae81-8a4b94bc388e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:17.104380 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-109d2689-d22c-4115-ae81-8a4b94bc388e None None] MFA Rules not processed for user `7531cd92a155460fa615581cb26ac550`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:17.105748 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-109d2689-d22c-4115-ae81-8a4b94bc388e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:17.206363 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 942/1853] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:17.211316 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a179a-0902-461e-b775-28be7f14365c admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:17.320562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a179a-0902-461e-b775-28be7f14365c admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:17.326809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998802f-598b-471b-a00b-6fb7e388a5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:17.328376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998802f-598b-471b-a00b-6fb7e388a5af admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:17.328991 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998802f-598b-471b-a00b-6fb7e388a5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:17.329483 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998802f-598b-471b-a00b-6fb7e388a5af admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:17.330601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998802f-598b-471b-a00b-6fb7e388a5af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:17.333546 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998802f-598b-471b-a00b-6fb7e388a5af admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:17.454438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 912/1854] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:17 2022] POST /identity/v3/projects => generated 375 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:17.457497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d2689-d22c-4115-ae81-8a4b94bc388e None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:17.471579 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d2689-d22c-4115-ae81-8a4b94bc388e None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:17.533643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:17.636558 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2d3c0-2a3d-4ab5-85de-b3fa97a1b3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:17.638855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2d3c0-2a3d-4ab5-85de-b3fa97a1b3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:17.639337 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2d3c0-2a3d-4ab5-85de-b3fa97a1b3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:17.639756 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2d3c0-2a3d-4ab5-85de-b3fa97a1b3d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:17.640883 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2d3c0-2a3d-4ab5-85de-b3fa97a1b3d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:17.643239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2d3c0-2a3d-4ab5-85de-b3fa97a1b3d2 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:17.694228 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:17.832767 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 943/1855] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:17 2022] POST /identity/v3/users => generated 288 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:17.833922 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998802f-598b-471b-a00b-6fb7e388a5af admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:17.845159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998802f-598b-471b-a00b-6fb7e388a5af admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:17.850894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe39a73-94ec-47ad-9bcb-dcae85e41d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:17.851656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe39a73-94ec-47ad-9bcb-dcae85e41d44 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:17.852066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe39a73-94ec-47ad-9bcb-dcae85e41d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:17.852309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe39a73-94ec-47ad-9bcb-dcae85e41d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:17.853287 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe39a73-94ec-47ad-9bcb-dcae85e41d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:17.855078 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe39a73-94ec-47ad-9bcb-dcae85e41d44 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:17.866648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 913/1856] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:17.871000 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2d3c0-2a3d-4ab5-85de-b3fa97a1b3d2 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:17.881232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2d3c0-2a3d-4ab5-85de-b3fa97a1b3d2 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:17.887396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1359aad-705a-4bd2-8c4a-265bc4442054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:17.893687 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1359aad-705a-4bd2-8c4a-265bc4442054 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:17.893687 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1359aad-705a-4bd2-8c4a-265bc4442054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:17.893687 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1359aad-705a-4bd2-8c4a-265bc4442054 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:17.893687 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1359aad-705a-4bd2-8c4a-265bc4442054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:17.894631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1359aad-705a-4bd2-8c4a-265bc4442054 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:17.908965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 944/1857] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:17.914766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe39a73-94ec-47ad-9bcb-dcae85e41d44 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:17.926417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe39a73-94ec-47ad-9bcb-dcae85e41d44 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:17.931443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f160f7-9084-47cc-8817-4caaa89b317e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:17.932379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f160f7-9084-47cc-8817-4caaa89b317e admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:17.934047 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f160f7-9084-47cc-8817-4caaa89b317e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:17.934703 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f160f7-9084-47cc-8817-4caaa89b317e admin admin] PATH_INFO: `/v3/projects/8337e0fa1a0e49c4a5da47a87b836378/users/f6d6179054d14144b1bdbbb6b8cf2ed2/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:17.975345 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f160f7-9084-47cc-8817-4caaa89b317e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8337e0fa1a0e49c4a5da47a87b836378, user_id=f6d6179054d14144b1bdbbb6b8cf2ed2, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:17.978148 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f160f7-9084-47cc-8817-4caaa89b317e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:18.076929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 914/1858] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:17 2022] PUT /identity/v3/projects/8337e0fa1a0e49c4a5da47a87b836378/users/f6d6179054d14144b1bdbbb6b8cf2ed2/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:18.087887 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11893b3-de97-4088-a15b-8b1b8ef9bc82 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:18.088536 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11893b3-de97-4088-a15b-8b1b8ef9bc82 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:18.088819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11893b3-de97-4088-a15b-8b1b8ef9bc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:18.120387 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-e11893b3-de97-4088-a15b-8b1b8ef9bc82 None None] MFA Rules not processed for user `f6d6179054d14144b1bdbbb6b8cf2ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:18.121758 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e11893b3-de97-4088-a15b-8b1b8ef9bc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:18.215027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f160f7-9084-47cc-8817-4caaa89b317e admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:18.217496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 945/1859] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:18.288058 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f160f7-9084-47cc-8817-4caaa89b317e admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:18.294908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36974e-348d-4ca3-9f6e-7952ce9503a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:18.295588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36974e-348d-4ca3-9f6e-7952ce9503a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:18.295947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36974e-348d-4ca3-9f6e-7952ce9503a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:18.296233 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36974e-348d-4ca3-9f6e-7952ce9503a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:18.296918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36974e-348d-4ca3-9f6e-7952ce9503a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:18.298957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36974e-348d-4ca3-9f6e-7952ce9503a1 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:18.468350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 915/1860] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:18 2022] POST /identity/v3/projects => generated 375 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:18.473118 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11893b3-de97-4088-a15b-8b1b8ef9bc82 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:18.486782 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11893b3-de97-4088-a15b-8b1b8ef9bc82 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:18.568525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bb16b-232d-4b5d-9098-2f43571f2325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:18.568525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bb16b-232d-4b5d-9098-2f43571f2325 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:18.568525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bb16b-232d-4b5d-9098-2f43571f2325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:18.568525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bb16b-232d-4b5d-9098-2f43571f2325 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:18.568890 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bb16b-232d-4b5d-9098-2f43571f2325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:18.568890 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bb16b-232d-4b5d-9098-2f43571f2325 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:18.738608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 946/1861] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:18 2022] POST /identity/v3/users => generated 294 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:18.740434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36974e-348d-4ca3-9f6e-7952ce9503a1 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:18.763362 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36974e-348d-4ca3-9f6e-7952ce9503a1 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:18.772161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3e939-dff1-4450-855d-5a9614ea473e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:18.774277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e939-dff1-4450-855d-5a9614ea473e admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:18.775415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e939-dff1-4450-855d-5a9614ea473e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:18.775911 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3e939-dff1-4450-855d-5a9614ea473e admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:18.776874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3e939-dff1-4450-855d-5a9614ea473e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:18.779590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3e939-dff1-4450-855d-5a9614ea473e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:18.802379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 916/1862] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:18.803443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bb16b-232d-4b5d-9098-2f43571f2325 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:18.825467 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bb16b-232d-4b5d-9098-2f43571f2325 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:18.839127 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe350b13-9287-4c91-a7f8-2004c2f4f1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:18.842144 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe350b13-9287-4c91-a7f8-2004c2f4f1c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:18.842746 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe350b13-9287-4c91-a7f8-2004c2f4f1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:18.843640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe350b13-9287-4c91-a7f8-2004c2f4f1c9 admin admin] PATH_INFO: `/v3/projects/db004a529078454496afdb7ff7388c44/users/914e36c2c79347668e108c5097280357/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:18.877929 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe350b13-9287-4c91-a7f8-2004c2f4f1c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db004a529078454496afdb7ff7388c44, user_id=914e36c2c79347668e108c5097280357, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:18.880848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe350b13-9287-4c91-a7f8-2004c2f4f1c9 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:19.011461 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 947/1863] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:18 2022] PUT /identity/v3/projects/db004a529078454496afdb7ff7388c44/users/914e36c2c79347668e108c5097280357/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:19.015747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3e939-dff1-4450-855d-5a9614ea473e admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:19.039366 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3e939-dff1-4450-855d-5a9614ea473e admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:19.118491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b71a63-58c8-4768-9990-b9c2f2844988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:19.119489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b71a63-58c8-4768-9990-b9c2f2844988 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:19.119801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b71a63-58c8-4768-9990-b9c2f2844988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:19.120095 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b71a63-58c8-4768-9990-b9c2f2844988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:19.120816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b71a63-58c8-4768-9990-b9c2f2844988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:19.122509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b71a63-58c8-4768-9990-b9c2f2844988 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:19.141442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 917/1864] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:19.147611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe350b13-9287-4c91-a7f8-2004c2f4f1c9 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:19.159980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe350b13-9287-4c91-a7f8-2004c2f4f1c9 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:19.166501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccdb1f-cbf1-4e17-955a-30643d1f6ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:19.167878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccdb1f-cbf1-4e17-955a-30643d1f6ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:19.168181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccdb1f-cbf1-4e17-955a-30643d1f6ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:19.168468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccdb1f-cbf1-4e17-955a-30643d1f6ed9 admin admin] PATH_INFO: `/v3/projects/db004a529078454496afdb7ff7388c44/users/914e36c2c79347668e108c5097280357/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:19.170889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccdb1f-cbf1-4e17-955a-30643d1f6ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db004a529078454496afdb7ff7388c44, user_id=914e36c2c79347668e108c5097280357, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:19.173333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccdb1f-cbf1-4e17-955a-30643d1f6ed9 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:19.189243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 948/1865] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:19 2022] PUT /identity/v3/projects/db004a529078454496afdb7ff7388c44/users/914e36c2c79347668e108c5097280357/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:19.203867 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc0e81-5985-469f-b632-2d1c43f53176 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:19.209370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc0e81-5985-469f-b632-2d1c43f53176 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:19.209370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc0e81-5985-469f-b632-2d1c43f53176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:19.255705 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-69bc0e81-5985-469f-b632-2d1c43f53176 None None] MFA Rules not processed for user `914e36c2c79347668e108c5097280357`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:19.256807 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-69bc0e81-5985-469f-b632-2d1c43f53176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:19.358685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 918/1866] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:19.575869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccdb1f-cbf1-4e17-955a-30643d1f6ed9 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:19.577745 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-cfccdb1f-cbf1-4e17-955a-30643d1f6ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:19.638550 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccdb1f-cbf1-4e17-955a-30643d1f6ed9 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:19.642396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54a03c-f90c-43da-87d0-53c26ba382c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:19.643198 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54a03c-f90c-43da-87d0-53c26ba382c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:19.649805 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54a03c-f90c-43da-87d0-53c26ba382c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:19.649805 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54a03c-f90c-43da-87d0-53c26ba382c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:19.710990 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54a03c-f90c-43da-87d0-53c26ba382c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:19.712891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54a03c-f90c-43da-87d0-53c26ba382c9 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:19.725050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 949/1867] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:20.063796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc0e81-5985-469f-b632-2d1c43f53176 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:20.066657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-69bc0e81-5985-469f-b632-2d1c43f53176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:20.156936 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc0e81-5985-469f-b632-2d1c43f53176 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:20.163619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240e892-7a05-4202-b2a4-e236040e52d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:20.166447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e892-7a05-4202-b2a4-e236040e52d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:20.166447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e892-7a05-4202-b2a4-e236040e52d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:20.166447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e892-7a05-4202-b2a4-e236040e52d0 admin admin] PATH_INFO: `/v3/users/f4197a7f4071474a809db8711765d60c` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:20.168424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240e892-7a05-4202-b2a4-e236040e52d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4197a7f4071474a809db8711765d60c)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:20.174200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240e892-7a05-4202-b2a4-e236040e52d0 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:20.388000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2240e892-7a05-4202-b2a4-e236040e52d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4197a7f4071474a809db8711765d60c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:20.388766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2240e892-7a05-4202-b2a4-e236040e52d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4197a7f4071474a809db8711765d60c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:20.396586 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2240e892-7a05-4202-b2a4-e236040e52d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4197a7f4071474a809db8711765d60c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:20.397357 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2240e892-7a05-4202-b2a4-e236040e52d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4197a7f4071474a809db8711765d60c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:20.505118 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2240e892-7a05-4202-b2a4-e236040e52d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4197a7f4071474a809db8711765d60c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:20.533245 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 919/1868] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:20 2022] DELETE /identity/v3/users/f4197a7f4071474a809db8711765d60c => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:20.539602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2791f1-1a18-42b2-8bbd-f1703038d137 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:20.540868 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2791f1-1a18-42b2-8bbd-f1703038d137 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:20.542640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2791f1-1a18-42b2-8bbd-f1703038d137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:20.591975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-3b2791f1-1a18-42b2-8bbd-f1703038d137 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:20.591975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-3b2791f1-1a18-42b2-8bbd-f1703038d137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:20.713204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 950/1869] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:20.725952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240e892-7a05-4202-b2a4-e236040e52d0 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:20.727719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2240e892-7a05-4202-b2a4-e236040e52d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:20.807344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240e892-7a05-4202-b2a4-e236040e52d0 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:20.807344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb9b39-d5e4-4eda-9cc6-123e2902f1a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:20.807344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb9b39-d5e4-4eda-9cc6-123e2902f1a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:20.807344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb9b39-d5e4-4eda-9cc6-123e2902f1a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:20.808016 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb9b39-d5e4-4eda-9cc6-123e2902f1a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:20.816739 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb9b39-d5e4-4eda-9cc6-123e2902f1a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:20.818218 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb9b39-d5e4-4eda-9cc6-123e2902f1a7 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:20.833561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 920/1870] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:20.939881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:20.995433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2791f1-1a18-42b2-8bbd-f1703038d137 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:20.996907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-3b2791f1-1a18-42b2-8bbd-f1703038d137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:21.009797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2791f1-1a18-42b2-8bbd-f1703038d137 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:21.015206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ea7f2-7fcf-4493-82b9-d8e63ee70e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:21.016168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ea7f2-7fcf-4493-82b9-d8e63ee70e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:21.016475 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ea7f2-7fcf-4493-82b9-d8e63ee70e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:21.016746 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ea7f2-7fcf-4493-82b9-d8e63ee70e02 admin admin] PATH_INFO: `/v3/users/ecde93d4fd3142a6984dc0fb85c7bf17` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:21.018174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ea7f2-7fcf-4493-82b9-d8e63ee70e02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecde93d4fd3142a6984dc0fb85c7bf17)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:21.020380 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ea7f2-7fcf-4493-82b9-d8e63ee70e02 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:21.305298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-170ea7f2-7fcf-4493-82b9-d8e63ee70e02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecde93d4fd3142a6984dc0fb85c7bf17'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:21.313522 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-170ea7f2-7fcf-4493-82b9-d8e63ee70e02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecde93d4fd3142a6984dc0fb85c7bf17'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:21.314258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-170ea7f2-7fcf-4493-82b9-d8e63ee70e02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecde93d4fd3142a6984dc0fb85c7bf17'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:21.329799 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-170ea7f2-7fcf-4493-82b9-d8e63ee70e02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecde93d4fd3142a6984dc0fb85c7bf17'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:21.330642 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-170ea7f2-7fcf-4493-82b9-d8e63ee70e02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecde93d4fd3142a6984dc0fb85c7bf17'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:21.448708 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb9b39-d5e4-4eda-9cc6-123e2902f1a7 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:21.451376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 951/1871] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:20 2022] DELETE /identity/v3/users/ecde93d4fd3142a6984dc0fb85c7bf17 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:21.451479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f6eb9b39-d5e4-4eda-9cc6-123e2902f1a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:21.455587 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb47021-8fe8-4d24-aed3-a0a5d5750390 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:21.455875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb47021-8fe8-4d24-aed3-a0a5d5750390 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:21.456327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb47021-8fe8-4d24-aed3-a0a5d5750390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:21.474413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb9b39-d5e4-4eda-9cc6-123e2902f1a7 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:21.477328 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-dbb47021-8fe8-4d24-aed3-a0a5d5750390 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:21.479455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-dbb47021-8fe8-4d24-aed3-a0a5d5750390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:21.545404 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:21.546839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:21.547121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:21.547396 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f admin admin] PATH_INFO: `/v3/projects/e14bdcffed8f4862971363476de311ac` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:21.548667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e14bdcffed8f4862971363476de311ac)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:21.550687 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:21.563611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 952/1872] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:21.574045 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb47021-8fe8-4d24-aed3-a0a5d5750390 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:21.575526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-dbb47021-8fe8-4d24-aed3-a0a5d5750390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:21.634197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb47021-8fe8-4d24-aed3-a0a5d5750390 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:21.638025 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1c3ea-dd10-443e-aa52-ef1bb2058a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:21.638681 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1c3ea-dd10-443e-aa52-ef1bb2058a9d service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:21.638986 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1c3ea-dd10-443e-aa52-ef1bb2058a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:21.639280 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1c3ea-dd10-443e-aa52-ef1bb2058a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:21.653602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1c3ea-dd10-443e-aa52-ef1bb2058a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:21.655247 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1c3ea-dd10-443e-aa52-ef1bb2058a9d service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:21.665926 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 953/1873] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:04:21.740588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e14bdcffed8f4862971363476de311ac', 'request_id': 'req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:21.747608 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e14bdcffed8f4862971363476de311ac', 'request_id': 'req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:21.754963 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e14bdcffed8f4862971363476de311ac', 'request_id': 'req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:21.864678 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f admin admin] The token cache is being invalidate because project e14bdcffed8f4862971363476de311ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:21.864974 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:21.865943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:21.871046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 921/1874] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:21 2022] DELETE /identity/v3/projects/e14bdcffed8f4862971363476de311ac => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:21.872967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1c3ea-dd10-443e-aa52-ef1bb2058a9d service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:21.876643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e2c1c3ea-dd10-443e-aa52-ef1bb2058a9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:21.905593 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1c3ea-dd10-443e-aa52-ef1bb2058a9d service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:22.053676 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332549a0-0094-4179-b3ee-44def3b96fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:22.055353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332549a0-0094-4179-b3ee-44def3b96fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:22.057027 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332549a0-0094-4179-b3ee-44def3b96fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:22.057328 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332549a0-0094-4179-b3ee-44def3b96fce admin admin] PATH_INFO: `/v3/users/2277c9bea8a64ea1bd1d141cdc2502e7` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:22.059894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332549a0-0094-4179-b3ee-44def3b96fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=2277c9bea8a64ea1bd1d141cdc2502e7)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:22.065098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332549a0-0094-4179-b3ee-44def3b96fce admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:22.167981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:22.168590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:22.232549 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6a853-16db-4ce3-8efd-b2337c3dd15f admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:22.236247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8b7ae-5e8a-411d-a388-38e9fb2726e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:22.236979 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8b7ae-5e8a-411d-a388-38e9fb2726e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:22.237305 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8b7ae-5e8a-411d-a388-38e9fb2726e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:22.237593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8b7ae-5e8a-411d-a388-38e9fb2726e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:22.239484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f8a8b7ae-5e8a-411d-a388-38e9fb2726e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:22.310238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8b7ae-5e8a-411d-a388-38e9fb2726e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:22.312587 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8b7ae-5e8a-411d-a388-38e9fb2726e8 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:22.341844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 922/1875] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:04:22.343303 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8b7ae-5e8a-411d-a388-38e9fb2726e8 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:22.345044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f8a8b7ae-5e8a-411d-a388-38e9fb2726e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:22.365802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8b7ae-5e8a-411d-a388-38e9fb2726e8 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:22.376133 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f4e27-9542-48c4-89f7-8359722889ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:22.378539 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f4e27-9542-48c4-89f7-8359722889ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:22.381291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f4e27-9542-48c4-89f7-8359722889ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:22.381681 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f4e27-9542-48c4-89f7-8359722889ab admin admin] PATH_INFO: `/v3/projects/572f9321cb6848bf93e26eb8ab3efb00` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:22.384578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f4e27-9542-48c4-89f7-8359722889ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=572f9321cb6848bf93e26eb8ab3efb00)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:22.385394 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-332549a0-0094-4179-b3ee-44def3b96fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2277c9bea8a64ea1bd1d141cdc2502e7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:22.391784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f4e27-9542-48c4-89f7-8359722889ab admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:22.393728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-332549a0-0094-4179-b3ee-44def3b96fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2277c9bea8a64ea1bd1d141cdc2502e7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:22.394653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-332549a0-0094-4179-b3ee-44def3b96fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2277c9bea8a64ea1bd1d141cdc2502e7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:22.409191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-332549a0-0094-4179-b3ee-44def3b96fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2277c9bea8a64ea1bd1d141cdc2502e7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:22.410498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-332549a0-0094-4179-b3ee-44def3b96fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2277c9bea8a64ea1bd1d141cdc2502e7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:22.436071 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:22.500981 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 954/1876] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:21 2022] DELETE /identity/v3/users/2277c9bea8a64ea1bd1d141cdc2502e7 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:22.597733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-3f3f4e27-9542-48c4-89f7-8359722889ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572f9321cb6848bf93e26eb8ab3efb00', 'request_id': 'req-3f3f4e27-9542-48c4-89f7-8359722889ab'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:22.606210 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-3f3f4e27-9542-48c4-89f7-8359722889ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572f9321cb6848bf93e26eb8ab3efb00', 'request_id': 'req-3f3f4e27-9542-48c4-89f7-8359722889ab'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:22.613512 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-3f3f4e27-9542-48c4-89f7-8359722889ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572f9321cb6848bf93e26eb8ab3efb00', 'request_id': 'req-3f3f4e27-9542-48c4-89f7-8359722889ab'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:22.831850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-3f3f4e27-9542-48c4-89f7-8359722889ab admin admin] The token cache is being invalidate because project 572f9321cb6848bf93e26eb8ab3efb00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:22.832150 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-3f3f4e27-9542-48c4-89f7-8359722889ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:22.833346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-3f3f4e27-9542-48c4-89f7-8359722889ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:22.834935 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 923/1877] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:22 2022] DELETE /identity/v3/projects/572f9321cb6848bf93e26eb8ab3efb00 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:22.839464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332549a0-0094-4179-b3ee-44def3b96fce admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:22.841009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-332549a0-0094-4179-b3ee-44def3b96fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:22.924606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332549a0-0094-4179-b3ee-44def3b96fce admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:22.993654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28a10a-18c3-4e4c-b158-c5fba4c2090a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:22.995146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28a10a-18c3-4e4c-b158-c5fba4c2090a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:22.995632 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28a10a-18c3-4e4c-b158-c5fba4c2090a admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:22.996156 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28a10a-18c3-4e4c-b158-c5fba4c2090a admin admin] PATH_INFO: `/v3/users/0fe21a842e2f447aad434dfca3f078e7` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:22.997791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28a10a-18c3-4e4c-b158-c5fba4c2090a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe21a842e2f447aad434dfca3f078e7)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:23.003869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28a10a-18c3-4e4c-b158-c5fba4c2090a admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:23.123988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f4e27-9542-48c4-89f7-8359722889ab admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:23.125491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3f3f4e27-9542-48c4-89f7-8359722889ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:23.144613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f4e27-9542-48c4-89f7-8359722889ab admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:23.162901 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f0dc0-cb84-4d2a-a5e6-a197ac52cd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:23.163955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f0dc0-cb84-4d2a-a5e6-a197ac52cd5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:23.164250 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f0dc0-cb84-4d2a-a5e6-a197ac52cd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:23.164564 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f0dc0-cb84-4d2a-a5e6-a197ac52cd5c admin admin] PATH_INFO: `/v3/projects/41be0bce6d36414a98855f775a8e068b` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:23.169578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f0dc0-cb84-4d2a-a5e6-a197ac52cd5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=41be0bce6d36414a98855f775a8e068b)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:23.173903 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f0dc0-cb84-4d2a-a5e6-a197ac52cd5c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:23.338815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-449f0dc0-cb84-4d2a-a5e6-a197ac52cd5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41be0bce6d36414a98855f775a8e068b', 'request_id': 'req-449f0dc0-cb84-4d2a-a5e6-a197ac52cd5c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:23.347075 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-449f0dc0-cb84-4d2a-a5e6-a197ac52cd5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41be0bce6d36414a98855f775a8e068b', 'request_id': 'req-449f0dc0-cb84-4d2a-a5e6-a197ac52cd5c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:23.348739 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7d28a10a-18c3-4e4c-b158-c5fba4c2090a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe21a842e2f447aad434dfca3f078e7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:23.354341 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-449f0dc0-cb84-4d2a-a5e6-a197ac52cd5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41be0bce6d36414a98855f775a8e068b', 'request_id': 'req-449f0dc0-cb84-4d2a-a5e6-a197ac52cd5c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:23.361405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7d28a10a-18c3-4e4c-b158-c5fba4c2090a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe21a842e2f447aad434dfca3f078e7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:23.362156 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7d28a10a-18c3-4e4c-b158-c5fba4c2090a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe21a842e2f447aad434dfca3f078e7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:23.376381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7d28a10a-18c3-4e4c-b158-c5fba4c2090a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe21a842e2f447aad434dfca3f078e7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:23.385588 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7d28a10a-18c3-4e4c-b158-c5fba4c2090a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe21a842e2f447aad434dfca3f078e7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:23.455227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-449f0dc0-cb84-4d2a-a5e6-a197ac52cd5c admin admin] The token cache is being invalidate because project 41be0bce6d36414a98855f775a8e068b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:23.463289 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-449f0dc0-cb84-4d2a-a5e6-a197ac52cd5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:23.464685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-449f0dc0-cb84-4d2a-a5e6-a197ac52cd5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:23.468027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 924/1878] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:23 2022] DELETE /identity/v3/projects/41be0bce6d36414a98855f775a8e068b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:23.473013 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb58352-0b65-4505-a97b-36bec64b06c4 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:23.473414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb58352-0b65-4505-a97b-36bec64b06c4 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:23.473836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb58352-0b65-4505-a97b-36bec64b06c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:23.492908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-dfb58352-0b65-4505-a97b-36bec64b06c4 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:23.497942 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-dfb58352-0b65-4505-a97b-36bec64b06c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:23.572327 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 925/1880] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:23.575730 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 955/1880] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:22 2022] DELETE /identity/v3/users/0fe21a842e2f447aad434dfca3f078e7 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:23.584290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e517a-757c-4920-85e2-67519805d896 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:23.584819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e517a-757c-4920-85e2-67519805d896 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:23.585181 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e517a-757c-4920-85e2-67519805d896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:23.620290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-0f5e517a-757c-4920-85e2-67519805d896 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:23.621562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-0f5e517a-757c-4920-85e2-67519805d896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:23.740467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 926/1881] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:23.745183 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28a10a-18c3-4e4c-b158-c5fba4c2090a admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:23.747443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-7d28a10a-18c3-4e4c-b158-c5fba4c2090a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:23.773255 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28a10a-18c3-4e4c-b158-c5fba4c2090a admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:23.779468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96032ca-1a57-4d1c-95fe-78826c3acf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:23.780238 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96032ca-1a57-4d1c-95fe-78826c3acf7b admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:23.780560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96032ca-1a57-4d1c-95fe-78826c3acf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:23.780952 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96032ca-1a57-4d1c-95fe-78826c3acf7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:23.781769 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96032ca-1a57-4d1c-95fe-78826c3acf7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:04:23.787784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96032ca-1a57-4d1c-95fe-78826c3acf7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:23.787784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96032ca-1a57-4d1c-95fe-78826c3acf7b admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:23.798551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 956/1882] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:04:23.804712 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e517a-757c-4920-85e2-67519805d896 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:23.824327 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e517a-757c-4920-85e2-67519805d896 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:23.842135 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c71bc9-4c7d-42ba-9822-4d29ef58187a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:23.843371 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c71bc9-4c7d-42ba-9822-4d29ef58187a admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:23.843664 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c71bc9-4c7d-42ba-9822-4d29ef58187a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:23.843971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c71bc9-4c7d-42ba-9822-4d29ef58187a admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:23.844697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c71bc9-4c7d-42ba-9822-4d29ef58187a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:23.850170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c71bc9-4c7d-42ba-9822-4d29ef58187a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:24.022375 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:24.031575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 927/1883] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:23 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:24.036054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96032ca-1a57-4d1c-95fe-78826c3acf7b admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:24.050173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96032ca-1a57-4d1c-95fe-78826c3acf7b admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:24.131785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd287b28-05d4-4576-81b8-8de3049a5e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:24.132411 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd287b28-05d4-4576-81b8-8de3049a5e39 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:24.132706 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd287b28-05d4-4576-81b8-8de3049a5e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:24.132989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd287b28-05d4-4576-81b8-8de3049a5e39 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:24.133796 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd287b28-05d4-4576-81b8-8de3049a5e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:24.135964 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd287b28-05d4-4576-81b8-8de3049a5e39 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:24.266468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 957/1884] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:24 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:24.271291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c71bc9-4c7d-42ba-9822-4d29ef58187a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:24.282967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c71bc9-4c7d-42ba-9822-4d29ef58187a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:24.291719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7371dd5-0a67-4b2d-a368-b68db82d8a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:24.292419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7371dd5-0a67-4b2d-a368-b68db82d8a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:24.292713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7371dd5-0a67-4b2d-a368-b68db82d8a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:24.292995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7371dd5-0a67-4b2d-a368-b68db82d8a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:24.293814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7371dd5-0a67-4b2d-a368-b68db82d8a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:24.295421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7371dd5-0a67-4b2d-a368-b68db82d8a87 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:24.307782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 928/1885] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:24.312302 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd287b28-05d4-4576-81b8-8de3049a5e39 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:24.323410 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd287b28-05d4-4576-81b8-8de3049a5e39 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:24.328994 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806b37b-e563-4bf0-ba01-18ff6c9078dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:24.329707 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806b37b-e563-4bf0-ba01-18ff6c9078dd admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:24.329998 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806b37b-e563-4bf0-ba01-18ff6c9078dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:24.330300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806b37b-e563-4bf0-ba01-18ff6c9078dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:24.331020 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806b37b-e563-4bf0-ba01-18ff6c9078dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:24.332639 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806b37b-e563-4bf0-ba01-18ff6c9078dd admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:24.343315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 958/1886] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:24.347818 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7371dd5-0a67-4b2d-a368-b68db82d8a87 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:24.359376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7371dd5-0a67-4b2d-a368-b68db82d8a87 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:24.364670 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87d41e-6694-41ec-90c9-72c363b71fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:24.365884 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87d41e-6694-41ec-90c9-72c363b71fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:24.366173 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87d41e-6694-41ec-90c9-72c363b71fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:24.366555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87d41e-6694-41ec-90c9-72c363b71fb0 admin admin] PATH_INFO: `/v3/projects/54560291de484d809f111f1bfe6bc9c4/users/1aad8ce84ede418d84afdce86f44afa5/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:24.382980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806b37b-e563-4bf0-ba01-18ff6c9078dd admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:24.384797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-8806b37b-e563-4bf0-ba01-18ff6c9078dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:24.388583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87d41e-6694-41ec-90c9-72c363b71fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54560291de484d809f111f1bfe6bc9c4, user_id=1aad8ce84ede418d84afdce86f44afa5, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:24.392885 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87d41e-6694-41ec-90c9-72c363b71fb0 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:24.402500 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806b37b-e563-4bf0-ba01-18ff6c9078dd admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:24.407609 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a70de7-afc5-4921-b051-bd8fdc118f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:24.408662 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a70de7-afc5-4921-b051-bd8fdc118f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:24.409311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a70de7-afc5-4921-b051-bd8fdc118f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:24.409908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a70de7-afc5-4921-b051-bd8fdc118f02 admin admin] PATH_INFO: `/v3/projects/a6472e44e932409791cdeef0abb3a7b0` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:24.415810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a70de7-afc5-4921-b051-bd8fdc118f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6472e44e932409791cdeef0abb3a7b0)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:24.415810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a70de7-afc5-4921-b051-bd8fdc118f02 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:24.532075 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 929/1887] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:24 2022] PUT /identity/v3/projects/54560291de484d809f111f1bfe6bc9c4/users/1aad8ce84ede418d84afdce86f44afa5/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:24.542958 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae18454-839c-4bff-aa37-4811be68d126 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:24.543334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae18454-839c-4bff-aa37-4811be68d126 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:24.543619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae18454-839c-4bff-aa37-4811be68d126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:24.573383 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-0ae18454-839c-4bff-aa37-4811be68d126 None None] MFA Rules not processed for user `1aad8ce84ede418d84afdce86f44afa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:24.574627 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-0ae18454-839c-4bff-aa37-4811be68d126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:24.627884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-29a70de7-afc5-4921-b051-bd8fdc118f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6472e44e932409791cdeef0abb3a7b0', 'request_id': 'req-29a70de7-afc5-4921-b051-bd8fdc118f02'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:24.635185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-29a70de7-afc5-4921-b051-bd8fdc118f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6472e44e932409791cdeef0abb3a7b0', 'request_id': 'req-29a70de7-afc5-4921-b051-bd8fdc118f02'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:24.641271 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-29a70de7-afc5-4921-b051-bd8fdc118f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6472e44e932409791cdeef0abb3a7b0', 'request_id': 'req-29a70de7-afc5-4921-b051-bd8fdc118f02'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:24.651202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 930/1888] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:24.664385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae18454-839c-4bff-aa37-4811be68d126 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:24.666382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-0ae18454-839c-4bff-aa37-4811be68d126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:24.737583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae18454-839c-4bff-aa37-4811be68d126 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:24.792789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-29a70de7-afc5-4921-b051-bd8fdc118f02 admin admin] The token cache is being invalidate because project a6472e44e932409791cdeef0abb3a7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:24.793112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-29a70de7-afc5-4921-b051-bd8fdc118f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:24.794199 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-29a70de7-afc5-4921-b051-bd8fdc118f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:24.796605 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 959/1889] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:24 2022] DELETE /identity/v3/projects/a6472e44e932409791cdeef0abb3a7b0 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:24.801659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee55ef-2545-4917-be71-8e3d4b26e2ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8f268ca2cb34c06b188908495cdcd53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:24.802560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee55ef-2545-4917-be71-8e3d4b26e2ad service glance] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:24.802680 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b0b42-77e7-4a00-b09c-daa85cbaea8f None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:24.802994 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b0b42-77e7-4a00-b09c-daa85cbaea8f None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:24.803287 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee55ef-2545-4917-be71-8e3d4b26e2ad service glance] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:24.803403 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b0b42-77e7-4a00-b09c-daa85cbaea8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:24.803854 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee55ef-2545-4917-be71-8e3d4b26e2ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:24.806022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-50ee55ef-2545-4917-be71-8e3d4b26e2ad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:24.824466 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-0d7b0b42-77e7-4a00-b09c-daa85cbaea8f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:24.826111 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0d7b0b42-77e7-4a00-b09c-daa85cbaea8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:24.889671 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee55ef-2545-4917-be71-8e3d4b26e2ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:24.891278 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee55ef-2545-4917-be71-8e3d4b26e2ad service glance] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:24.902734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 931/1890] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:24.937870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 960/1891] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:24.946565 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc122547-6c7b-4204-b00e-8aabe832ff3e None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:24.947070 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc122547-6c7b-4204-b00e-8aabe832ff3e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:24.947403 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc122547-6c7b-4204-b00e-8aabe832ff3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:25.011980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-cc122547-6c7b-4204-b00e-8aabe832ff3e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:25.014184 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-cc122547-6c7b-4204-b00e-8aabe832ff3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:25.040440 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 932/1892] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:25.045267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b0b42-77e7-4a00-b09c-daa85cbaea8f None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:25.073679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b0b42-77e7-4a00-b09c-daa85cbaea8f None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:25.074686 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc122547-6c7b-4204-b00e-8aabe832ff3e None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:25.076585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-cc122547-6c7b-4204-b00e-8aabe832ff3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:25.081517 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4469667-cff0-46bf-842b-1c1cd60776fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:25.091568 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4469667-cff0-46bf-842b-1c1cd60776fd admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:25.101427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4469667-cff0-46bf-842b-1c1cd60776fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:25.101427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4469667-cff0-46bf-842b-1c1cd60776fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:25.101427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4469667-cff0-46bf-842b-1c1cd60776fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:04:25.101427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4469667-cff0-46bf-842b-1c1cd60776fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:25.101427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4469667-cff0-46bf-842b-1c1cd60776fd admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:25.126344 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 961/1893] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:04:25.127577 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4469667-cff0-46bf-842b-1c1cd60776fd admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:25.149006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4469667-cff0-46bf-842b-1c1cd60776fd admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:25.156011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8a178-2a52-42bd-9a34-b87984d827b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:25.156457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8a178-2a52-42bd-9a34-b87984d827b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:25.156752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8a178-2a52-42bd-9a34-b87984d827b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:25.157032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8a178-2a52-42bd-9a34-b87984d827b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:25.158121 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8a178-2a52-42bd-9a34-b87984d827b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:25.160084 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8a178-2a52-42bd-9a34-b87984d827b1 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:25.198846 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc122547-6c7b-4204-b00e-8aabe832ff3e None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:25.204774 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90580015-7a8e-414a-a2c8-9f096cd2caa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:25.206055 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90580015-7a8e-414a-a2c8-9f096cd2caa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:25.206055 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90580015-7a8e-414a-a2c8-9f096cd2caa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:25.206229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90580015-7a8e-414a-a2c8-9f096cd2caa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:25.208180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-90580015-7a8e-414a-a2c8-9f096cd2caa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:25.281204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 962/1894] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:25 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:25.284369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8a178-2a52-42bd-9a34-b87984d827b1 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:25.312647 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90580015-7a8e-414a-a2c8-9f096cd2caa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:25.315254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90580015-7a8e-414a-a2c8-9f096cd2caa1 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:25.339528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 933/1895] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:04:25.390419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8a178-2a52-42bd-9a34-b87984d827b1 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:25.392289 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:25.398145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1ff40-f1b2-442c-8317-b2de292f644e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:25.398847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ff40-f1b2-442c-8317-b2de292f644e admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:25.399381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ff40-f1b2-442c-8317-b2de292f644e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:25.399626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ff40-f1b2-442c-8317-b2de292f644e admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:25.405936 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1ff40-f1b2-442c-8317-b2de292f644e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:25.405936 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1ff40-f1b2-442c-8317-b2de292f644e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:25.461444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:25.519478 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 963/1896] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:25 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:25.523923 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90580015-7a8e-414a-a2c8-9f096cd2caa1 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:25.553645 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90580015-7a8e-414a-a2c8-9f096cd2caa1 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:25.562514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5021d-ebc0-4e8c-8191-4527186573b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:25.564051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5021d-ebc0-4e8c-8191-4527186573b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:25.564545 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5021d-ebc0-4e8c-8191-4527186573b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:25.565158 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5021d-ebc0-4e8c-8191-4527186573b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:25.567070 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5021d-ebc0-4e8c-8191-4527186573b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:25.569086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5021d-ebc0-4e8c-8191-4527186573b5 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:25.598816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 934/1897] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:25.602734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1ff40-f1b2-442c-8317-b2de292f644e admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:25.614239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1ff40-f1b2-442c-8317-b2de292f644e admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:25.619785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2830ee-cef2-4c06-a41e-a6f1d9e22783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:25.620483 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2830ee-cef2-4c06-a41e-a6f1d9e22783 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:25.620778 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2830ee-cef2-4c06-a41e-a6f1d9e22783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:25.621053 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2830ee-cef2-4c06-a41e-a6f1d9e22783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:25.621844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2830ee-cef2-4c06-a41e-a6f1d9e22783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:25.623470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2830ee-cef2-4c06-a41e-a6f1d9e22783 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:25.638957 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 964/1898] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:25.640265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5021d-ebc0-4e8c-8191-4527186573b5 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:25.651854 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5021d-ebc0-4e8c-8191-4527186573b5 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:25.659049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891093dd-a62a-4124-8ac4-20151262afbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:25.660168 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891093dd-a62a-4124-8ac4-20151262afbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:25.660580 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891093dd-a62a-4124-8ac4-20151262afbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:25.661221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891093dd-a62a-4124-8ac4-20151262afbe admin admin] PATH_INFO: `/v3/projects/5ccb89c3ca064fe49e5d968618ebdaad/users/ed5722b0d08d47f981cb2e470afce986/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:25.691216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891093dd-a62a-4124-8ac4-20151262afbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccb89c3ca064fe49e5d968618ebdaad, user_id=ed5722b0d08d47f981cb2e470afce986, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:25.695807 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891093dd-a62a-4124-8ac4-20151262afbe admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:25.898046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 935/1899] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:25 2022] PUT /identity/v3/projects/5ccb89c3ca064fe49e5d968618ebdaad/users/ed5722b0d08d47f981cb2e470afce986/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:25.911511 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dec48a-98fe-485b-9f30-024c6ed0af36 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:25.912021 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dec48a-98fe-485b-9f30-024c6ed0af36 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:25.912339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dec48a-98fe-485b-9f30-024c6ed0af36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:25.947035 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-f3dec48a-98fe-485b-9f30-024c6ed0af36 None None] MFA Rules not processed for user `ed5722b0d08d47f981cb2e470afce986`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:25.948518 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-f3dec48a-98fe-485b-9f30-024c6ed0af36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:26.044021 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 965/1900] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:26.053401 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891093dd-a62a-4124-8ac4-20151262afbe admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:26.182803 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891093dd-a62a-4124-8ac4-20151262afbe admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:26.183370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e4b71-9c06-4430-9cc0-cc7e3ae014c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:26.184062 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e4b71-9c06-4430-9cc0-cc7e3ae014c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:26.184485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e4b71-9c06-4430-9cc0-cc7e3ae014c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:26.184781 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e4b71-9c06-4430-9cc0-cc7e3ae014c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:26.185521 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e4b71-9c06-4430-9cc0-cc7e3ae014c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:26.187623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e4b71-9c06-4430-9cc0-cc7e3ae014c8 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:26.321346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 936/1901] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:26 2022] POST /identity/v3/projects => generated 387 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:26.326514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dec48a-98fe-485b-9f30-024c6ed0af36 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:26.340427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dec48a-98fe-485b-9f30-024c6ed0af36 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:26.420524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7f478-30b9-43fd-b072-01980a6113fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:26.421658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f478-30b9-43fd-b072-01980a6113fa admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:26.422114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f478-30b9-43fd-b072-01980a6113fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:26.422716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f478-30b9-43fd-b072-01980a6113fa admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:26.424025 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7f478-30b9-43fd-b072-01980a6113fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:26.431835 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7f478-30b9-43fd-b072-01980a6113fa admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:26.663773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 966/1902] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:26 2022] POST /identity/v3/users => generated 300 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:26.665541 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e4b71-9c06-4430-9cc0-cc7e3ae014c8 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:26.692570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e4b71-9c06-4430-9cc0-cc7e3ae014c8 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:26.697706 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59efb9-7859-449b-a373-3366e82c2528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:26.698481 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59efb9-7859-449b-a373-3366e82c2528 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:26.699113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59efb9-7859-449b-a373-3366e82c2528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:26.699113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59efb9-7859-449b-a373-3366e82c2528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:26.699921 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59efb9-7859-449b-a373-3366e82c2528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:26.701744 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59efb9-7859-449b-a373-3366e82c2528 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:26.738405 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 937/1903] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:04:26.742504 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7f478-30b9-43fd-b072-01980a6113fa admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:26.756614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7f478-30b9-43fd-b072-01980a6113fa admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:26.764117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c61b5-5dab-48a5-b7af-91dcad1c11a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:26.766007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c61b5-5dab-48a5-b7af-91dcad1c11a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:26.766599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c61b5-5dab-48a5-b7af-91dcad1c11a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:26.767147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c61b5-5dab-48a5-b7af-91dcad1c11a9 admin admin] PATH_INFO: `/v3/projects/42fbe2223e494bd5b849a33186cbdff9/users/e9783d2af15649f9bb61ae8709536d15/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:26.800970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c61b5-5dab-48a5-b7af-91dcad1c11a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42fbe2223e494bd5b849a33186cbdff9, user_id=e9783d2af15649f9bb61ae8709536d15, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:26.803772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c61b5-5dab-48a5-b7af-91dcad1c11a9 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:26.981416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 967/1904] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:26 2022] PUT /identity/v3/projects/42fbe2223e494bd5b849a33186cbdff9/users/e9783d2af15649f9bb61ae8709536d15/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:26.982765 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59efb9-7859-449b-a373-3366e82c2528 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:27.009096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59efb9-7859-449b-a373-3366e82c2528 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:27.126632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1c6fc-808f-4c6b-adbf-8488840f433f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:27.126632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1c6fc-808f-4c6b-adbf-8488840f433f admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:27.129695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1c6fc-808f-4c6b-adbf-8488840f433f admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:27.129846 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1c6fc-808f-4c6b-adbf-8488840f433f admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:27.131170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1c6fc-808f-4c6b-adbf-8488840f433f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:27.137050 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1c6fc-808f-4c6b-adbf-8488840f433f admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:27.149519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 938/1905] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:27.153812 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c61b5-5dab-48a5-b7af-91dcad1c11a9 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:27.173312 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c61b5-5dab-48a5-b7af-91dcad1c11a9 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:27.179285 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacada13-e3b1-449c-9fa4-60ccf2115b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:27.180363 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacada13-e3b1-449c-9fa4-60ccf2115b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:27.180800 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacada13-e3b1-449c-9fa4-60ccf2115b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:27.181252 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacada13-e3b1-449c-9fa4-60ccf2115b35 admin admin] PATH_INFO: `/v3/projects/42fbe2223e494bd5b849a33186cbdff9/users/e9783d2af15649f9bb61ae8709536d15/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:27.183927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacada13-e3b1-449c-9fa4-60ccf2115b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42fbe2223e494bd5b849a33186cbdff9, user_id=e9783d2af15649f9bb61ae8709536d15, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:27.187651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacada13-e3b1-449c-9fa4-60ccf2115b35 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:27.199222 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 968/1906] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:27 2022] PUT /identity/v3/projects/42fbe2223e494bd5b849a33186cbdff9/users/e9783d2af15649f9bb61ae8709536d15/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:27.212581 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e47ea8-6795-4291-9106-63312d1485cc None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:27.213099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e47ea8-6795-4291-9106-63312d1485cc None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:27.214840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e47ea8-6795-4291-9106-63312d1485cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:27.264313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-07e47ea8-6795-4291-9106-63312d1485cc None None] MFA Rules not processed for user `e9783d2af15649f9bb61ae8709536d15`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:27.266391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-07e47ea8-6795-4291-9106-63312d1485cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:27.382865 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 939/1907] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:27.394326 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacada13-e3b1-449c-9fa4-60ccf2115b35 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:27.465016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacada13-e3b1-449c-9fa4-60ccf2115b35 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:27.470909 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2ada3-3b8b-4e5a-b470-b931830e716a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:27.471898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2ada3-3b8b-4e5a-b470-b931830e716a service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:27.472219 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2ada3-3b8b-4e5a-b470-b931830e716a service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:27.472708 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2ada3-3b8b-4e5a-b470-b931830e716a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:27.485982 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2ada3-3b8b-4e5a-b470-b931830e716a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:27.488005 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2ada3-3b8b-4e5a-b470-b931830e716a service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:27.499332 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 969/1908] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:27.534273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e47ea8-6795-4291-9106-63312d1485cc None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:27.661081 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e47ea8-6795-4291-9106-63312d1485cc None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:27.666070 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b36d20-1494-4e20-b30a-01453a78a042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:27.667040 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b36d20-1494-4e20-b30a-01453a78a042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:27.667270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b36d20-1494-4e20-b30a-01453a78a042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:27.667541 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b36d20-1494-4e20-b30a-01453a78a042 admin admin] PATH_INFO: `/v3/users/ed5722b0d08d47f981cb2e470afce986` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:27.668879 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b36d20-1494-4e20-b30a-01453a78a042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5722b0d08d47f981cb2e470afce986)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:27.671039 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b36d20-1494-4e20-b30a-01453a78a042 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:28.019192 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c0b36d20-1494-4e20-b30a-01453a78a042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5722b0d08d47f981cb2e470afce986'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:28.020127 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c0b36d20-1494-4e20-b30a-01453a78a042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5722b0d08d47f981cb2e470afce986'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:28.038049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c0b36d20-1494-4e20-b30a-01453a78a042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5722b0d08d47f981cb2e470afce986'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:28.039733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c0b36d20-1494-4e20-b30a-01453a78a042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5722b0d08d47f981cb2e470afce986'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:28.229967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c0b36d20-1494-4e20-b30a-01453a78a042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5722b0d08d47f981cb2e470afce986'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:28.275959 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 940/1909] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:27 2022] DELETE /identity/v3/users/ed5722b0d08d47f981cb2e470afce986 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:28.285575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb961b0f-386a-4e24-9daa-a6dbebf53162 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:28.285575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb961b0f-386a-4e24-9daa-a6dbebf53162 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:28.285848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb961b0f-386a-4e24-9daa-a6dbebf53162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:28.328593 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-fb961b0f-386a-4e24-9daa-a6dbebf53162 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:28.331205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fb961b0f-386a-4e24-9daa-a6dbebf53162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:28.387352 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:28.471564 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 970/1910] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:28.488052 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b36d20-1494-4e20-b30a-01453a78a042 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:28.490695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c0b36d20-1494-4e20-b30a-01453a78a042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:28.599312 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b36d20-1494-4e20-b30a-01453a78a042 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:28.614147 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67103f46-a5ca-428c-a5d8-fac042b141c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:28.615110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67103f46-a5ca-428c-a5d8-fac042b141c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:28.615419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67103f46-a5ca-428c-a5d8-fac042b141c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:28.615711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67103f46-a5ca-428c-a5d8-fac042b141c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:28.647672 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67103f46-a5ca-428c-a5d8-fac042b141c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:28.649340 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67103f46-a5ca-428c-a5d8-fac042b141c5 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:28.673830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 941/1911] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:29.625684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb961b0f-386a-4e24-9daa-a6dbebf53162 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:29.631559 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fb961b0f-386a-4e24-9daa-a6dbebf53162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:29.663870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb961b0f-386a-4e24-9daa-a6dbebf53162 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:29.672744 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:29.674177 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:29.679969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:29.679969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5 admin admin] PATH_INFO: `/v3/projects/5ccb89c3ca064fe49e5d968618ebdaad` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:29.679969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ccb89c3ca064fe49e5d968618ebdaad)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:29.679969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:29.764816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:29.895838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ccb89c3ca064fe49e5d968618ebdaad', 'request_id': 'req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:29.907009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ccb89c3ca064fe49e5d968618ebdaad', 'request_id': 'req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:29.917676 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ccb89c3ca064fe49e5d968618ebdaad', 'request_id': 'req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:30.053044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5 admin admin] The token cache is being invalidate because project 5ccb89c3ca064fe49e5d968618ebdaad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:30.055388 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:30.055388 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:30.058395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 971/1912] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:29 2022] DELETE /identity/v3/projects/5ccb89c3ca064fe49e5d968618ebdaad => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:30.064156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67103f46-a5ca-428c-a5d8-fac042b141c5 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:30.078376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67103f46-a5ca-428c-a5d8-fac042b141c5 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:30.238874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af937a99-f22c-48df-8626-dfb41f765907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:30.240769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af937a99-f22c-48df-8626-dfb41f765907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:30.241089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af937a99-f22c-48df-8626-dfb41f765907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:30.241467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af937a99-f22c-48df-8626-dfb41f765907 admin admin] PATH_INFO: `/v3/users/e9783d2af15649f9bb61ae8709536d15` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:30.243419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af937a99-f22c-48df-8626-dfb41f765907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9783d2af15649f9bb61ae8709536d15)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:30.245547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af937a99-f22c-48df-8626-dfb41f765907 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:30.587014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-af937a99-f22c-48df-8626-dfb41f765907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9783d2af15649f9bb61ae8709536d15'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:30.588457 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-af937a99-f22c-48df-8626-dfb41f765907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9783d2af15649f9bb61ae8709536d15'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:30.604252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-af937a99-f22c-48df-8626-dfb41f765907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9783d2af15649f9bb61ae8709536d15'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:30.605967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-af937a99-f22c-48df-8626-dfb41f765907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9783d2af15649f9bb61ae8709536d15'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:30.734883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-af937a99-f22c-48df-8626-dfb41f765907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9783d2af15649f9bb61ae8709536d15'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:30.756440 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 942/1913] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:30 2022] DELETE /identity/v3/users/e9783d2af15649f9bb61ae8709536d15 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:30.951426 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:31.191733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:31.447663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:31.450043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:31.482879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af58f5-0aa2-4eae-81bd-84ce4f3f23c5 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:31.578595 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06110c05-14d8-4a44-a028-5e7600d995e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:31.579577 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06110c05-14d8-4a44-a028-5e7600d995e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:31.579856 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06110c05-14d8-4a44-a028-5e7600d995e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:31.580299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06110c05-14d8-4a44-a028-5e7600d995e4 admin admin] PATH_INFO: `/v3/projects/42fbe2223e494bd5b849a33186cbdff9` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:31.582028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06110c05-14d8-4a44-a028-5e7600d995e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42fbe2223e494bd5b849a33186cbdff9)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:31.584771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06110c05-14d8-4a44-a028-5e7600d995e4 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:31.771104 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-06110c05-14d8-4a44-a028-5e7600d995e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42fbe2223e494bd5b849a33186cbdff9', 'request_id': 'req-06110c05-14d8-4a44-a028-5e7600d995e4'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:31.778399 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-06110c05-14d8-4a44-a028-5e7600d995e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42fbe2223e494bd5b849a33186cbdff9', 'request_id': 'req-06110c05-14d8-4a44-a028-5e7600d995e4'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:31.785652 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-06110c05-14d8-4a44-a028-5e7600d995e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42fbe2223e494bd5b849a33186cbdff9', 'request_id': 'req-06110c05-14d8-4a44-a028-5e7600d995e4'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:31.934794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-06110c05-14d8-4a44-a028-5e7600d995e4 admin admin] The token cache is being invalidate because project 42fbe2223e494bd5b849a33186cbdff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:31.934794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-06110c05-14d8-4a44-a028-5e7600d995e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:31.934794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-06110c05-14d8-4a44-a028-5e7600d995e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:31.934794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 972/1914] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:31 2022] DELETE /identity/v3/projects/42fbe2223e494bd5b849a33186cbdff9 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:31.939067 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ccea1-66b3-4f91-aff8-dc8882c0f2b4 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:31.939551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ccea1-66b3-4f91-aff8-dc8882c0f2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:31.940066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ccea1-66b3-4f91-aff8-dc8882c0f2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:31.961950 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-ff2ccea1-66b3-4f91-aff8-dc8882c0f2b4 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:31.963216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ff2ccea1-66b3-4f91-aff8-dc8882c0f2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:32.048287 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 943/1915] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:32.061301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f20f-afe9-4707-a3b9-7464b4e52ffe None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:32.072700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f20f-afe9-4707-a3b9-7464b4e52ffe None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:32.072700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f20f-afe9-4707-a3b9-7464b4e52ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:32.095528 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-bcf1f20f-afe9-4707-a3b9-7464b4e52ffe None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:32.096807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-bcf1f20f-afe9-4707-a3b9-7464b4e52ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:32.106869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 973/1916] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:32.111830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ccea1-66b3-4f91-aff8-dc8882c0f2b4 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:32.122451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ccea1-66b3-4f91-aff8-dc8882c0f2b4 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:32.127402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db978936-94d7-410e-a055-b1f9273e6a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:32.128443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978936-94d7-410e-a055-b1f9273e6a20 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:32.128927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978936-94d7-410e-a055-b1f9273e6a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:32.129445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978936-94d7-410e-a055-b1f9273e6a20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:32.130407 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db978936-94d7-410e-a055-b1f9273e6a20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:04:32.131016 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db978936-94d7-410e-a055-b1f9273e6a20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:32.133341 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db978936-94d7-410e-a055-b1f9273e6a20 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:32.148954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 944/1917] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:04:32.154093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1f20f-afe9-4707-a3b9-7464b4e52ffe None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:32.165458 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1f20f-afe9-4707-a3b9-7464b4e52ffe None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:32.172595 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a471519-5bff-43f5-9546-31bda380b4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:32.173780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a471519-5bff-43f5-9546-31bda380b4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:32.174322 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a471519-5bff-43f5-9546-31bda380b4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:32.174809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a471519-5bff-43f5-9546-31bda380b4d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:32.175780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a471519-5bff-43f5-9546-31bda380b4d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:32.178264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a471519-5bff-43f5-9546-31bda380b4d9 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:32.322718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db978936-94d7-410e-a055-b1f9273e6a20 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:32.326432 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-db978936-94d7-410e-a055-b1f9273e6a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:32.330065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 974/1918] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:32 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:32.334696 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a471519-5bff-43f5-9546-31bda380b4d9 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:32.347161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db978936-94d7-410e-a055-b1f9273e6a20 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:32.435867 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdf65e-717d-4c31-ab4b-ef2b3511120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:32.436954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdf65e-717d-4c31-ab4b-ef2b3511120c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:32.437362 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdf65e-717d-4c31-ab4b-ef2b3511120c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:32.437723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdf65e-717d-4c31-ab4b-ef2b3511120c admin admin] PATH_INFO: `/v3/users/7531cd92a155460fa615581cb26ac550` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:32.439996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdf65e-717d-4c31-ab4b-ef2b3511120c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7531cd92a155460fa615581cb26ac550)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:32.442080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdf65e-717d-4c31-ab4b-ef2b3511120c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:32.443429 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a471519-5bff-43f5-9546-31bda380b4d9 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:32.449512 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1dd7e-4769-4af8-9def-d7d55e5ca72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:32.450796 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1dd7e-4769-4af8-9def-d7d55e5ca72f admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:32.451258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1dd7e-4769-4af8-9def-d7d55e5ca72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:32.457535 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1dd7e-4769-4af8-9def-d7d55e5ca72f admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:32.457535 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1dd7e-4769-4af8-9def-d7d55e5ca72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:32.457535 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1dd7e-4769-4af8-9def-d7d55e5ca72f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:32.603801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 975/1919] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:32 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:04:32.615061 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1dd7e-4769-4af8-9def-d7d55e5ca72f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:32.628334 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1dd7e-4769-4af8-9def-d7d55e5ca72f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:32.633309 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef677138-7378-473e-9f87-d96626516945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:32.634023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef677138-7378-473e-9f87-d96626516945 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:32.634314 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef677138-7378-473e-9f87-d96626516945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:32.634589 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef677138-7378-473e-9f87-d96626516945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:32.635330 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef677138-7378-473e-9f87-d96626516945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:32.637116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef677138-7378-473e-9f87-d96626516945 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:32.649794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 976/1920] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:32.653972 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef677138-7378-473e-9f87-d96626516945 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:32.665818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef677138-7378-473e-9f87-d96626516945 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:32.670975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c7a96-9b2b-4507-ab0e-83a085a39dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:32.671524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c7a96-9b2b-4507-ab0e-83a085a39dda admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:32.671814 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c7a96-9b2b-4507-ab0e-83a085a39dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:32.672098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c7a96-9b2b-4507-ab0e-83a085a39dda admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:32.673159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c7a96-9b2b-4507-ab0e-83a085a39dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:32.674824 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c7a96-9b2b-4507-ab0e-83a085a39dda admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:32.688394 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 977/1921] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:04:32.694477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c7a96-9b2b-4507-ab0e-83a085a39dda admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:32.706471 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c7a96-9b2b-4507-ab0e-83a085a39dda admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:32.712678 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c0303-fa63-4f6c-affa-ce9532c47858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:32.713686 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c0303-fa63-4f6c-affa-ce9532c47858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:32.713971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c0303-fa63-4f6c-affa-ce9532c47858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:32.714257 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c0303-fa63-4f6c-affa-ce9532c47858 admin admin] PATH_INFO: `/v3/projects/0912eeb9c391421393859e31bed567cf/users/b2d7a29de7b741cda6f7a4e4341535f0/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:32.731552 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c0303-fa63-4f6c-affa-ce9532c47858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0912eeb9c391421393859e31bed567cf, user_id=b2d7a29de7b741cda6f7a4e4341535f0, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:32.734535 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c0303-fa63-4f6c-affa-ce9532c47858 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:32.795772 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-38bdf65e-717d-4c31-ab4b-ef2b3511120c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7531cd92a155460fa615581cb26ac550'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:32.796716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-38bdf65e-717d-4c31-ab4b-ef2b3511120c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7531cd92a155460fa615581cb26ac550'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:32.804872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-38bdf65e-717d-4c31-ab4b-ef2b3511120c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7531cd92a155460fa615581cb26ac550'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:32.805788 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-38bdf65e-717d-4c31-ab4b-ef2b3511120c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7531cd92a155460fa615581cb26ac550'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:32.853806 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 978/1922] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:32 2022] PUT /identity/v3/projects/0912eeb9c391421393859e31bed567cf/users/b2d7a29de7b741cda6f7a4e4341535f0/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:32.873705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2039d46-0fc1-43a3-986e-f6c10e1f5fa7 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:32.874104 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2039d46-0fc1-43a3-986e-f6c10e1f5fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:32.874581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2039d46-0fc1-43a3-986e-f6c10e1f5fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:32.903937 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-c2039d46-0fc1-43a3-986e-f6c10e1f5fa7 None None] MFA Rules not processed for user `b2d7a29de7b741cda6f7a4e4341535f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:32.905623 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c2039d46-0fc1-43a3-986e-f6c10e1f5fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:32.933050 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-38bdf65e-717d-4c31-ab4b-ef2b3511120c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7531cd92a155460fa615581cb26ac550'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:32.957392 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 945/1923] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:32 2022] DELETE /identity/v3/users/7531cd92a155460fa615581cb26ac550 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:32.961409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c869-7382-4e3b-a7ab-7f4e0621206e None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:32.961779 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c869-7382-4e3b-a7ab-7f4e0621206e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:32.962132 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c869-7382-4e3b-a7ab-7f4e0621206e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:32.979732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-01a7c869-7382-4e3b-a7ab-7f4e0621206e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:32.981026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-01a7c869-7382-4e3b-a7ab-7f4e0621206e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:33.001644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 979/1924] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:33.006693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2039d46-0fc1-43a3-986e-f6c10e1f5fa7 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:33.008330 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c2039d46-0fc1-43a3-986e-f6c10e1f5fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:33.052969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 946/1925] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:33.064632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c869-7382-4e3b-a7ab-7f4e0621206e None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:33.066502 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-01a7c869-7382-4e3b-a7ab-7f4e0621206e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:33.100594 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2039d46-0fc1-43a3-986e-f6c10e1f5fa7 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:33.115203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737284b-c1d0-456e-9fd9-6d54f21379f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:33.115899 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737284b-c1d0-456e-9fd9-6d54f21379f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:33.116192 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737284b-c1d0-456e-9fd9-6d54f21379f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:33.116476 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737284b-c1d0-456e-9fd9-6d54f21379f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:33.117236 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737284b-c1d0-456e-9fd9-6d54f21379f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:33.122224 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737284b-c1d0-456e-9fd9-6d54f21379f2 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:33.137917 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c869-7382-4e3b-a7ab-7f4e0621206e None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:33.141815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab20dea-e746-4747-a4a1-30d802bc3355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:33.142495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab20dea-e746-4747-a4a1-30d802bc3355 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:33.142782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab20dea-e746-4747-a4a1-30d802bc3355 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:33.143137 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab20dea-e746-4747-a4a1-30d802bc3355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:33.153969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab20dea-e746-4747-a4a1-30d802bc3355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:33.155984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab20dea-e746-4747-a4a1-30d802bc3355 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:33.166817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 947/1926] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:04:33.266293 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 980/1927] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:33 2022] POST /identity/v3/projects => generated 379 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:33.270805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab20dea-e746-4747-a4a1-30d802bc3355 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:33.281670 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab20dea-e746-4747-a4a1-30d802bc3355 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:33.340388 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465c3ca-4b05-4ef8-8c26-4b50724d3e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:33.341066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465c3ca-4b05-4ef8-8c26-4b50724d3e1f admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:33.341589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465c3ca-4b05-4ef8-8c26-4b50724d3e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:33.341867 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465c3ca-4b05-4ef8-8c26-4b50724d3e1f admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:33.342932 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465c3ca-4b05-4ef8-8c26-4b50724d3e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:33.345659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465c3ca-4b05-4ef8-8c26-4b50724d3e1f admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:33.442663 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 948/1928] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:33 2022] POST /identity/v3/users => generated 296 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:33.443977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737284b-c1d0-456e-9fd9-6d54f21379f2 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:33.458136 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737284b-c1d0-456e-9fd9-6d54f21379f2 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:33.466381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20744a8-226b-4a9e-a531-ef7ff9bc6080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:33.467320 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20744a8-226b-4a9e-a531-ef7ff9bc6080 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:33.467857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20744a8-226b-4a9e-a531-ef7ff9bc6080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:33.468204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20744a8-226b-4a9e-a531-ef7ff9bc6080 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:33.469027 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20744a8-226b-4a9e-a531-ef7ff9bc6080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:33.472584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20744a8-226b-4a9e-a531-ef7ff9bc6080 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:33.616748 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:33.620156 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 981/1929] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:33.624052 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465c3ca-4b05-4ef8-8c26-4b50724d3e1f admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:33.638175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465c3ca-4b05-4ef8-8c26-4b50724d3e1f admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:33.644334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86531c9-f521-47e7-8141-65be78cca795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:33.645427 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86531c9-f521-47e7-8141-65be78cca795 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:33.645776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86531c9-f521-47e7-8141-65be78cca795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:33.646090 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86531c9-f521-47e7-8141-65be78cca795 admin admin] PATH_INFO: `/v3/projects/51740b2ac4f64481b1e2db70b86c7f95/users/e0e7c32f68b94de8884ec01a90e64935/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:33.664005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86531c9-f521-47e7-8141-65be78cca795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51740b2ac4f64481b1e2db70b86c7f95, user_id=e0e7c32f68b94de8884ec01a90e64935, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:33.666882 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86531c9-f521-47e7-8141-65be78cca795 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:33.702811 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20744a8-226b-4a9e-a531-ef7ff9bc6080 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:33.708446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a20744a8-226b-4a9e-a531-ef7ff9bc6080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:33.723065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20744a8-226b-4a9e-a531-ef7ff9bc6080 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:33.728877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35192838-04b6-4b10-895a-dde0464b7a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:33.729863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35192838-04b6-4b10-895a-dde0464b7a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:33.730204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35192838-04b6-4b10-895a-dde0464b7a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:33.730672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35192838-04b6-4b10-895a-dde0464b7a38 admin admin] PATH_INFO: `/v3/projects/d9aeb955c56a4aecb32d5008527703fc` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:33.732510 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35192838-04b6-4b10-895a-dde0464b7a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9aeb955c56a4aecb32d5008527703fc)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:33.734587 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35192838-04b6-4b10-895a-dde0464b7a38 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:33.742356 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 949/1930] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:33 2022] PUT /identity/v3/projects/51740b2ac4f64481b1e2db70b86c7f95/users/e0e7c32f68b94de8884ec01a90e64935/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:33.748227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86531c9-f521-47e7-8141-65be78cca795 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:33.823442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86531c9-f521-47e7-8141-65be78cca795 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:33.829496 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8957b3-d65b-40e8-b2d2-e2fba41d6a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:33.830189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8957b3-d65b-40e8-b2d2-e2fba41d6a90 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:33.830472 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8957b3-d65b-40e8-b2d2-e2fba41d6a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:33.830747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8957b3-d65b-40e8-b2d2-e2fba41d6a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:33.831480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8957b3-d65b-40e8-b2d2-e2fba41d6a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:33.833080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8957b3-d65b-40e8-b2d2-e2fba41d6a90 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:33.845435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 950/1931] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:33.849982 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8957b3-d65b-40e8-b2d2-e2fba41d6a90 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:33.861029 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8957b3-d65b-40e8-b2d2-e2fba41d6a90 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:33.865076 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-35192838-04b6-4b10-895a-dde0464b7a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9aeb955c56a4aecb32d5008527703fc', 'request_id': 'req-35192838-04b6-4b10-895a-dde0464b7a38'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:33.878712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-35192838-04b6-4b10-895a-dde0464b7a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9aeb955c56a4aecb32d5008527703fc', 'request_id': 'req-35192838-04b6-4b10-895a-dde0464b7a38'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:33.896055 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-35192838-04b6-4b10-895a-dde0464b7a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9aeb955c56a4aecb32d5008527703fc', 'request_id': 'req-35192838-04b6-4b10-895a-dde0464b7a38'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:33.939759 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56347477-8839-4616-9f93-a7631a7e2eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:33.940779 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56347477-8839-4616-9f93-a7631a7e2eba admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:33.941168 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56347477-8839-4616-9f93-a7631a7e2eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:33.941612 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56347477-8839-4616-9f93-a7631a7e2eba admin admin] PATH_INFO: `/v3/projects/51740b2ac4f64481b1e2db70b86c7f95/users/e0e7c32f68b94de8884ec01a90e64935/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:33.943752 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56347477-8839-4616-9f93-a7631a7e2eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=51740b2ac4f64481b1e2db70b86c7f95, user_id=e0e7c32f68b94de8884ec01a90e64935, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:33.946547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56347477-8839-4616-9f93-a7631a7e2eba admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:33.957796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 951/1932] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:33 2022] PUT /identity/v3/projects/51740b2ac4f64481b1e2db70b86c7f95/users/e0e7c32f68b94de8884ec01a90e64935/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:33.968771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7ca92-64f8-47b7-a50f-f8aa745a0928 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:33.969805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7ca92-64f8-47b7-a50f-f8aa745a0928 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:33.970241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7ca92-64f8-47b7-a50f-f8aa745a0928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:34.010081 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-d3d7ca92-64f8-47b7-a50f-f8aa745a0928 None None] MFA Rules not processed for user `e0e7c32f68b94de8884ec01a90e64935`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:34.011594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d3d7ca92-64f8-47b7-a50f-f8aa745a0928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:34.019983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:34.024006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-35192838-04b6-4b10-895a-dde0464b7a38 admin admin] The token cache is being invalidate because project d9aeb955c56a4aecb32d5008527703fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:34.024312 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-35192838-04b6-4b10-895a-dde0464b7a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:34.024981 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-35192838-04b6-4b10-895a-dde0464b7a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:34.026809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 982/1933] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:33 2022] DELETE /identity/v3/projects/d9aeb955c56a4aecb32d5008527703fc => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:34.031839 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35192838-04b6-4b10-895a-dde0464b7a38 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:34.033623 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-35192838-04b6-4b10-895a-dde0464b7a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:34.047587 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35192838-04b6-4b10-895a-dde0464b7a38 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:34.139014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 952/1934] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:34.144911 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268722d9-8939-44db-8dfe-85909a632c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:34.145832 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268722d9-8939-44db-8dfe-85909a632c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:34.146119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268722d9-8939-44db-8dfe-85909a632c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:34.146467 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268722d9-8939-44db-8dfe-85909a632c30 admin admin] PATH_INFO: `/v3/users/f6d6179054d14144b1bdbbb6b8cf2ed2` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:34.150897 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268722d9-8939-44db-8dfe-85909a632c30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d6179054d14144b1bdbbb6b8cf2ed2)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:34.153007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268722d9-8939-44db-8dfe-85909a632c30 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:34.158541 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7ca92-64f8-47b7-a50f-f8aa745a0928 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:34.160028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d3d7ca92-64f8-47b7-a50f-f8aa745a0928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:34.242555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7ca92-64f8-47b7-a50f-f8aa745a0928 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:34.246403 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13ccc9-0055-4412-bd55-794d741fef32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:34.247070 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13ccc9-0055-4412-bd55-794d741fef32 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:34.247359 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13ccc9-0055-4412-bd55-794d741fef32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:34.247646 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13ccc9-0055-4412-bd55-794d741fef32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:34.251779 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4c13ccc9-0055-4412-bd55-794d741fef32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:34.318397 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13ccc9-0055-4412-bd55-794d741fef32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:34.321466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13ccc9-0055-4412-bd55-794d741fef32 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:34.344061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 953/1935] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:34.464192 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-268722d9-8939-44db-8dfe-85909a632c30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d6179054d14144b1bdbbb6b8cf2ed2'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:34.474680 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-268722d9-8939-44db-8dfe-85909a632c30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d6179054d14144b1bdbbb6b8cf2ed2'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:34.475451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-268722d9-8939-44db-8dfe-85909a632c30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d6179054d14144b1bdbbb6b8cf2ed2'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:34.488408 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-268722d9-8939-44db-8dfe-85909a632c30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d6179054d14144b1bdbbb6b8cf2ed2'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:34.489152 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-268722d9-8939-44db-8dfe-85909a632c30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d6179054d14144b1bdbbb6b8cf2ed2'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:34.579735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 983/1936] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:34 2022] DELETE /identity/v3/users/f6d6179054d14144b1bdbbb6b8cf2ed2 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:35.180543 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:35.347809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13ccc9-0055-4412-bd55-794d741fef32 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:35.364266 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13ccc9-0055-4412-bd55-794d741fef32 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:35.435972 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:35.437460 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:35.437740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:35.438045 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38 admin admin] PATH_INFO: `/v3/projects/8337e0fa1a0e49c4a5da47a87b836378` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:35.439315 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8337e0fa1a0e49c4a5da47a87b836378)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:35.441267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:35.670486 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8337e0fa1a0e49c4a5da47a87b836378', 'request_id': 'req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:35.677794 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8337e0fa1a0e49c4a5da47a87b836378', 'request_id': 'req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:35.683907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8337e0fa1a0e49c4a5da47a87b836378', 'request_id': 'req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:35.761743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38 admin admin] The token cache is being invalidate because project 8337e0fa1a0e49c4a5da47a87b836378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:35.761743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:35.761953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:35.769525 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 954/1937] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:35 2022] DELETE /identity/v3/projects/8337e0fa1a0e49c4a5da47a87b836378 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:35.770206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268722d9-8939-44db-8dfe-85909a632c30 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:35.771716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-268722d9-8939-44db-8dfe-85909a632c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:35.787953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268722d9-8939-44db-8dfe-85909a632c30 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:35.859761 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4515a7-cc2e-4f1c-8069-162ddcfc906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:35.860945 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4515a7-cc2e-4f1c-8069-162ddcfc906d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:35.861553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4515a7-cc2e-4f1c-8069-162ddcfc906d admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:35.861972 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4515a7-cc2e-4f1c-8069-162ddcfc906d admin admin] PATH_INFO: `/v3/users/914e36c2c79347668e108c5097280357` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:35.866777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4515a7-cc2e-4f1c-8069-162ddcfc906d admin admin] RBAC: Authorizing `identity:delete_user(user_id=914e36c2c79347668e108c5097280357)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:35.866777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4515a7-cc2e-4f1c-8069-162ddcfc906d admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:36.150398 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-6a4515a7-cc2e-4f1c-8069-162ddcfc906d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '914e36c2c79347668e108c5097280357'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:36.161545 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-6a4515a7-cc2e-4f1c-8069-162ddcfc906d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '914e36c2c79347668e108c5097280357'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:36.162325 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-6a4515a7-cc2e-4f1c-8069-162ddcfc906d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '914e36c2c79347668e108c5097280357'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:36.184888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-6a4515a7-cc2e-4f1c-8069-162ddcfc906d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '914e36c2c79347668e108c5097280357'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:36.184888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-6a4515a7-cc2e-4f1c-8069-162ddcfc906d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '914e36c2c79347668e108c5097280357'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:36.303472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 984/1938] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:35 2022] DELETE /identity/v3/users/914e36c2c79347668e108c5097280357 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:36.728965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:36.888121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:36.890314 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:36.905347 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b96e1f-6cec-4925-b4ab-9b3b2adc0a38 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:36.973167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079927f-6a54-4ca9-b8ef-1289bd93074c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:36.974145 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079927f-6a54-4ca9-b8ef-1289bd93074c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:36.974439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079927f-6a54-4ca9-b8ef-1289bd93074c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:36.974724 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079927f-6a54-4ca9-b8ef-1289bd93074c admin admin] PATH_INFO: `/v3/projects/db004a529078454496afdb7ff7388c44` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:36.976639 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079927f-6a54-4ca9-b8ef-1289bd93074c admin admin] RBAC: Authorizing `identity:delete_project(project_id=db004a529078454496afdb7ff7388c44)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:36.981734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079927f-6a54-4ca9-b8ef-1289bd93074c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:37.155859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4079927f-6a54-4ca9-b8ef-1289bd93074c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db004a529078454496afdb7ff7388c44', 'request_id': 'req-4079927f-6a54-4ca9-b8ef-1289bd93074c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:37.164672 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4079927f-6a54-4ca9-b8ef-1289bd93074c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db004a529078454496afdb7ff7388c44', 'request_id': 'req-4079927f-6a54-4ca9-b8ef-1289bd93074c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:37.170571 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4079927f-6a54-4ca9-b8ef-1289bd93074c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db004a529078454496afdb7ff7388c44', 'request_id': 'req-4079927f-6a54-4ca9-b8ef-1289bd93074c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:37.258000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4079927f-6a54-4ca9-b8ef-1289bd93074c admin admin] The token cache is being invalidate because project db004a529078454496afdb7ff7388c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:37.258394 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4079927f-6a54-4ca9-b8ef-1289bd93074c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:37.259055 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4079927f-6a54-4ca9-b8ef-1289bd93074c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:37.260628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 955/1939] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:36 2022] DELETE /identity/v3/projects/db004a529078454496afdb7ff7388c44 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:37.265898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69bac7-8829-4012-8c46-cbd15e2856ca None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:37.266445 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69bac7-8829-4012-8c46-cbd15e2856ca None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:37.266529 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69bac7-8829-4012-8c46-cbd15e2856ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:37.290226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-be69bac7-8829-4012-8c46-cbd15e2856ca None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:37.292033 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-be69bac7-8829-4012-8c46-cbd15e2856ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:37.309171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079927f-6a54-4ca9-b8ef-1289bd93074c admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:37.310746 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4079927f-6a54-4ca9-b8ef-1289bd93074c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:37.355095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 985/1940] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:37.363898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97599603-b8a3-499a-9b39-0c4e3b0e894e None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:37.364194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97599603-b8a3-499a-9b39-0c4e3b0e894e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:37.364648 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97599603-b8a3-499a-9b39-0c4e3b0e894e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:37.382210 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079927f-6a54-4ca9-b8ef-1289bd93074c admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:37.384237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-97599603-b8a3-499a-9b39-0c4e3b0e894e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:37.385667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-97599603-b8a3-499a-9b39-0c4e3b0e894e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:37.387821 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5592b-4f83-4f10-87b2-0c2f98ab95ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:37.389634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5592b-4f83-4f10-87b2-0c2f98ab95ad service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:37.389634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5592b-4f83-4f10-87b2-0c2f98ab95ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:37.392087 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5592b-4f83-4f10-87b2-0c2f98ab95ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:37.394146 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f6c5592b-4f83-4f10-87b2-0c2f98ab95ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:37.397585 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 986/1941] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:37.402009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97599603-b8a3-499a-9b39-0c4e3b0e894e None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:37.412232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97599603-b8a3-499a-9b39-0c4e3b0e894e None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:37.417820 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94fb5c-9a3c-43d2-b466-2c44f7ad63e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:37.418573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94fb5c-9a3c-43d2-b466-2c44f7ad63e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:37.418864 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94fb5c-9a3c-43d2-b466-2c44f7ad63e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:37.419146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94fb5c-9a3c-43d2-b466-2c44f7ad63e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:37.419915 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94fb5c-9a3c-43d2-b466-2c44f7ad63e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:04:37.420209 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94fb5c-9a3c-43d2-b466-2c44f7ad63e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:37.422505 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94fb5c-9a3c-43d2-b466-2c44f7ad63e1 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:37.423300 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:37.437926 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 987/1942] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:04:37.442773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94fb5c-9a3c-43d2-b466-2c44f7ad63e1 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:37.454779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94fb5c-9a3c-43d2-b466-2c44f7ad63e1 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:37.460578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902d707-e86d-40f1-b452-d0646df1cde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:37.461356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902d707-e86d-40f1-b452-d0646df1cde4 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:37.461641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902d707-e86d-40f1-b452-d0646df1cde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:37.461919 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902d707-e86d-40f1-b452-d0646df1cde4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:37.462784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902d707-e86d-40f1-b452-d0646df1cde4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:37.464693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902d707-e86d-40f1-b452-d0646df1cde4 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:37.483993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5592b-4f83-4f10-87b2-0c2f98ab95ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:37.485521 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5592b-4f83-4f10-87b2-0c2f98ab95ad service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:37.497251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 956/1943] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:04:37.606766 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 988/1944] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:37 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:04:37.611621 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5592b-4f83-4f10-87b2-0c2f98ab95ad service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:37.627377 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5592b-4f83-4f10-87b2-0c2f98ab95ad service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:37.715666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bd981-82bf-4fa4-894e-3cd79c1ce61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:37.719536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bd981-82bf-4fa4-894e-3cd79c1ce61b admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:37.719536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bd981-82bf-4fa4-894e-3cd79c1ce61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:37.719536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bd981-82bf-4fa4-894e-3cd79c1ce61b admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:37.719536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bd981-82bf-4fa4-894e-3cd79c1ce61b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:37.721515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bd981-82bf-4fa4-894e-3cd79c1ce61b admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:37.898046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 957/1945] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:37 2022] POST /identity/v3/users => generated 283 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:37.900523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902d707-e86d-40f1-b452-d0646df1cde4 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:37.914530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902d707-e86d-40f1-b452-d0646df1cde4 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:37.920035 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a64b06-8f42-4774-801e-004553e7d359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:37.920805 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a64b06-8f42-4774-801e-004553e7d359 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:37.923279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a64b06-8f42-4774-801e-004553e7d359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:37.923566 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a64b06-8f42-4774-801e-004553e7d359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:37.925264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a64b06-8f42-4774-801e-004553e7d359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:37.928230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a64b06-8f42-4774-801e-004553e7d359 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:37.940170 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 989/1946] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:37.944303 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bd981-82bf-4fa4-894e-3cd79c1ce61b admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:37.956172 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bd981-82bf-4fa4-894e-3cd79c1ce61b admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:37.962234 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c38af-a7e5-4fac-b3df-f73c63fc2994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:37.963240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c38af-a7e5-4fac-b3df-f73c63fc2994 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:37.963837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c38af-a7e5-4fac-b3df-f73c63fc2994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:37.964126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c38af-a7e5-4fac-b3df-f73c63fc2994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:37.964885 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c38af-a7e5-4fac-b3df-f73c63fc2994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:37.966817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c38af-a7e5-4fac-b3df-f73c63fc2994 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:37.981474 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 958/1947] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:37.985821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a64b06-8f42-4774-801e-004553e7d359 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:37.996117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a64b06-8f42-4774-801e-004553e7d359 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:38.001071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e9d92-9030-4949-abfd-1bf472e37d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:38.002253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e9d92-9030-4949-abfd-1bf472e37d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:38.002627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e9d92-9030-4949-abfd-1bf472e37d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:38.003016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e9d92-9030-4949-abfd-1bf472e37d3f admin admin] PATH_INFO: `/v3/projects/5e5ad595e21947feba7668fb4c07291c/users/f3c9b306f1664b148ed024581563f16c/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:38.022256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e9d92-9030-4949-abfd-1bf472e37d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5ad595e21947feba7668fb4c07291c, user_id=f3c9b306f1664b148ed024581563f16c, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:38.024962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e9d92-9030-4949-abfd-1bf472e37d3f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:38.147676 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 990/1948] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:37 2022] PUT /identity/v3/projects/5e5ad595e21947feba7668fb4c07291c/users/f3c9b306f1664b148ed024581563f16c/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:38.166073 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c61fa-1cf0-451f-9c92-8ea55b4c3adb None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:38.166372 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c61fa-1cf0-451f-9c92-8ea55b4c3adb None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:38.166661 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c61fa-1cf0-451f-9c92-8ea55b4c3adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:38.197012 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-f66c61fa-1cf0-451f-9c92-8ea55b4c3adb None None] MFA Rules not processed for user `f3c9b306f1664b148ed024581563f16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:38.198339 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f66c61fa-1cf0-451f-9c92-8ea55b4c3adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:38.283280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 959/1949] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:38.299856 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e9d92-9030-4949-abfd-1bf472e37d3f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:38.301638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-384e9d92-9030-4949-abfd-1bf472e37d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:38.369996 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e9d92-9030-4949-abfd-1bf472e37d3f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:38.373789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469c70e-12f6-41bc-a204-3056bd064401 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:38.375100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469c70e-12f6-41bc-a204-3056bd064401 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:38.375496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469c70e-12f6-41bc-a204-3056bd064401 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:38.375896 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469c70e-12f6-41bc-a204-3056bd064401 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:38.385469 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469c70e-12f6-41bc-a204-3056bd064401 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:38.386951 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469c70e-12f6-41bc-a204-3056bd064401 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:38.397819 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 991/1950] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:40.391644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:41.043332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:41.969650 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:42.078029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:43.377692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c61fa-1cf0-451f-9c92-8ea55b4c3adb None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:43.380492 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f66c61fa-1cf0-451f-9c92-8ea55b4c3adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:43.474183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c61fa-1cf0-451f-9c92-8ea55b4c3adb None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:43.480863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da788059-23c9-4cfe-8f12-f2dda7a5ca82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:43.481858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da788059-23c9-4cfe-8f12-f2dda7a5ca82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:43.482155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da788059-23c9-4cfe-8f12-f2dda7a5ca82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:43.482700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da788059-23c9-4cfe-8f12-f2dda7a5ca82 admin admin] PATH_INFO: `/v3/users/b2d7a29de7b741cda6f7a4e4341535f0` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:43.484707 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da788059-23c9-4cfe-8f12-f2dda7a5ca82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d7a29de7b741cda6f7a4e4341535f0)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:43.487003 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da788059-23c9-4cfe-8f12-f2dda7a5ca82 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:43.524214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469c70e-12f6-41bc-a204-3056bd064401 service cinder] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:43.526302 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-3469c70e-12f6-41bc-a204-3056bd064401 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:43.548956 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469c70e-12f6-41bc-a204-3056bd064401 service cinder] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:43.554644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0f435-3e10-40d9-8e58-7f29f5e79902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:43.555629 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0f435-3e10-40d9-8e58-7f29f5e79902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:43.556200 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0f435-3e10-40d9-8e58-7f29f5e79902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:43.556487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0f435-3e10-40d9-8e58-7f29f5e79902 admin admin] PATH_INFO: `/v3/users/460fac4b23a549d9bf08505001c077f8` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:43.557776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0f435-3e10-40d9-8e58-7f29f5e79902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=460fac4b23a549d9bf08505001c077f8)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:43.559843 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0f435-3e10-40d9-8e58-7f29f5e79902 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:43.787072 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-da788059-23c9-4cfe-8f12-f2dda7a5ca82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d7a29de7b741cda6f7a4e4341535f0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:43.787767 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-da788059-23c9-4cfe-8f12-f2dda7a5ca82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d7a29de7b741cda6f7a4e4341535f0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:43.801503 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-da788059-23c9-4cfe-8f12-f2dda7a5ca82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d7a29de7b741cda6f7a4e4341535f0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:43.806373 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-da788059-23c9-4cfe-8f12-f2dda7a5ca82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d7a29de7b741cda6f7a4e4341535f0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:43.814026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-61e0f435-3e10-40d9-8e58-7f29f5e79902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460fac4b23a549d9bf08505001c077f8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:43.823324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-61e0f435-3e10-40d9-8e58-7f29f5e79902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460fac4b23a549d9bf08505001c077f8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:43.824515 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-61e0f435-3e10-40d9-8e58-7f29f5e79902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460fac4b23a549d9bf08505001c077f8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:43.844380 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-61e0f435-3e10-40d9-8e58-7f29f5e79902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460fac4b23a549d9bf08505001c077f8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:43.845758 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-61e0f435-3e10-40d9-8e58-7f29f5e79902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460fac4b23a549d9bf08505001c077f8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:43.882947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-da788059-23c9-4cfe-8f12-f2dda7a5ca82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d7a29de7b741cda6f7a4e4341535f0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:43.907347 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 960/1951] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:43 2022] DELETE /identity/v3/users/b2d7a29de7b741cda6f7a4e4341535f0 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:43.912946 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d293e-eb5c-49a2-9170-d6ac710e2d78 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:43.913284 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d293e-eb5c-49a2-9170-d6ac710e2d78 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:43.913655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d293e-eb5c-49a2-9170-d6ac710e2d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:43.944485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-c63d293e-eb5c-49a2-9170-d6ac710e2d78 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:43.945778 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c63d293e-eb5c-49a2-9170-d6ac710e2d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:43.972894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 992/1952] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:43 2022] DELETE /identity/v3/users/460fac4b23a549d9bf08505001c077f8 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:43.977872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab255-bb18-4651-b68a-3ea1705b994c None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:43.978530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab255-bb18-4651-b68a-3ea1705b994c None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:43.978905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dab255-bb18-4651-b68a-3ea1705b994c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:43.985355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:43.999854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-e6dab255-bb18-4651-b68a-3ea1705b994c None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:44.001364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e6dab255-bb18-4651-b68a-3ea1705b994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:44.041089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 961/1953] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:44.078458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d293e-eb5c-49a2-9170-d6ac710e2d78 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:44.079924 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c63d293e-eb5c-49a2-9170-d6ac710e2d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:44.084436 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 993/1954] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:44.094600 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dab255-bb18-4651-b68a-3ea1705b994c None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:44.096140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e6dab255-bb18-4651-b68a-3ea1705b994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:44.111481 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:44.154333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d293e-eb5c-49a2-9170-d6ac710e2d78 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:44.184475 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dab255-bb18-4651-b68a-3ea1705b994c None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:44.196133 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6d698-1513-427e-9a21-22d14e8dabdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:44.197930 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6d698-1513-427e-9a21-22d14e8dabdd service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:44.198393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6d698-1513-427e-9a21-22d14e8dabdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:44.200034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6d698-1513-427e-9a21-22d14e8dabdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:44.213284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6d698-1513-427e-9a21-22d14e8dabdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:44.215536 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6d698-1513-427e-9a21-22d14e8dabdd service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:44.224434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac556449-20a4-45b2-a4c8-a624c7016d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:44.225285 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac556449-20a4-45b2-a4c8-a624c7016d14 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:44.225649 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac556449-20a4-45b2-a4c8-a624c7016d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:44.226001 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac556449-20a4-45b2-a4c8-a624c7016d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:44.231174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 994/1955] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:04:44.238358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac556449-20a4-45b2-a4c8-a624c7016d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:44.240273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac556449-20a4-45b2-a4c8-a624c7016d14 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:44.255698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 962/1956] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:04:45.203485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6d698-1513-427e-9a21-22d14e8dabdd service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:45.205837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-21d6d698-1513-427e-9a21-22d14e8dabdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:45.223941 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:45.235319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6d698-1513-427e-9a21-22d14e8dabdd service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:45.242043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac556449-20a4-45b2-a4c8-a624c7016d14 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:45.243799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ac556449-20a4-45b2-a4c8-a624c7016d14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:45.257545 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fedd1-a255-4372-a992-2d37c02810bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:45.259373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fedd1-a255-4372-a992-2d37c02810bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:45.259916 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fedd1-a255-4372-a992-2d37c02810bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:45.260533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fedd1-a255-4372-a992-2d37c02810bf admin admin] PATH_INFO: `/v3/projects/f07bdb086d61408ba7b3c252e2767479` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:45.261381 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac556449-20a4-45b2-a4c8-a624c7016d14 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:45.262093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fedd1-a255-4372-a992-2d37c02810bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07bdb086d61408ba7b3c252e2767479)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:45.264385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fedd1-a255-4372-a992-2d37c02810bf admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:45.269770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:45.271100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:45.271605 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:45.272073 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36 admin admin] PATH_INFO: `/v3/projects/0912eeb9c391421393859e31bed567cf` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:45.274442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0912eeb9c391421393859e31bed567cf)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:45.278267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:45.390271 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-9d7fedd1-a255-4372-a992-2d37c02810bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07bdb086d61408ba7b3c252e2767479', 'request_id': 'req-9d7fedd1-a255-4372-a992-2d37c02810bf'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.406855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-9d7fedd1-a255-4372-a992-2d37c02810bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07bdb086d61408ba7b3c252e2767479', 'request_id': 'req-9d7fedd1-a255-4372-a992-2d37c02810bf'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.415685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-9d7fedd1-a255-4372-a992-2d37c02810bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07bdb086d61408ba7b3c252e2767479', 'request_id': 'req-9d7fedd1-a255-4372-a992-2d37c02810bf'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.429265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0912eeb9c391421393859e31bed567cf', 'request_id': 'req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.438277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0912eeb9c391421393859e31bed567cf', 'request_id': 'req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.450537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0912eeb9c391421393859e31bed567cf', 'request_id': 'req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.527182 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-9d7fedd1-a255-4372-a992-2d37c02810bf admin admin] The token cache is being invalidate because project f07bdb086d61408ba7b3c252e2767479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:45.527636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-9d7fedd1-a255-4372-a992-2d37c02810bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.528487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-9d7fedd1-a255-4372-a992-2d37c02810bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.534537 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 995/1957] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:45 2022] DELETE /identity/v3/projects/f07bdb086d61408ba7b3c252e2767479 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:45.535922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fedd1-a255-4372-a992-2d37c02810bf admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:45.537900 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9d7fedd1-a255-4372-a992-2d37c02810bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:45.615032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fedd1-a255-4372-a992-2d37c02810bf admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:45.615284 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36 admin admin] The token cache is being invalidate because project 0912eeb9c391421393859e31bed567cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:45.615456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.616284 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.618498 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 963/1958] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:45 2022] DELETE /identity/v3/projects/0912eeb9c391421393859e31bed567cf => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:45.624094 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:45.627113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:45.692084 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4d216-ccdd-43de-b240-e21f606af8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:45.692084 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4d216-ccdd-43de-b240-e21f606af8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:45.692084 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4d216-ccdd-43de-b240-e21f606af8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:45.692084 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4d216-ccdd-43de-b240-e21f606af8de admin admin] PATH_INFO: `/v3/users/64684c0667d042ae90c78de65fa12f78` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:45.693759 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4d216-ccdd-43de-b240-e21f606af8de admin admin] RBAC: Authorizing `identity:delete_user(user_id=64684c0667d042ae90c78de65fa12f78)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:45.693759 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4d216-ccdd-43de-b240-e21f606af8de admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:45.705886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:45.729506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b4c39-b04a-49c3-a5a0-e5c931c8dc36 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:45.734908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9a161-edf3-4aab-b5e3-9a57f693f745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:45.735829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9a161-edf3-4aab-b5e3-9a57f693f745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:45.736119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9a161-edf3-4aab-b5e3-9a57f693f745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:45.736399 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9a161-edf3-4aab-b5e3-9a57f693f745 admin admin] PATH_INFO: `/v3/users/e0e7c32f68b94de8884ec01a90e64935` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:45.737812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9a161-edf3-4aab-b5e3-9a57f693f745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e7c32f68b94de8884ec01a90e64935)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:45.741026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9a161-edf3-4aab-b5e3-9a57f693f745 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:45.938001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-06c4d216-ccdd-43de-b240-e21f606af8de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64684c0667d042ae90c78de65fa12f78'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.947105 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-06c4d216-ccdd-43de-b240-e21f606af8de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64684c0667d042ae90c78de65fa12f78'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.947916 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-06c4d216-ccdd-43de-b240-e21f606af8de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64684c0667d042ae90c78de65fa12f78'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.960672 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-3ff9a161-edf3-4aab-b5e3-9a57f693f745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e7c32f68b94de8884ec01a90e64935'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.961481 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-3ff9a161-edf3-4aab-b5e3-9a57f693f745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e7c32f68b94de8884ec01a90e64935'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.971425 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-3ff9a161-edf3-4aab-b5e3-9a57f693f745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e7c32f68b94de8884ec01a90e64935'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.972684 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-3ff9a161-edf3-4aab-b5e3-9a57f693f745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e7c32f68b94de8884ec01a90e64935'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.985165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-06c4d216-ccdd-43de-b240-e21f606af8de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64684c0667d042ae90c78de65fa12f78'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:45.985165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-06c4d216-ccdd-43de-b240-e21f606af8de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64684c0667d042ae90c78de65fa12f78'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:46.049627 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-3ff9a161-edf3-4aab-b5e3-9a57f693f745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e7c32f68b94de8884ec01a90e64935'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:46.082279 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 964/1959] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:45 2022] DELETE /identity/v3/users/e0e7c32f68b94de8884ec01a90e64935 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:46.118105 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 996/1960] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:45 2022] DELETE /identity/v3/users/64684c0667d042ae90c78de65fa12f78 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:46.623802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9a161-edf3-4aab-b5e3-9a57f693f745 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:46.625859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3ff9a161-edf3-4aab-b5e3-9a57f693f745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:46.762648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9a161-edf3-4aab-b5e3-9a57f693f745 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:46.882910 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ed53f-03d0-4d39-be20-12e07580c693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:46.884574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ed53f-03d0-4d39-be20-12e07580c693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:46.884875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ed53f-03d0-4d39-be20-12e07580c693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:46.885412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ed53f-03d0-4d39-be20-12e07580c693 admin admin] PATH_INFO: `/v3/projects/51740b2ac4f64481b1e2db70b86c7f95` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:46.886839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ed53f-03d0-4d39-be20-12e07580c693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51740b2ac4f64481b1e2db70b86c7f95)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:46.888938 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ed53f-03d0-4d39-be20-12e07580c693 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:46.972866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4d216-ccdd-43de-b240-e21f606af8de admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:46.976039 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-06c4d216-ccdd-43de-b240-e21f606af8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:46.998872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4d216-ccdd-43de-b240-e21f606af8de admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:47.005925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45116d6-d7eb-4a63-aec7-ac4fcf9f0dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:47.006859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45116d6-d7eb-4a63-aec7-ac4fcf9f0dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:47.009644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45116d6-d7eb-4a63-aec7-ac4fcf9f0dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:47.009644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45116d6-d7eb-4a63-aec7-ac4fcf9f0dc9 admin admin] PATH_INFO: `/v3/projects/d49a0c1a926848f78b178266e90a1e78` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:47.009644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45116d6-d7eb-4a63-aec7-ac4fcf9f0dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d49a0c1a926848f78b178266e90a1e78)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:47.011046 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45116d6-d7eb-4a63-aec7-ac4fcf9f0dc9 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:47.089055 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d53ed53f-03d0-4d39-be20-12e07580c693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51740b2ac4f64481b1e2db70b86c7f95', 'request_id': 'req-d53ed53f-03d0-4d39-be20-12e07580c693'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:47.097288 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d53ed53f-03d0-4d39-be20-12e07580c693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51740b2ac4f64481b1e2db70b86c7f95', 'request_id': 'req-d53ed53f-03d0-4d39-be20-12e07580c693'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:47.106700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d53ed53f-03d0-4d39-be20-12e07580c693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51740b2ac4f64481b1e2db70b86c7f95', 'request_id': 'req-d53ed53f-03d0-4d39-be20-12e07580c693'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:47.150947 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:47.184013 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a45116d6-d7eb-4a63-aec7-ac4fcf9f0dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd49a0c1a926848f78b178266e90a1e78', 'request_id': 'req-a45116d6-d7eb-4a63-aec7-ac4fcf9f0dc9'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:47.198393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a45116d6-d7eb-4a63-aec7-ac4fcf9f0dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd49a0c1a926848f78b178266e90a1e78', 'request_id': 'req-a45116d6-d7eb-4a63-aec7-ac4fcf9f0dc9'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:47.210115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a45116d6-d7eb-4a63-aec7-ac4fcf9f0dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd49a0c1a926848f78b178266e90a1e78', 'request_id': 'req-a45116d6-d7eb-4a63-aec7-ac4fcf9f0dc9'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:47.241801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d53ed53f-03d0-4d39-be20-12e07580c693 admin admin] The token cache is being invalidate because project 51740b2ac4f64481b1e2db70b86c7f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:47.244695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d53ed53f-03d0-4d39-be20-12e07580c693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:47.244695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d53ed53f-03d0-4d39-be20-12e07580c693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:47.244695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 965/1961] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:46 2022] DELETE /identity/v3/projects/51740b2ac4f64481b1e2db70b86c7f95 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:47.251781 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc1189-6ac5-435d-88e5-2935af0eda24 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:47.252291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc1189-6ac5-435d-88e5-2935af0eda24 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:47.252835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc1189-6ac5-435d-88e5-2935af0eda24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:47.287691 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-44cc1189-6ac5-435d-88e5-2935af0eda24 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:47.290106 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-44cc1189-6ac5-435d-88e5-2935af0eda24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:47.338496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a45116d6-d7eb-4a63-aec7-ac4fcf9f0dc9 admin admin] The token cache is being invalidate because project d49a0c1a926848f78b178266e90a1e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:47.339026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a45116d6-d7eb-4a63-aec7-ac4fcf9f0dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:47.340377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a45116d6-d7eb-4a63-aec7-ac4fcf9f0dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:47.344879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 997/1962] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:46 2022] DELETE /identity/v3/projects/d49a0c1a926848f78b178266e90a1e78 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:47.350874 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbfedf-8598-42c6-9299-6f1ed5d8915c None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:47.351853 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbfedf-8598-42c6-9299-6f1ed5d8915c None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:47.353748 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbfedf-8598-42c6-9299-6f1ed5d8915c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:47.401075 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-d1bbfedf-8598-42c6-9299-6f1ed5d8915c None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:47.401075 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-d1bbfedf-8598-42c6-9299-6f1ed5d8915c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:47.415543 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 966/1963] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:47.416905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 998/1964] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:47.425678 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2607e-ecbe-4ec6-9df9-c5bc9f8a5cc9 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:47.426009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c30f60-e61c-4d5f-8273-29c451158e81 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:47.426156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2607e-ecbe-4ec6-9df9-c5bc9f8a5cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:47.426393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2607e-ecbe-4ec6-9df9-c5bc9f8a5cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:47.426780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c30f60-e61c-4d5f-8273-29c451158e81 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:47.427276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c30f60-e61c-4d5f-8273-29c451158e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:47.450078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-29c30f60-e61c-4d5f-8273-29c451158e81 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:47.451399 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-29c30f60-e61c-4d5f-8273-29c451158e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:47.454006 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-c9b2607e-ecbe-4ec6-9df9-c5bc9f8a5cc9 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:47.455531 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c9b2607e-ecbe-4ec6-9df9-c5bc9f8a5cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:47.464876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 999/1965] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:47.468850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 967/1966] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:47.470030 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c30f60-e61c-4d5f-8273-29c451158e81 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:47.470346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2607e-ecbe-4ec6-9df9-c5bc9f8a5cc9 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:47.480707 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2607e-ecbe-4ec6-9df9-c5bc9f8a5cc9 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:47.484652 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c30f60-e61c-4d5f-8273-29c451158e81 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:47.489752 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d42ec8-e718-469d-9c0e-e2f4246f613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:47.490067 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85bd19-1bc4-4c74-b158-b24d54c6f2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:47.490702 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d42ec8-e718-469d-9c0e-e2f4246f613b admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:47.490838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85bd19-1bc4-4c74-b158-b24d54c6f2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:47.491013 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d42ec8-e718-469d-9c0e-e2f4246f613b admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:47.491130 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85bd19-1bc4-4c74-b158-b24d54c6f2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:47.491299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d42ec8-e718-469d-9c0e-e2f4246f613b admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:47.491413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85bd19-1bc4-4c74-b158-b24d54c6f2c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:47.492016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85bd19-1bc4-4c74-b158-b24d54c6f2c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:04:47.492127 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d42ec8-e718-469d-9c0e-e2f4246f613b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:04:47.492329 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85bd19-1bc4-4c74-b158-b24d54c6f2c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:47.492433 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d42ec8-e718-469d-9c0e-e2f4246f613b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:47.494487 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d42ec8-e718-469d-9c0e-e2f4246f613b admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:47.494648 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85bd19-1bc4-4c74-b158-b24d54c6f2c5 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:47.507674 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 968/1967] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:04:47.509602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1000/1968] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:04:47.514198 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d42ec8-e718-469d-9c0e-e2f4246f613b admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:47.518374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85bd19-1bc4-4c74-b158-b24d54c6f2c5 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:47.528097 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d42ec8-e718-469d-9c0e-e2f4246f613b admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:47.533727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85bd19-1bc4-4c74-b158-b24d54c6f2c5 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:47.538505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7abd3a-54b9-4b62-97c6-d3a5d0168a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:47.539342 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7abd3a-54b9-4b62-97c6-d3a5d0168a96 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:47.539710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7abd3a-54b9-4b62-97c6-d3a5d0168a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:47.540064 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7abd3a-54b9-4b62-97c6-d3a5d0168a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:47.541082 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7abd3a-54b9-4b62-97c6-d3a5d0168a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:47.541347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ec525-0fe0-4da6-9631-9fd5f5a8aba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:47.542337 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ec525-0fe0-4da6-9631-9fd5f5a8aba3 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:47.542700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ec525-0fe0-4da6-9631-9fd5f5a8aba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:47.543165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ec525-0fe0-4da6-9631-9fd5f5a8aba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:47.543597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7abd3a-54b9-4b62-97c6-d3a5d0168a96 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:47.545300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ec525-0fe0-4da6-9631-9fd5f5a8aba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:47.555432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ec525-0fe0-4da6-9631-9fd5f5a8aba3 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:47.640343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 969/1969] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:47 2022] POST /identity/v3/projects => generated 407 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:47.641261 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7abd3a-54b9-4b62-97c6-d3a5d0168a96 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:47.642914 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-df7abd3a-54b9-4b62-97c6-d3a5d0168a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:47.691793 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1001/1970] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:47 2022] POST /identity/v3/projects => generated 367 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:47.692799 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ec525-0fe0-4da6-9631-9fd5f5a8aba3 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:47.734470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7abd3a-54b9-4b62-97c6-d3a5d0168a96 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:47.768494 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ec525-0fe0-4da6-9631-9fd5f5a8aba3 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:47.774063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:47.774327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b98a1-8e89-4218-88ed-1a7665561f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:47.774938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b98a1-8e89-4218-88ed-1a7665561f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:47.775236 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b98a1-8e89-4218-88ed-1a7665561f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:47.775510 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b98a1-8e89-4218-88ed-1a7665561f51 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:47.776209 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b98a1-8e89-4218-88ed-1a7665561f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:47.778199 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b98a1-8e89-4218-88ed-1a7665561f51 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:47.803213 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1aa429-8349-4be9-b3f6-b6093462b755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:47.804106 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1aa429-8349-4be9-b3f6-b6093462b755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:47.804404 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1aa429-8349-4be9-b3f6-b6093462b755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:47.804679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1aa429-8349-4be9-b3f6-b6093462b755 admin admin] PATH_INFO: `/v3/users/46e1408cf45241208f6c7f485fb4a182` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:47.805947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1aa429-8349-4be9-b3f6-b6093462b755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e1408cf45241208f6c7f485fb4a182)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:47.813659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1aa429-8349-4be9-b3f6-b6093462b755 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:47.895873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1002/1971] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:47 2022] POST /identity/v3/users => generated 304 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:47.896694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b98a1-8e89-4218-88ed-1a7665561f51 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:47.907742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b98a1-8e89-4218-88ed-1a7665561f51 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:47.917317 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82808c3e-1f80-4232-8f27-318bfb6d36c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:47.918437 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82808c3e-1f80-4232-8f27-318bfb6d36c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:47.918949 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82808c3e-1f80-4232-8f27-318bfb6d36c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:47.922011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82808c3e-1f80-4232-8f27-318bfb6d36c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:47.922011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82808c3e-1f80-4232-8f27-318bfb6d36c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:47.923693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82808c3e-1f80-4232-8f27-318bfb6d36c5 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:48.030765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1003/1972] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:47 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:48.031629 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82808c3e-1f80-4232-8f27-318bfb6d36c5 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:48.048270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ef1aa429-8349-4be9-b3f6-b6093462b755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e1408cf45241208f6c7f485fb4a182'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:48.049036 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ef1aa429-8349-4be9-b3f6-b6093462b755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e1408cf45241208f6c7f485fb4a182'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:48.051519 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82808c3e-1f80-4232-8f27-318bfb6d36c5 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:48.056980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c29a60-e44f-4ddc-8685-189d02bfc57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:48.058007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c29a60-e44f-4ddc-8685-189d02bfc57d admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:48.058388 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c29a60-e44f-4ddc-8685-189d02bfc57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:48.058757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c29a60-e44f-4ddc-8685-189d02bfc57d admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:48.059746 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c29a60-e44f-4ddc-8685-189d02bfc57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:48.060430 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ef1aa429-8349-4be9-b3f6-b6093462b755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e1408cf45241208f6c7f485fb4a182'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:48.062065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c29a60-e44f-4ddc-8685-189d02bfc57d admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:48.063032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ef1aa429-8349-4be9-b3f6-b6093462b755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e1408cf45241208f6c7f485fb4a182'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:48.076130 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1004/1973] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:48.080004 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c29a60-e44f-4ddc-8685-189d02bfc57d admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:48.080579 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a7c29a60-e44f-4ddc-8685-189d02bfc57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:48.094399 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c29a60-e44f-4ddc-8685-189d02bfc57d admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:48.099586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cdaf9-d231-4e7e-8d2b-f1e4cdeb91fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:48.100275 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cdaf9-d231-4e7e-8d2b-f1e4cdeb91fd admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:48.101938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cdaf9-d231-4e7e-8d2b-f1e4cdeb91fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:48.101938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cdaf9-d231-4e7e-8d2b-f1e4cdeb91fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:48.101938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cdaf9-d231-4e7e-8d2b-f1e4cdeb91fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:48.103196 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cdaf9-d231-4e7e-8d2b-f1e4cdeb91fd admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:48.115824 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1005/1974] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:48.116733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cdaf9-d231-4e7e-8d2b-f1e4cdeb91fd admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:48.118611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-018cdaf9-d231-4e7e-8d2b-f1e4cdeb91fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:48.132264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cdaf9-d231-4e7e-8d2b-f1e4cdeb91fd admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:48.140507 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b32fda-1cf7-401d-838e-ec9cf354b287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:48.141255 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b32fda-1cf7-401d-838e-ec9cf354b287 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:48.141547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b32fda-1cf7-401d-838e-ec9cf354b287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:48.141826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b32fda-1cf7-401d-838e-ec9cf354b287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:48.142606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b32fda-1cf7-401d-838e-ec9cf354b287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:48.144284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b32fda-1cf7-401d-838e-ec9cf354b287 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:48.156121 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1006/1975] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:48.156998 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b32fda-1cf7-401d-838e-ec9cf354b287 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:48.158240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ef1aa429-8349-4be9-b3f6-b6093462b755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e1408cf45241208f6c7f485fb4a182'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:48.168367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b32fda-1cf7-401d-838e-ec9cf354b287 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:48.174051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995ed03-12be-4039-b215-26fa7e370b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:48.174740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995ed03-12be-4039-b215-26fa7e370b16 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:48.175033 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995ed03-12be-4039-b215-26fa7e370b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:48.175340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995ed03-12be-4039-b215-26fa7e370b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:48.176100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995ed03-12be-4039-b215-26fa7e370b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:48.177761 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995ed03-12be-4039-b215-26fa7e370b16 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:48.189930 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1007/1976] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:48.190541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995ed03-12be-4039-b215-26fa7e370b16 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:48.196389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 970/1977] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:47 2022] DELETE /identity/v3/users/46e1408cf45241208f6c7f485fb4a182 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:48.197622 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1aa429-8349-4be9-b3f6-b6093462b755 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:48.201776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995ed03-12be-4039-b215-26fa7e370b16 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:48.298466 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e5041-80ef-4692-aeab-7879ca4722e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:48.299641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e5041-80ef-4692-aeab-7879ca4722e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:48.299928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e5041-80ef-4692-aeab-7879ca4722e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:48.300211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e5041-80ef-4692-aeab-7879ca4722e5 admin admin] PATH_INFO: `/v3/projects/95e310d9416b4f838838df59ca5a421e/users/b372b8fbf5e04f378e85ffdc29106b7f/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:48.311330 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1aa429-8349-4be9-b3f6-b6093462b755 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:48.317486 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6496ef-cb63-4d24-ae4a-5cbf07c9e22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:48.317917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e5041-80ef-4692-aeab-7879ca4722e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e310d9416b4f838838df59ca5a421e, user_id=b372b8fbf5e04f378e85ffdc29106b7f, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:48.318411 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6496ef-cb63-4d24-ae4a-5cbf07c9e22a admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:48.318701 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6496ef-cb63-4d24-ae4a-5cbf07c9e22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:48.318985 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6496ef-cb63-4d24-ae4a-5cbf07c9e22a admin admin] PATH_INFO: `/v3/projects/b994239165fc429eb74eb2a61143aa6b/users/872d96f777b44fe086d62431cc985bd4/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:48.320946 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e5041-80ef-4692-aeab-7879ca4722e5 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:48.335479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6496ef-cb63-4d24-ae4a-5cbf07c9e22a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b994239165fc429eb74eb2a61143aa6b, user_id=872d96f777b44fe086d62431cc985bd4, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:48.338346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6496ef-cb63-4d24-ae4a-5cbf07c9e22a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:48.420785 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 971/1978] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:48 2022] PUT /identity/v3/projects/b994239165fc429eb74eb2a61143aa6b/users/872d96f777b44fe086d62431cc985bd4/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:48.423074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1008/1979] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:48 2022] PUT /identity/v3/projects/95e310d9416b4f838838df59ca5a421e/users/b372b8fbf5e04f378e85ffdc29106b7f/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:48.432120 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706ae94-064c-4ee1-be23-819c22d318a9 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:48.432420 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706ae94-064c-4ee1-be23-819c22d318a9 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:48.432788 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706ae94-064c-4ee1-be23-819c22d318a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:48.434574 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034a0e1-d6f0-41ab-9c75-c93451b8f050 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:48.434900 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034a0e1-d6f0-41ab-9c75-c93451b8f050 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:48.435204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034a0e1-d6f0-41ab-9c75-c93451b8f050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:48.469316 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-f706ae94-064c-4ee1-be23-819c22d318a9 None None] MFA Rules not processed for user `872d96f777b44fe086d62431cc985bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:48.470570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f706ae94-064c-4ee1-be23-819c22d318a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:48.482746 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-4034a0e1-d6f0-41ab-9c75-c93451b8f050 None None] MFA Rules not processed for user `b372b8fbf5e04f378e85ffdc29106b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:48.483983 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4034a0e1-d6f0-41ab-9c75-c93451b8f050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:48.557417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 972/1980] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:48.557417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706ae94-064c-4ee1-be23-819c22d318a9 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:48.557417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f706ae94-064c-4ee1-be23-819c22d318a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:48.582595 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1009/1981] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:48 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:48.584473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034a0e1-d6f0-41ab-9c75-c93451b8f050 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:48.671946 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706ae94-064c-4ee1-be23-819c22d318a9 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:48.677486 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:48.679002 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:48.679552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:48.680094 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a admin admin] PATH_INFO: `/v3/projects/ca26c89d8c6e43b6a5a8aaaf66e291d7` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:48.680969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034a0e1-d6f0-41ab-9c75-c93451b8f050 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:48.681656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca26c89d8c6e43b6a5a8aaaf66e291d7)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:48.690599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:48.690807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bded29-1ccf-4dd1-85f2-82deb02f9756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:48.690807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bded29-1ccf-4dd1-85f2-82deb02f9756 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:48.690807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bded29-1ccf-4dd1-85f2-82deb02f9756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:48.690807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bded29-1ccf-4dd1-85f2-82deb02f9756 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:48.691175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bded29-1ccf-4dd1-85f2-82deb02f9756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:48.691175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bded29-1ccf-4dd1-85f2-82deb02f9756 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:48.832470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1010/1982] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:48 2022] POST /identity/v3/projects => generated 369 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:48.833545 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bded29-1ccf-4dd1-85f2-82deb02f9756 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:48.867392 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca26c89d8c6e43b6a5a8aaaf66e291d7', 'request_id': 'req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:48.880588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca26c89d8c6e43b6a5a8aaaf66e291d7', 'request_id': 'req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:48.906000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca26c89d8c6e43b6a5a8aaaf66e291d7', 'request_id': 'req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:48.935114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bded29-1ccf-4dd1-85f2-82deb02f9756 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:48.995280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a admin admin] The token cache is being invalidate because project ca26c89d8c6e43b6a5a8aaaf66e291d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:48.995722 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:48.996440 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:48.998096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 973/1983] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:48 2022] DELETE /identity/v3/projects/ca26c89d8c6e43b6a5a8aaaf66e291d7 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:48.998963 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:49.008506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:49.009038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2b011-58a8-4f34-bb37-8384f7f0935b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:49.009764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2b011-58a8-4f34-bb37-8384f7f0935b admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:49.010054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2b011-58a8-4f34-bb37-8384f7f0935b admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:49.010372 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2b011-58a8-4f34-bb37-8384f7f0935b admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:49.011117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2b011-58a8-4f34-bb37-8384f7f0935b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:49.013215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2b011-58a8-4f34-bb37-8384f7f0935b admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:49.067915 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ab1b1-812f-4978-8b1a-dcc7a0a7f35a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:49.072729 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048de6cb-82a4-4f12-aa09-20e4302d5a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:49.073474 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048de6cb-82a4-4f12-aa09-20e4302d5a50 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:49.073769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048de6cb-82a4-4f12-aa09-20e4302d5a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:49.074054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048de6cb-82a4-4f12-aa09-20e4302d5a50 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:49.074789 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048de6cb-82a4-4f12-aa09-20e4302d5a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:49.076727 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048de6cb-82a4-4f12-aa09-20e4302d5a50 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:49.168546 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1011/1984] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:48 2022] POST /identity/v3/projects => generated 409 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:49.170076 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899527c-d98f-464a-8461-2d37ca2ca3a2 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:49.170369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899527c-d98f-464a-8461-2d37ca2ca3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:49.170651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899527c-d98f-464a-8461-2d37ca2ca3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:49.193893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-9899527c-d98f-464a-8461-2d37ca2ca3a2 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:49.195112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9899527c-d98f-464a-8461-2d37ca2ca3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:49.237591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:49.246879 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 974/1985] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:48 2022] POST /identity/v3/users => generated 291 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:49.255096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048de6cb-82a4-4f12-aa09-20e4302d5a50 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:49.255096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-048de6cb-82a4-4f12-aa09-20e4302d5a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:49.271943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048de6cb-82a4-4f12-aa09-20e4302d5a50 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:49.275204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1012/1986] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:49.276131 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899527c-d98f-464a-8461-2d37ca2ca3a2 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:49.284476 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc5f00-95ee-4486-90c6-a9e66587d4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:49.289556 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc5f00-95ee-4486-90c6-a9e66587d4ac admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:49.289556 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc5f00-95ee-4486-90c6-a9e66587d4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:49.289556 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc5f00-95ee-4486-90c6-a9e66587d4ac admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:49.289556 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc5f00-95ee-4486-90c6-a9e66587d4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:49.290102 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899527c-d98f-464a-8461-2d37ca2ca3a2 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:49.290344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc5f00-95ee-4486-90c6-a9e66587d4ac admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:49.294410 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc1ef2-89c9-4096-a710-cd799b77ecfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:49.295301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc1ef2-89c9-4096-a710-cd799b77ecfe admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:49.295685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc1ef2-89c9-4096-a710-cd799b77ecfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:49.296075 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc1ef2-89c9-4096-a710-cd799b77ecfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:49.297104 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc1ef2-89c9-4096-a710-cd799b77ecfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:49.299457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc1ef2-89c9-4096-a710-cd799b77ecfe admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:49.311808 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1013/1987] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:49.313295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53161372-c302-41d9-a3d4-24165b4c2e58 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:49.313588 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53161372-c302-41d9-a3d4-24165b4c2e58 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:49.313867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53161372-c302-41d9-a3d4-24165b4c2e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:49.337670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-53161372-c302-41d9-a3d4-24165b4c2e58 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:49.338886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-53161372-c302-41d9-a3d4-24165b4c2e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:49.347647 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1014/1988] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:49.348487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53161372-c302-41d9-a3d4-24165b4c2e58 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:49.358234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53161372-c302-41d9-a3d4-24165b4c2e58 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:49.362992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90806782-1619-4bcc-bd87-79d4ebcb0f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:49.363881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90806782-1619-4bcc-bd87-79d4ebcb0f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:49.364164 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90806782-1619-4bcc-bd87-79d4ebcb0f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:49.364437 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90806782-1619-4bcc-bd87-79d4ebcb0f83 admin admin] PATH_INFO: `/v3/projects/1cc5466b36324893a145a4e872fc5e2a/users/9891b950e9aa488fa83ffe8cc99df2c1/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:49.379948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90806782-1619-4bcc-bd87-79d4ebcb0f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc5466b36324893a145a4e872fc5e2a, user_id=9891b950e9aa488fa83ffe8cc99df2c1, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:49.382696 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90806782-1619-4bcc-bd87-79d4ebcb0f83 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:49.495464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:49.505081 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 975/1989] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:49 2022] POST /identity/v3/users => generated 311 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:49.505081 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc5f00-95ee-4486-90c6-a9e66587d4ac admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:49.505416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1015/1990] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:49 2022] PUT /identity/v3/projects/1cc5466b36324893a145a4e872fc5e2a/users/9891b950e9aa488fa83ffe8cc99df2c1/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:49.511001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90806782-1619-4bcc-bd87-79d4ebcb0f83 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:49.517028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc5f00-95ee-4486-90c6-a9e66587d4ac admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:49.578376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90806782-1619-4bcc-bd87-79d4ebcb0f83 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:49.583685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1613506-20d7-41a4-919f-9ad93bea5982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:49.583898 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6d963-782a-4a04-ae21-f5944c27c274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:49.584353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1613506-20d7-41a4-919f-9ad93bea5982 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:49.584641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1613506-20d7-41a4-919f-9ad93bea5982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:49.584776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6d963-782a-4a04-ae21-f5944c27c274 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:49.584938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1613506-20d7-41a4-919f-9ad93bea5982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:49.585318 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6d963-782a-4a04-ae21-f5944c27c274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:49.585703 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1613506-20d7-41a4-919f-9ad93bea5982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:49.585800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6d963-782a-4a04-ae21-f5944c27c274 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:49.586743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6d963-782a-4a04-ae21-f5944c27c274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:04:49.587314 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6d963-782a-4a04-ae21-f5944c27c274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:49.587487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1613506-20d7-41a4-919f-9ad93bea5982 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:49.588990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6d963-782a-4a04-ae21-f5944c27c274 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:49.600081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1016/1991] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:49.600081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1613506-20d7-41a4-919f-9ad93bea5982 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:49.604491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 976/1992] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:04:49.605375 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6d963-782a-4a04-ae21-f5944c27c274 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:49.613504 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1613506-20d7-41a4-919f-9ad93bea5982 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:49.620722 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca53e8-ca81-42f6-9144-74da3f028078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:49.621481 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca53e8-ca81-42f6-9144-74da3f028078 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:49.622572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6d963-782a-4a04-ae21-f5944c27c274 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:49.623745 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca53e8-ca81-42f6-9144-74da3f028078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:49.624591 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca53e8-ca81-42f6-9144-74da3f028078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:49.625367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca53e8-ca81-42f6-9144-74da3f028078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:49.627592 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca53e8-ca81-42f6-9144-74da3f028078 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:49.627908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba9f43-3594-45b3-81e8-fca3d00789ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:49.629050 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba9f43-3594-45b3-81e8-fca3d00789ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:49.629593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba9f43-3594-45b3-81e8-fca3d00789ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:49.629943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba9f43-3594-45b3-81e8-fca3d00789ee admin admin] PATH_INFO: `/v3/projects/21f73962368c4d1f995e3dd0ebb03acc/users/2835eae846fa47d4852f562c5b871ff4/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:49.639698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1017/1993] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:49.639698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca53e8-ca81-42f6-9144-74da3f028078 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:49.650069 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba9f43-3594-45b3-81e8-fca3d00789ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f73962368c4d1f995e3dd0ebb03acc, user_id=2835eae846fa47d4852f562c5b871ff4, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:49.652752 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba9f43-3594-45b3-81e8-fca3d00789ee admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:49.653097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca53e8-ca81-42f6-9144-74da3f028078 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:49.659766 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daefc7-b7d2-4f6a-8015-73f629b9e34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:49.659766 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daefc7-b7d2-4f6a-8015-73f629b9e34c admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:49.660042 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daefc7-b7d2-4f6a-8015-73f629b9e34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:49.660138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daefc7-b7d2-4f6a-8015-73f629b9e34c admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:49.660835 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daefc7-b7d2-4f6a-8015-73f629b9e34c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:49.662912 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daefc7-b7d2-4f6a-8015-73f629b9e34c admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:49.776938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1018/1994] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:49 2022] POST /identity/v3/projects => generated 405 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:49.779007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daefc7-b7d2-4f6a-8015-73f629b9e34c admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:49.788007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 977/1995] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:49 2022] PUT /identity/v3/projects/21f73962368c4d1f995e3dd0ebb03acc/users/2835eae846fa47d4852f562c5b871ff4/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:49.788007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba9f43-3594-45b3-81e8-fca3d00789ee admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:49.855266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daefc7-b7d2-4f6a-8015-73f629b9e34c admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:49.860943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7e132-7632-4b20-9ac1-3c040fa2e94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:49.861516 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba9f43-3594-45b3-81e8-fca3d00789ee admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:49.861873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7e132-7632-4b20-9ac1-3c040fa2e94d admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:49.862166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7e132-7632-4b20-9ac1-3c040fa2e94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:49.862443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7e132-7632-4b20-9ac1-3c040fa2e94d admin admin] PATH_INFO: `/v3/projects/1cc5466b36324893a145a4e872fc5e2a/users/9891b950e9aa488fa83ffe8cc99df2c1/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:49.864562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7e132-7632-4b20-9ac1-3c040fa2e94d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc5466b36324893a145a4e872fc5e2a, user_id=9891b950e9aa488fa83ffe8cc99df2c1, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:49.866721 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe40f5e-c664-4ebf-982c-d7e0a320e0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:49.867221 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7e132-7632-4b20-9ac1-3c040fa2e94d admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:49.867395 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe40f5e-c664-4ebf-982c-d7e0a320e0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:49.867793 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe40f5e-c664-4ebf-982c-d7e0a320e0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:49.868072 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe40f5e-c664-4ebf-982c-d7e0a320e0b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:49.868770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe40f5e-c664-4ebf-982c-d7e0a320e0b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:49.870793 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe40f5e-c664-4ebf-982c-d7e0a320e0b3 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:49.878870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1019/1996] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:49 2022] PUT /identity/v3/projects/1cc5466b36324893a145a4e872fc5e2a/users/9891b950e9aa488fa83ffe8cc99df2c1/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:49.879747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7e132-7632-4b20-9ac1-3c040fa2e94d admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:49.947760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7e132-7632-4b20-9ac1-3c040fa2e94d admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:49.953741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a5435-f29c-4154-a74d-6cd65d521cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:49.954425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a5435-f29c-4154-a74d-6cd65d521cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:49.954709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a5435-f29c-4154-a74d-6cd65d521cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:49.959042 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a5435-f29c-4154-a74d-6cd65d521cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:49.959042 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a5435-f29c-4154-a74d-6cd65d521cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:49.959042 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a5435-f29c-4154-a74d-6cd65d521cd9 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:49.973997 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1020/1997] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:49.975386 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db147e13-31b8-46b1-bf2d-784c0e130fd1 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:49.975682 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db147e13-31b8-46b1-bf2d-784c0e130fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:49.975966 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db147e13-31b8-46b1-bf2d-784c0e130fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:49.995059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 978/1998] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:49 2022] POST /identity/v3/users => generated 303 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:49.996705 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe40f5e-c664-4ebf-982c-d7e0a320e0b3 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:50.012172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-db147e13-31b8-46b1-bf2d-784c0e130fd1 None None] MFA Rules not processed for user `9891b950e9aa488fa83ffe8cc99df2c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:50.013984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe40f5e-c664-4ebf-982c-d7e0a320e0b3 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:50.014307 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-db147e13-31b8-46b1-bf2d-784c0e130fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:50.020983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497cc4a-c8a4-457c-af08-e86213f493c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:50.022030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497cc4a-c8a4-457c-af08-e86213f493c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:50.028216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497cc4a-c8a4-457c-af08-e86213f493c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:50.028216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497cc4a-c8a4-457c-af08-e86213f493c6 admin admin] PATH_INFO: `/v3/projects/21f73962368c4d1f995e3dd0ebb03acc/users/2835eae846fa47d4852f562c5b871ff4/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:50.028216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497cc4a-c8a4-457c-af08-e86213f493c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f73962368c4d1f995e3dd0ebb03acc, user_id=2835eae846fa47d4852f562c5b871ff4, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:50.028216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497cc4a-c8a4-457c-af08-e86213f493c6 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:50.042453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 979/1999] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:49 2022] PUT /identity/v3/projects/21f73962368c4d1f995e3dd0ebb03acc/users/2835eae846fa47d4852f562c5b871ff4/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:50.051899 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497cc4a-c8a4-457c-af08-e86213f493c6 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:50.122178 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497cc4a-c8a4-457c-af08-e86213f493c6 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:50.129257 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32d25b-6925-4243-8203-086c53f802ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:50.129953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32d25b-6925-4243-8203-086c53f802ca admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:50.130227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32d25b-6925-4243-8203-086c53f802ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:50.130913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32d25b-6925-4243-8203-086c53f802ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:50.131407 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32d25b-6925-4243-8203-086c53f802ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:50.133027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32d25b-6925-4243-8203-086c53f802ca admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:50.139928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1021/2000] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:49 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:50.139928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8f72e-5fbd-4d3e-8323-ee423409d146 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:50.139928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8f72e-5fbd-4d3e-8323-ee423409d146 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:50.139928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8f72e-5fbd-4d3e-8323-ee423409d146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:50.146920 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 980/2001] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:50.148586 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32d25b-6925-4243-8203-086c53f802ca admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:50.151553 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-bd32d25b-6925-4243-8203-086c53f802ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:50.184922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-e9f8f72e-5fbd-4d3e-8323-ee423409d146 None None] MFA Rules not processed for user `2835eae846fa47d4852f562c5b871ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:50.187489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e9f8f72e-5fbd-4d3e-8323-ee423409d146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:50.224856 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32d25b-6925-4243-8203-086c53f802ca admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:50.231709 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e166fa-5363-46f7-b0ca-80235e396acd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:50.232756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e166fa-5363-46f7-b0ca-80235e396acd service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:50.234143 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e166fa-5363-46f7-b0ca-80235e396acd service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:50.234330 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e166fa-5363-46f7-b0ca-80235e396acd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:50.290156 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1022/2002] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:50 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:50.291171 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8f72e-5fbd-4d3e-8323-ee423409d146 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:50.312998 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8f72e-5fbd-4d3e-8323-ee423409d146 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:50.318930 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15ada-f505-4041-9126-21301ac034c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:50.320086 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15ada-f505-4041-9126-21301ac034c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:50.320511 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15ada-f505-4041-9126-21301ac034c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:50.320893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15ada-f505-4041-9126-21301ac034c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:50.321751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15ada-f505-4041-9126-21301ac034c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:50.323465 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15ada-f505-4041-9126-21301ac034c3 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:50.331723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e166fa-5363-46f7-b0ca-80235e396acd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:50.333235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e166fa-5363-46f7-b0ca-80235e396acd service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:50.339196 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1023/2003] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:50.342251 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15ada-f505-4041-9126-21301ac034c3 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:50.352808 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15ada-f505-4041-9126-21301ac034c3 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:50.354796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 981/2004] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:50 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:50.368315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dd61c-44ac-48a2-bfe6-60e24b38dab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:50.368315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dd61c-44ac-48a2-bfe6-60e24b38dab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:50.368315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dd61c-44ac-48a2-bfe6-60e24b38dab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:50.368315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712dd61c-44ac-48a2-bfe6-60e24b38dab0 admin admin] PATH_INFO: `/v3/projects/2c667b656a064dc09d2269669fe30f7f/users/c4471e9e4c6d4b2ebdf92cd0947a6b5f/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:50.385085 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712dd61c-44ac-48a2-bfe6-60e24b38dab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c667b656a064dc09d2269669fe30f7f, user_id=c4471e9e4c6d4b2ebdf92cd0947a6b5f, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:50.387885 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712dd61c-44ac-48a2-bfe6-60e24b38dab0 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:50.540746 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1024/2005] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:50 2022] PUT /identity/v3/projects/2c667b656a064dc09d2269669fe30f7f/users/c4471e9e4c6d4b2ebdf92cd0947a6b5f/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:50.551388 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac860d-33e6-4716-a117-35b5d69f17b3 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:50.555014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac860d-33e6-4716-a117-35b5d69f17b3 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:50.555014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac860d-33e6-4716-a117-35b5d69f17b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:50.586396 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-e4ac860d-33e6-4716-a117-35b5d69f17b3 None None] MFA Rules not processed for user `c4471e9e4c6d4b2ebdf92cd0947a6b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:50.587640 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e4ac860d-33e6-4716-a117-35b5d69f17b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:50.662384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 982/2006] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:50.678041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dd61c-44ac-48a2-bfe6-60e24b38dab0 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:50.741373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712dd61c-44ac-48a2-bfe6-60e24b38dab0 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:50.746375 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba71415-4e3e-402c-943f-9cc21a3eab48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:50.747097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba71415-4e3e-402c-943f-9cc21a3eab48 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:50.747441 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba71415-4e3e-402c-943f-9cc21a3eab48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:50.747769 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba71415-4e3e-402c-943f-9cc21a3eab48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:50.748598 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba71415-4e3e-402c-943f-9cc21a3eab48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:50.751098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba71415-4e3e-402c-943f-9cc21a3eab48 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:50.786259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac860d-33e6-4716-a117-35b5d69f17b3 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:50.811389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:50.850453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac860d-33e6-4716-a117-35b5d69f17b3 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:50.854194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bc3ab-cea3-40b6-87ce-14e5ff49cdff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:50.854856 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bc3ab-cea3-40b6-87ce-14e5ff49cdff service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:50.855148 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bc3ab-cea3-40b6-87ce-14e5ff49cdff service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:50.855433 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bc3ab-cea3-40b6-87ce-14e5ff49cdff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:50.874108 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1025/2007] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:50 2022] POST /identity/v3/projects => generated 403 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:50.878441 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba71415-4e3e-402c-943f-9cc21a3eab48 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:50.922609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bc3ab-cea3-40b6-87ce-14e5ff49cdff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:50.924264 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bc3ab-cea3-40b6-87ce-14e5ff49cdff service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:50.937470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 983/2008] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:50 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:04:50.982825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba71415-4e3e-402c-943f-9cc21a3eab48 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:50.988087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad16b17-c370-4a17-b0e8-994adca52557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:50.988782 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad16b17-c370-4a17-b0e8-994adca52557 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:50.989073 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad16b17-c370-4a17-b0e8-994adca52557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:50.989417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad16b17-c370-4a17-b0e8-994adca52557 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:50.990123 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad16b17-c370-4a17-b0e8-994adca52557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:50.992071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad16b17-c370-4a17-b0e8-994adca52557 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:51.122307 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1026/2009] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:50 2022] POST /identity/v3/users => generated 308 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:51.129090 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bc3ab-cea3-40b6-87ce-14e5ff49cdff service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:51.142475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bc3ab-cea3-40b6-87ce-14e5ff49cdff service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:51.147469 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe77746-1424-4db2-b40e-33e19ca291a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:51.148317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe77746-1424-4db2-b40e-33e19ca291a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:51.148603 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe77746-1424-4db2-b40e-33e19ca291a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:51.149078 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe77746-1424-4db2-b40e-33e19ca291a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:51.150645 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe77746-1424-4db2-b40e-33e19ca291a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:51.162179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe77746-1424-4db2-b40e-33e19ca291a5 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:51.165593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 984/2010] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:51.166753 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad16b17-c370-4a17-b0e8-994adca52557 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:51.184649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad16b17-c370-4a17-b0e8-994adca52557 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:51.189393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720ef66-94b7-4bad-9f28-a0f6df078b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:51.190316 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720ef66-94b7-4bad-9f28-a0f6df078b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:51.190747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720ef66-94b7-4bad-9f28-a0f6df078b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:51.191162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720ef66-94b7-4bad-9f28-a0f6df078b37 admin admin] PATH_INFO: `/v3/projects/9282428ace994386918c7cd5f5284f51/users/736f9968761742b3b27d3fe669022e29/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:51.213637 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720ef66-94b7-4bad-9f28-a0f6df078b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9282428ace994386918c7cd5f5284f51, user_id=736f9968761742b3b27d3fe669022e29, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:51.217448 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720ef66-94b7-4bad-9f28-a0f6df078b37 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:51.329075 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1027/2011] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:51 2022] PUT /identity/v3/projects/9282428ace994386918c7cd5f5284f51/users/736f9968761742b3b27d3fe669022e29/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:51.333384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe77746-1424-4db2-b40e-33e19ca291a5 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:51.344286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe77746-1424-4db2-b40e-33e19ca291a5 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:51.410007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb883c8-fb50-424f-8437-685d03f4c61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:51.410691 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb883c8-fb50-424f-8437-685d03f4c61d admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:51.410983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb883c8-fb50-424f-8437-685d03f4c61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:51.411261 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb883c8-fb50-424f-8437-685d03f4c61d admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:51.412000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb883c8-fb50-424f-8437-685d03f4c61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:51.413652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb883c8-fb50-424f-8437-685d03f4c61d admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:51.425178 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 985/2012] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:51.429419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720ef66-94b7-4bad-9f28-a0f6df078b37 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:51.440796 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720ef66-94b7-4bad-9f28-a0f6df078b37 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:51.446034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e691ba-3f2a-4512-9292-5c02ec5f80de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:51.446917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e691ba-3f2a-4512-9292-5c02ec5f80de admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:51.447206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e691ba-3f2a-4512-9292-5c02ec5f80de admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:51.447487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e691ba-3f2a-4512-9292-5c02ec5f80de admin admin] PATH_INFO: `/v3/projects/9282428ace994386918c7cd5f5284f51/users/736f9968761742b3b27d3fe669022e29/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:51.449550 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e691ba-3f2a-4512-9292-5c02ec5f80de admin admin] RBAC: Authorizing `identity:create_grant(project_id=9282428ace994386918c7cd5f5284f51, user_id=736f9968761742b3b27d3fe669022e29, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:51.452260 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e691ba-3f2a-4512-9292-5c02ec5f80de admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:51.463185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1028/2013] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:51 2022] PUT /identity/v3/projects/9282428ace994386918c7cd5f5284f51/users/736f9968761742b3b27d3fe669022e29/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:51.474518 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3f41e-619b-482b-ac96-0450ac896941 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:51.475043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3f41e-619b-482b-ac96-0450ac896941 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:51.475478 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3f41e-619b-482b-ac96-0450ac896941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:51.511975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-76a3f41e-619b-482b-ac96-0450ac896941 None None] MFA Rules not processed for user `736f9968761742b3b27d3fe669022e29`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:51.517418 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-76a3f41e-619b-482b-ac96-0450ac896941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:51.541255 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e691ba-3f2a-4512-9292-5c02ec5f80de admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:51.544213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-68e691ba-3f2a-4512-9292-5c02ec5f80de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:51.605731 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 986/2014] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:51.626824 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e691ba-3f2a-4512-9292-5c02ec5f80de admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:51.630736 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8c9f5-4696-4ec6-8262-9ad6f525d125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:51.631501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8c9f5-4696-4ec6-8262-9ad6f525d125 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:51.631792 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8c9f5-4696-4ec6-8262-9ad6f525d125 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:51.637596 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8c9f5-4696-4ec6-8262-9ad6f525d125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:51.639357 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3f41e-619b-482b-ac96-0450ac896941 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:51.640049 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-19e8c9f5-4696-4ec6-8262-9ad6f525d125 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:51.649089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3f41e-619b-482b-ac96-0450ac896941 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:51.653079 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16258dff-488a-4567-8642-270e5b64af66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:51.653862 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16258dff-488a-4567-8642-270e5b64af66 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:51.654151 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16258dff-488a-4567-8642-270e5b64af66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:51.654430 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16258dff-488a-4567-8642-270e5b64af66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:51.664515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16258dff-488a-4567-8642-270e5b64af66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:51.666248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16258dff-488a-4567-8642-270e5b64af66 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:51.677721 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 987/2015] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:51 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:04:51.685906 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:51.713693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8c9f5-4696-4ec6-8262-9ad6f525d125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:51.716200 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8c9f5-4696-4ec6-8262-9ad6f525d125 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:51.729656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1029/2016] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:51 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:04:51.929072 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:52.132096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16258dff-488a-4567-8642-270e5b64af66 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:52.133579 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-16258dff-488a-4567-8642-270e5b64af66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:52.170141 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8c9f5-4696-4ec6-8262-9ad6f525d125 service cinder] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:52.214323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16258dff-488a-4567-8642-270e5b64af66 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:52.217940 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac28c0-8e33-4d0c-a0db-8bdfa0308259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:52.219020 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac28c0-8e33-4d0c-a0db-8bdfa0308259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:52.219318 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac28c0-8e33-4d0c-a0db-8bdfa0308259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:52.219610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac28c0-8e33-4d0c-a0db-8bdfa0308259 admin admin] PATH_INFO: `/v3/users/1aad8ce84ede418d84afdce86f44afa5` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:52.220834 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac28c0-8e33-4d0c-a0db-8bdfa0308259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aad8ce84ede418d84afdce86f44afa5)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:52.222869 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac28c0-8e33-4d0c-a0db-8bdfa0308259 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:52.238288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8c9f5-4696-4ec6-8262-9ad6f525d125 service cinder] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:52.243204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba65de-7792-411c-8f44-dd4e34ae1e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:52.244102 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba65de-7792-411c-8f44-dd4e34ae1e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:52.244386 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba65de-7792-411c-8f44-dd4e34ae1e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:52.244666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba65de-7792-411c-8f44-dd4e34ae1e25 admin admin] PATH_INFO: `/v3/users/c4471e9e4c6d4b2ebdf92cd0947a6b5f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:52.246097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba65de-7792-411c-8f44-dd4e34ae1e25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4471e9e4c6d4b2ebdf92cd0947a6b5f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:52.248113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba65de-7792-411c-8f44-dd4e34ae1e25 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:52.475688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-a5ac28c0-8e33-4d0c-a0db-8bdfa0308259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aad8ce84ede418d84afdce86f44afa5'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:52.476461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-a5ac28c0-8e33-4d0c-a0db-8bdfa0308259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aad8ce84ede418d84afdce86f44afa5'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:52.484615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-a5ac28c0-8e33-4d0c-a0db-8bdfa0308259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aad8ce84ede418d84afdce86f44afa5'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:52.485463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-a5ac28c0-8e33-4d0c-a0db-8bdfa0308259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aad8ce84ede418d84afdce86f44afa5'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:52.504115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-98ba65de-7792-411c-8f44-dd4e34ae1e25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4471e9e4c6d4b2ebdf92cd0947a6b5f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:52.511183 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-98ba65de-7792-411c-8f44-dd4e34ae1e25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4471e9e4c6d4b2ebdf92cd0947a6b5f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:52.512057 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-98ba65de-7792-411c-8f44-dd4e34ae1e25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4471e9e4c6d4b2ebdf92cd0947a6b5f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:52.527023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-98ba65de-7792-411c-8f44-dd4e34ae1e25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4471e9e4c6d4b2ebdf92cd0947a6b5f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:52.527791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-98ba65de-7792-411c-8f44-dd4e34ae1e25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4471e9e4c6d4b2ebdf92cd0947a6b5f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:52.643633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-a5ac28c0-8e33-4d0c-a0db-8bdfa0308259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aad8ce84ede418d84afdce86f44afa5'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:52.674567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 988/2017] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:52 2022] DELETE /identity/v3/users/1aad8ce84ede418d84afdce86f44afa5 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:52.679211 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee5030-6351-46f7-97e7-f11e475c8f91 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:52.679506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee5030-6351-46f7-97e7-f11e475c8f91 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:52.679795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee5030-6351-46f7-97e7-f11e475c8f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:52.700127 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-21ee5030-6351-46f7-97e7-f11e475c8f91 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:52.701425 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-21ee5030-6351-46f7-97e7-f11e475c8f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:52.776775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 989/2018] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:52.788148 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1030/2019] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:52 2022] DELETE /identity/v3/users/c4471e9e4c6d4b2ebdf92cd0947a6b5f => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:52.802463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee5030-6351-46f7-97e7-f11e475c8f91 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:52.802463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-21ee5030-6351-46f7-97e7-f11e475c8f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:52.806067 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575481-1acc-4012-9762-695cd13128bf None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:52.806444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575481-1acc-4012-9762-695cd13128bf None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:52.806803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4575481-1acc-4012-9762-695cd13128bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:52.830162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-e4575481-1acc-4012-9762-695cd13128bf None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:52.831708 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e4575481-1acc-4012-9762-695cd13128bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:52.867964 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee5030-6351-46f7-97e7-f11e475c8f91 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:52.903747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1031/2020] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:52.914219 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4575481-1acc-4012-9762-695cd13128bf None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:52.930722 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c1922-abd5-4588-beb9-59be241aeb35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:52.931775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1922-abd5-4588-beb9-59be241aeb35 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:52.932336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1922-abd5-4588-beb9-59be241aeb35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:52.932697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1922-abd5-4588-beb9-59be241aeb35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:52.944683 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c1922-abd5-4588-beb9-59be241aeb35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:52.946353 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c1922-abd5-4588-beb9-59be241aeb35 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:52.958303 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 990/2021] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:52.982057 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4575481-1acc-4012-9762-695cd13128bf None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:52.986691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c87bc8-6bfb-460b-9235-3a9ec00149a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:52.987363 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c87bc8-6bfb-460b-9235-3a9ec00149a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:52.987656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c87bc8-6bfb-460b-9235-3a9ec00149a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:52.987941 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c87bc8-6bfb-460b-9235-3a9ec00149a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:52.999999 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c87bc8-6bfb-460b-9235-3a9ec00149a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:53.001486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c87bc8-6bfb-460b-9235-3a9ec00149a7 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:53.012851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1032/2022] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:53.625714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c1922-abd5-4588-beb9-59be241aeb35 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:53.628026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b36c1922-abd5-4588-beb9-59be241aeb35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:53.656654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c1922-abd5-4588-beb9-59be241aeb35 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:53.667417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e07a9-ac22-41ee-9028-3c50e1186e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:53.667417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e07a9-ac22-41ee-9028-3c50e1186e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:53.667417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e07a9-ac22-41ee-9028-3c50e1186e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:53.667417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e07a9-ac22-41ee-9028-3c50e1186e32 admin admin] PATH_INFO: `/v3/projects/54560291de484d809f111f1bfe6bc9c4` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:53.668674 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e07a9-ac22-41ee-9028-3c50e1186e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54560291de484d809f111f1bfe6bc9c4)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:53.668674 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e07a9-ac22-41ee-9028-3c50e1186e32 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:53.670675 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c87bc8-6bfb-460b-9235-3a9ec00149a7 service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:53.672526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-96c87bc8-6bfb-460b-9235-3a9ec00149a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:53.711108 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c87bc8-6bfb-460b-9235-3a9ec00149a7 service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:53.728258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e382238-1f8c-4887-8ef1-558ec26164c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:53.729664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e382238-1f8c-4887-8ef1-558ec26164c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:53.730009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e382238-1f8c-4887-8ef1-558ec26164c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:53.730584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e382238-1f8c-4887-8ef1-558ec26164c0 admin admin] PATH_INFO: `/v3/projects/2c667b656a064dc09d2269669fe30f7f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:53.733353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e382238-1f8c-4887-8ef1-558ec26164c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c667b656a064dc09d2269669fe30f7f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:53.735767 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e382238-1f8c-4887-8ef1-558ec26164c0 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:53.779475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:53.913227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4e0e07a9-ac22-41ee-9028-3c50e1186e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54560291de484d809f111f1bfe6bc9c4', 'request_id': 'req-4e0e07a9-ac22-41ee-9028-3c50e1186e32'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:53.919611 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4e0e07a9-ac22-41ee-9028-3c50e1186e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54560291de484d809f111f1bfe6bc9c4', 'request_id': 'req-4e0e07a9-ac22-41ee-9028-3c50e1186e32'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:53.925967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4e0e07a9-ac22-41ee-9028-3c50e1186e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54560291de484d809f111f1bfe6bc9c4', 'request_id': 'req-4e0e07a9-ac22-41ee-9028-3c50e1186e32'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:53.947656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2e382238-1f8c-4887-8ef1-558ec26164c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c667b656a064dc09d2269669fe30f7f', 'request_id': 'req-2e382238-1f8c-4887-8ef1-558ec26164c0'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:53.954751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2e382238-1f8c-4887-8ef1-558ec26164c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c667b656a064dc09d2269669fe30f7f', 'request_id': 'req-2e382238-1f8c-4887-8ef1-558ec26164c0'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:53.961226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2e382238-1f8c-4887-8ef1-558ec26164c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c667b656a064dc09d2269669fe30f7f', 'request_id': 'req-2e382238-1f8c-4887-8ef1-558ec26164c0'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:54.031951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4e0e07a9-ac22-41ee-9028-3c50e1186e32 admin admin] The token cache is being invalidate because project 54560291de484d809f111f1bfe6bc9c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:54.035558 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4e0e07a9-ac22-41ee-9028-3c50e1186e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:54.035558 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4e0e07a9-ac22-41ee-9028-3c50e1186e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:54.035558 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 991/2023] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:53 2022] DELETE /identity/v3/projects/54560291de484d809f111f1bfe6bc9c4 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:54.041875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c026b5-17c3-4919-9504-6ee21bb19a9a None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:54.042354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c026b5-17c3-4919-9504-6ee21bb19a9a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:54.042799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c026b5-17c3-4919-9504-6ee21bb19a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:54.066401 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-59c026b5-17c3-4919-9504-6ee21bb19a9a None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:54.067645 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-59c026b5-17c3-4919-9504-6ee21bb19a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:54.124651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2e382238-1f8c-4887-8ef1-558ec26164c0 admin admin] The token cache is being invalidate because project 2c667b656a064dc09d2269669fe30f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:54.125380 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2e382238-1f8c-4887-8ef1-558ec26164c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:54.126284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2e382238-1f8c-4887-8ef1-558ec26164c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:54.128702 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1033/2024] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:53 2022] DELETE /identity/v3/projects/2c667b656a064dc09d2269669fe30f7f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:54.132475 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e382238-1f8c-4887-8ef1-558ec26164c0 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:54.136373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2e382238-1f8c-4887-8ef1-558ec26164c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:54.137671 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 992/2025] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:54.146851 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03113904-0c9d-4165-971c-2c983470148c None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:54.147215 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03113904-0c9d-4165-971c-2c983470148c None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:54.147666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03113904-0c9d-4165-971c-2c983470148c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:54.153680 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e382238-1f8c-4887-8ef1-558ec26164c0 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:54.159769 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfeda8-4ec5-4b2e-8c43-f4284d40d04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:54.160911 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfeda8-4ec5-4b2e-8c43-f4284d40d04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:54.161238 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfeda8-4ec5-4b2e-8c43-f4284d40d04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:54.161529 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfeda8-4ec5-4b2e-8c43-f4284d40d04f admin admin] PATH_INFO: `/v3/users/736f9968761742b3b27d3fe669022e29` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:54.162923 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfeda8-4ec5-4b2e-8c43-f4284d40d04f admin admin] RBAC: Authorizing `identity:delete_user(user_id=736f9968761742b3b27d3fe669022e29)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:54.165002 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfeda8-4ec5-4b2e-8c43-f4284d40d04f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:54.168271 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-03113904-0c9d-4165-971c-2c983470148c None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:54.169655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-03113904-0c9d-4165-971c-2c983470148c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:54.178830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 993/2026] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:54.183248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03113904-0c9d-4165-971c-2c983470148c None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:54.198946 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03113904-0c9d-4165-971c-2c983470148c None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:54.206081 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5b358-98a7-4831-94f2-beb4a71badb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:54.206772 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5b358-98a7-4831-94f2-beb4a71badb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:54.207092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5b358-98a7-4831-94f2-beb4a71badb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:54.207371 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5b358-98a7-4831-94f2-beb4a71badb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:54.208363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5b358-98a7-4831-94f2-beb4a71badb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:04:54.208702 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5b358-98a7-4831-94f2-beb4a71badb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:54.210509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5b358-98a7-4831-94f2-beb4a71badb6 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:54.230963 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 994/2027] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:04:54.234615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5b358-98a7-4831-94f2-beb4a71badb6 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:54.246278 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5b358-98a7-4831-94f2-beb4a71badb6 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:54.251953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57995ba8-35e0-4d24-b4cd-f2ee195fbe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:54.252848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57995ba8-35e0-4d24-b4cd-f2ee195fbe19 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:54.253156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57995ba8-35e0-4d24-b4cd-f2ee195fbe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:54.253555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57995ba8-35e0-4d24-b4cd-f2ee195fbe19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:54.254681 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57995ba8-35e0-4d24-b4cd-f2ee195fbe19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:54.257008 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57995ba8-35e0-4d24-b4cd-f2ee195fbe19 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:54.405612 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 995/2028] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:54 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:04:54.409653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57995ba8-35e0-4d24-b4cd-f2ee195fbe19 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:54.456367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-32dfeda8-4ec5-4b2e-8c43-f4284d40d04f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '736f9968761742b3b27d3fe669022e29'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:54.463573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-32dfeda8-4ec5-4b2e-8c43-f4284d40d04f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '736f9968761742b3b27d3fe669022e29'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:54.464333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-32dfeda8-4ec5-4b2e-8c43-f4284d40d04f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '736f9968761742b3b27d3fe669022e29'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:54.474461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57995ba8-35e0-4d24-b4cd-f2ee195fbe19 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:54.480548 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-32dfeda8-4ec5-4b2e-8c43-f4284d40d04f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '736f9968761742b3b27d3fe669022e29'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:54.480845 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b062ff-61f5-443a-a1c3-053946c46194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:54.481389 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-32dfeda8-4ec5-4b2e-8c43-f4284d40d04f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '736f9968761742b3b27d3fe669022e29'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:54.482269 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b062ff-61f5-443a-a1c3-053946c46194 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:54.482269 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b062ff-61f5-443a-a1c3-053946c46194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:54.486267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b062ff-61f5-443a-a1c3-053946c46194 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:54.486267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b062ff-61f5-443a-a1c3-053946c46194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:54.486267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b062ff-61f5-443a-a1c3-053946c46194 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:54.586362 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1034/2029] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:54 2022] DELETE /identity/v3/users/736f9968761742b3b27d3fe669022e29 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:54.619788 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 996/2030] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:54 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:54.624673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfeda8-4ec5-4b2e-8c43-f4284d40d04f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:54.626194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-32dfeda8-4ec5-4b2e-8c43-f4284d40d04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:54.710775 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfeda8-4ec5-4b2e-8c43-f4284d40d04f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:54.720348 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78596b44-3155-4087-9221-c196eb0f5c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:54.721051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78596b44-3155-4087-9221-c196eb0f5c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:54.721414 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78596b44-3155-4087-9221-c196eb0f5c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:54.721713 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78596b44-3155-4087-9221-c196eb0f5c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:54.722549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78596b44-3155-4087-9221-c196eb0f5c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:54.728547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78596b44-3155-4087-9221-c196eb0f5c42 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:54.741501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1035/2031] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:54.745768 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b062ff-61f5-443a-a1c3-053946c46194 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:54.761524 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b062ff-61f5-443a-a1c3-053946c46194 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:54.775055 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16db80a-95d7-499a-8301-836490ede94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:54.775776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16db80a-95d7-499a-8301-836490ede94e admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:54.776063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16db80a-95d7-499a-8301-836490ede94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:54.776338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16db80a-95d7-499a-8301-836490ede94e admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:54.777287 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16db80a-95d7-499a-8301-836490ede94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:54.779034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16db80a-95d7-499a-8301-836490ede94e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:54.791006 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 997/2032] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:54.795424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78596b44-3155-4087-9221-c196eb0f5c42 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:54.806962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78596b44-3155-4087-9221-c196eb0f5c42 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:54.812328 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112be7b-439e-454f-bb1f-344285d66b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:54.813253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112be7b-439e-454f-bb1f-344285d66b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:54.813558 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112be7b-439e-454f-bb1f-344285d66b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:54.813871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112be7b-439e-454f-bb1f-344285d66b69 admin admin] PATH_INFO: `/v3/projects/d5889e3e6a584f54a450f7514e0a339d/users/df6048d396ca4cc79818941a46b4d153/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:54.837922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112be7b-439e-454f-bb1f-344285d66b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5889e3e6a584f54a450f7514e0a339d, user_id=df6048d396ca4cc79818941a46b4d153, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:54.840743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112be7b-439e-454f-bb1f-344285d66b69 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:55.044315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:55.052130 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1036/2033] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:54 2022] PUT /identity/v3/projects/d5889e3e6a584f54a450f7514e0a339d/users/df6048d396ca4cc79818941a46b4d153/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:55.064677 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d7ecf-5d41-4e55-970d-406a61ef2481 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:55.065003 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d7ecf-5d41-4e55-970d-406a61ef2481 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:55.065953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d7ecf-5d41-4e55-970d-406a61ef2481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:55.097989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-514d7ecf-5d41-4e55-970d-406a61ef2481 None None] MFA Rules not processed for user `df6048d396ca4cc79818941a46b4d153`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:55.099610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-514d7ecf-5d41-4e55-970d-406a61ef2481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:55.119351 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112be7b-439e-454f-bb1f-344285d66b69 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:55.130646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6112be7b-439e-454f-bb1f-344285d66b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:55.178972 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 998/2034] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:55.183827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d7ecf-5d41-4e55-970d-406a61ef2481 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:55.211052 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112be7b-439e-454f-bb1f-344285d66b69 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:55.215953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e2af0-bdc3-465e-9187-16d4397e91ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:55.216852 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e2af0-bdc3-465e-9187-16d4397e91ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:55.217161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e2af0-bdc3-465e-9187-16d4397e91ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:55.217455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e2af0-bdc3-465e-9187-16d4397e91ad admin admin] PATH_INFO: `/v3/users/872d96f777b44fe086d62431cc985bd4` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:55.219368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e2af0-bdc3-465e-9187-16d4397e91ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=872d96f777b44fe086d62431cc985bd4)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:55.221456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e2af0-bdc3-465e-9187-16d4397e91ad admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:55.261463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d7ecf-5d41-4e55-970d-406a61ef2481 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:55.270812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8c3dc-2d28-4eaa-9514-03279ef483b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:55.281444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8c3dc-2d28-4eaa-9514-03279ef483b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:55.281444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8c3dc-2d28-4eaa-9514-03279ef483b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:55.281444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8c3dc-2d28-4eaa-9514-03279ef483b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:55.281444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8c3dc-2d28-4eaa-9514-03279ef483b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:55.281444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8c3dc-2d28-4eaa-9514-03279ef483b6 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:55.424796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 999/2035] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:55 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:04:55.424796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8c3dc-2d28-4eaa-9514-03279ef483b6 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:55.424796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-8fb8c3dc-2d28-4eaa-9514-03279ef483b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:55.493982 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8c3dc-2d28-4eaa-9514-03279ef483b6 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:55.498735 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ac12f-eab8-412a-99d5-692d06ce538b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:55.500287 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ac12f-eab8-412a-99d5-692d06ce538b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:55.500500 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ac12f-eab8-412a-99d5-692d06ce538b admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:55.500776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ac12f-eab8-412a-99d5-692d06ce538b admin admin] PATH_INFO: `/v3/projects/9282428ace994386918c7cd5f5284f51` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:55.502231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ac12f-eab8-412a-99d5-692d06ce538b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9282428ace994386918c7cd5f5284f51)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:55.504349 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ac12f-eab8-412a-99d5-692d06ce538b admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:55.662473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-565e2af0-bdc3-465e-9187-16d4397e91ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872d96f777b44fe086d62431cc985bd4'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:55.671269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-565e2af0-bdc3-465e-9187-16d4397e91ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872d96f777b44fe086d62431cc985bd4'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:55.672561 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-565e2af0-bdc3-465e-9187-16d4397e91ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872d96f777b44fe086d62431cc985bd4'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:55.688928 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2d5ac12f-eab8-412a-99d5-692d06ce538b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9282428ace994386918c7cd5f5284f51', 'request_id': 'req-2d5ac12f-eab8-412a-99d5-692d06ce538b'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:55.693816 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-565e2af0-bdc3-465e-9187-16d4397e91ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872d96f777b44fe086d62431cc985bd4'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:55.694603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-565e2af0-bdc3-465e-9187-16d4397e91ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872d96f777b44fe086d62431cc985bd4'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:55.695602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2d5ac12f-eab8-412a-99d5-692d06ce538b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9282428ace994386918c7cd5f5284f51', 'request_id': 'req-2d5ac12f-eab8-412a-99d5-692d06ce538b'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:55.701441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2d5ac12f-eab8-412a-99d5-692d06ce538b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9282428ace994386918c7cd5f5284f51', 'request_id': 'req-2d5ac12f-eab8-412a-99d5-692d06ce538b'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:55.853190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1037/2036] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:55 2022] DELETE /identity/v3/users/872d96f777b44fe086d62431cc985bd4 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:55.854290 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e2af0-bdc3-465e-9187-16d4397e91ad admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:55.855741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-565e2af0-bdc3-465e-9187-16d4397e91ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:55.915311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2d5ac12f-eab8-412a-99d5-692d06ce538b admin admin] The token cache is being invalidate because project 9282428ace994386918c7cd5f5284f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:55.916242 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2d5ac12f-eab8-412a-99d5-692d06ce538b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:55.916912 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2d5ac12f-eab8-412a-99d5-692d06ce538b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:55.922048 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1000/2037] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:55 2022] DELETE /identity/v3/projects/9282428ace994386918c7cd5f5284f51 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:55.922048 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d37008-cb69-4d02-b236-7b598746d5c9 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:55.922048 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d37008-cb69-4d02-b236-7b598746d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:55.922048 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d37008-cb69-4d02-b236-7b598746d5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:55.933704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e2af0-bdc3-465e-9187-16d4397e91ad admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:55.939463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43dd42-b91d-4a50-b32c-98231528e096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:55.940162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43dd42-b91d-4a50-b32c-98231528e096 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:55.940278 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-54d37008-cb69-4d02-b236-7b598746d5c9 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:55.940450 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43dd42-b91d-4a50-b32c-98231528e096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:55.940729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43dd42-b91d-4a50-b32c-98231528e096 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:55.941476 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43dd42-b91d-4a50-b32c-98231528e096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:55.941681 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-54d37008-cb69-4d02-b236-7b598746d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:55.943425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43dd42-b91d-4a50-b32c-98231528e096 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:55.949887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1001/2038] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:55.951030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fec2c-19d4-4857-889c-80d25ea15ee7 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:55.951804 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fec2c-19d4-4857-889c-80d25ea15ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:55.951804 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fec2c-19d4-4857-889c-80d25ea15ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:55.973187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-e10fec2c-19d4-4857-889c-80d25ea15ee7 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:55.974645 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e10fec2c-19d4-4857-889c-80d25ea15ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:55.983370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1002/2039] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:55.984250 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fec2c-19d4-4857-889c-80d25ea15ee7 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:55.985562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e10fec2c-19d4-4857-889c-80d25ea15ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:56.023500 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:56.052672 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fec2c-19d4-4857-889c-80d25ea15ee7 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:56.055451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1038/2040] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:55 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:56.057108 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208f155-0ea7-4f8a-91dd-cda98fe5042b None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:56.057532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208f155-0ea7-4f8a-91dd-cda98fe5042b None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:56.057921 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208f155-0ea7-4f8a-91dd-cda98fe5042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:56.060591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6002b-679d-471a-ad9a-d99271dba69f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:56.061307 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6002b-679d-471a-ad9a-d99271dba69f service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:56.061643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6002b-679d-471a-ad9a-d99271dba69f service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:56.061931 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6002b-679d-471a-ad9a-d99271dba69f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:56.077695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6002b-679d-471a-ad9a-d99271dba69f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:56.079011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-e208f155-0ea7-4f8a-91dd-cda98fe5042b None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:56.079129 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6002b-679d-471a-ad9a-d99271dba69f service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:56.080378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e208f155-0ea7-4f8a-91dd-cda98fe5042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:56.091515 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1039/2041] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:56.092913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208f155-0ea7-4f8a-91dd-cda98fe5042b None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:56.095003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e208f155-0ea7-4f8a-91dd-cda98fe5042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:56.097056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1003/2042] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:56.098079 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6002b-679d-471a-ad9a-d99271dba69f service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:56.108344 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208f155-0ea7-4f8a-91dd-cda98fe5042b None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:56.109269 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6002b-679d-471a-ad9a-d99271dba69f service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:56.113781 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10312e6d-4b6b-45fc-80b8-7f8d80dcbb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:56.114210 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3e3fb-a4b9-425c-b26e-732c154300d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:56.114469 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312e6d-4b6b-45fc-80b8-7f8d80dcbb80 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:56.114885 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3e3fb-a4b9-425c-b26e-732c154300d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:56.115348 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3e3fb-a4b9-425c-b26e-732c154300d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:56.115468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312e6d-4b6b-45fc-80b8-7f8d80dcbb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:56.115673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10312e6d-4b6b-45fc-80b8-7f8d80dcbb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:56.116057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3e3fb-a4b9-425c-b26e-732c154300d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:56.116425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10312e6d-4b6b-45fc-80b8-7f8d80dcbb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:56.116804 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3e3fb-a4b9-425c-b26e-732c154300d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:04:56.117117 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3e3fb-a4b9-425c-b26e-732c154300d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:56.118120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10312e6d-4b6b-45fc-80b8-7f8d80dcbb80 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:56.118785 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3e3fb-a4b9-425c-b26e-732c154300d9 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:56.130981 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1040/2043] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:56.133276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1004/2044] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:04:56.135710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10312e6d-4b6b-45fc-80b8-7f8d80dcbb80 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:56.147240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3e3fb-a4b9-425c-b26e-732c154300d9 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:56.158067 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10312e6d-4b6b-45fc-80b8-7f8d80dcbb80 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:56.159873 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3e3fb-a4b9-425c-b26e-732c154300d9 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:56.165646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c60273-4244-456b-8dda-9b9184b304d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:56.169679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ef381-e01d-451a-ac9f-dd91bf4e191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:56.169852 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60273-4244-456b-8dda-9b9184b304d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:56.169967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ef381-e01d-451a-ac9f-dd91bf4e191a admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:56.170060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60273-4244-456b-8dda-9b9184b304d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:56.170147 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ef381-e01d-451a-ac9f-dd91bf4e191a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:56.170255 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c60273-4244-456b-8dda-9b9184b304d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:56.170342 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ef381-e01d-451a-ac9f-dd91bf4e191a admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:56.170489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c60273-4244-456b-8dda-9b9184b304d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:56.170628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ef381-e01d-451a-ac9f-dd91bf4e191a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:56.170759 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c60273-4244-456b-8dda-9b9184b304d7 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:56.172204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ef381-e01d-451a-ac9f-dd91bf4e191a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:56.189326 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1041/2045] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:04:56.191447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c60273-4244-456b-8dda-9b9184b304d7 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:56.205063 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c60273-4244-456b-8dda-9b9184b304d7 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:56.218500 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e29e8-6b75-4e68-b5d7-4b4d923cf800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:56.220398 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e29e8-6b75-4e68-b5d7-4b4d923cf800 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:56.221294 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e29e8-6b75-4e68-b5d7-4b4d923cf800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:56.221294 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e29e8-6b75-4e68-b5d7-4b4d923cf800 admin admin] PATH_INFO: `/v3/projects/ad5898f8921d4ea78163f0c2b1c1f8c9/users/d9ee8c3d3084450c8f64775474d8d4c7/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:56.251424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e29e8-6b75-4e68-b5d7-4b4d923cf800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5898f8921d4ea78163f0c2b1c1f8c9, user_id=d9ee8c3d3084450c8f64775474d8d4c7, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:56.255203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e29e8-6b75-4e68-b5d7-4b4d923cf800 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:56.289936 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1005/2046] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:56 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:04:56.294410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ef381-e01d-451a-ac9f-dd91bf4e191a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:56.371939 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ef381-e01d-451a-ac9f-dd91bf4e191a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:56.387060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1042/2047] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:56 2022] PUT /identity/v3/projects/ad5898f8921d4ea78163f0c2b1c1f8c9/users/d9ee8c3d3084450c8f64775474d8d4c7/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:56.388633 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072073b-801c-4039-a721-c369c831de8a None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:56.389355 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072073b-801c-4039-a721-c369c831de8a None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:56.389355 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072073b-801c-4039-a721-c369c831de8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:56.422728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-f072073b-801c-4039-a721-c369c831de8a None None] MFA Rules not processed for user `d9ee8c3d3084450c8f64775474d8d4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:56.424125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-f072073b-801c-4039-a721-c369c831de8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:56.458221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7b7bb-e468-483f-9d94-19c6bf7a5760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:56.459089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7b7bb-e468-483f-9d94-19c6bf7a5760 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:56.459375 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7b7bb-e468-483f-9d94-19c6bf7a5760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:56.459656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7b7bb-e468-483f-9d94-19c6bf7a5760 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:56.460364 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7b7bb-e468-483f-9d94-19c6bf7a5760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:56.463178 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7b7bb-e468-483f-9d94-19c6bf7a5760 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:56.516066 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1043/2048] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:56.520557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072073b-801c-4039-a721-c369c831de8a None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:56.532437 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072073b-801c-4039-a721-c369c831de8a None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:56.537012 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf973b0f-1be8-4c02-86da-7e64a6a91ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:56.537815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf973b0f-1be8-4c02-86da-7e64a6a91ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:56.538108 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf973b0f-1be8-4c02-86da-7e64a6a91ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:56.538391 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf973b0f-1be8-4c02-86da-7e64a6a91ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:56.539120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf973b0f-1be8-4c02-86da-7e64a6a91ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:56.541071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf973b0f-1be8-4c02-86da-7e64a6a91ee7 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:56.581666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1006/2049] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:56 2022] POST /identity/v3/users => generated 286 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:04:56.593066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7b7bb-e468-483f-9d94-19c6bf7a5760 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:56.596488 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7b7bb-e468-483f-9d94-19c6bf7a5760 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:56.602942 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275fe0d-764a-42f9-a105-7cfa8118fab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:56.603859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275fe0d-764a-42f9-a105-7cfa8118fab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:56.604231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275fe0d-764a-42f9-a105-7cfa8118fab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:56.604587 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275fe0d-764a-42f9-a105-7cfa8118fab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:56.605509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275fe0d-764a-42f9-a105-7cfa8118fab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:56.609334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275fe0d-764a-42f9-a105-7cfa8118fab5 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:56.620752 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1007/2050] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:04:56.625568 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275fe0d-764a-42f9-a105-7cfa8118fab5 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:56.638305 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275fe0d-764a-42f9-a105-7cfa8118fab5 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:56.646678 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9032f-7a9f-436d-8b2b-8f57d756a9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:56.647701 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9032f-7a9f-436d-8b2b-8f57d756a9ff admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:56.648098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9032f-7a9f-436d-8b2b-8f57d756a9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:56.648970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9032f-7a9f-436d-8b2b-8f57d756a9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:56.649791 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9032f-7a9f-436d-8b2b-8f57d756a9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:56.652201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9032f-7a9f-436d-8b2b-8f57d756a9ff admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:56.663802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1008/2051] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:04:56.668028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9032f-7a9f-436d-8b2b-8f57d756a9ff admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:56.679402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9032f-7a9f-436d-8b2b-8f57d756a9ff admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:56.684652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80541329-40c1-4086-bc1c-09ec024bab2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:56.685657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80541329-40c1-4086-bc1c-09ec024bab2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:56.685951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80541329-40c1-4086-bc1c-09ec024bab2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:56.686346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80541329-40c1-4086-bc1c-09ec024bab2f admin admin] PATH_INFO: `/v3/projects/835dc68aefd94fbdbeae078bd12db021/users/b8f9c8d3308a4273b801238c2f36d426/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:56.706888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80541329-40c1-4086-bc1c-09ec024bab2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=835dc68aefd94fbdbeae078bd12db021, user_id=b8f9c8d3308a4273b801238c2f36d426, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:56.709954 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80541329-40c1-4086-bc1c-09ec024bab2f admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:56.728147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1044/2052] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:56 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:04:56.729585 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf973b0f-1be8-4c02-86da-7e64a6a91ee7 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:56.731626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-cf973b0f-1be8-4c02-86da-7e64a6a91ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:56.814413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf973b0f-1be8-4c02-86da-7e64a6a91ee7 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:56.819437 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f3807-3af0-4451-90d0-c0308cf04bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:56.820310 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3807-3af0-4451-90d0-c0308cf04bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:56.820592 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3807-3af0-4451-90d0-c0308cf04bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:56.820866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3807-3af0-4451-90d0-c0308cf04bbf admin admin] PATH_INFO: `/v3/projects/b994239165fc429eb74eb2a61143aa6b` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:56.822095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f3807-3af0-4451-90d0-c0308cf04bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b994239165fc429eb74eb2a61143aa6b)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:56.824036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f3807-3af0-4451-90d0-c0308cf04bbf admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:56.835229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1009/2053] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:56 2022] PUT /identity/v3/projects/835dc68aefd94fbdbeae078bd12db021/users/b8f9c8d3308a4273b801238c2f36d426/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:56.836245 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80541329-40c1-4086-bc1c-09ec024bab2f admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:56.908840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80541329-40c1-4086-bc1c-09ec024bab2f admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:56.913837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48713b-8db6-4367-9982-7698c9791b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:56.914626 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48713b-8db6-4367-9982-7698c9791b8d admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:56.914916 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48713b-8db6-4367-9982-7698c9791b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:56.915222 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48713b-8db6-4367-9982-7698c9791b8d admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:56.915940 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48713b-8db6-4367-9982-7698c9791b8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:56.917924 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48713b-8db6-4367-9982-7698c9791b8d admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:57.170119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-097f3807-3af0-4451-90d0-c0308cf04bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b994239165fc429eb74eb2a61143aa6b', 'request_id': 'req-097f3807-3af0-4451-90d0-c0308cf04bbf'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:57.176735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-097f3807-3af0-4451-90d0-c0308cf04bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b994239165fc429eb74eb2a61143aa6b', 'request_id': 'req-097f3807-3af0-4451-90d0-c0308cf04bbf'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:57.182314 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-097f3807-3af0-4451-90d0-c0308cf04bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b994239165fc429eb74eb2a61143aa6b', 'request_id': 'req-097f3807-3af0-4451-90d0-c0308cf04bbf'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:57.227548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1010/2054] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:56 2022] POST /identity/v3/users => generated 299 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:57.228956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d96bb-dddb-412e-a96e-ac8fb6e86135 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:57.229401 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d96bb-dddb-412e-a96e-ac8fb6e86135 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:57.229601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d96bb-dddb-412e-a96e-ac8fb6e86135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:57.264544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-4d7d96bb-dddb-412e-a96e-ac8fb6e86135 None None] MFA Rules not processed for user `b8f9c8d3308a4273b801238c2f36d426`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:57.265930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4d7d96bb-dddb-412e-a96e-ac8fb6e86135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:57.300137 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-097f3807-3af0-4451-90d0-c0308cf04bbf admin admin] The token cache is being invalidate because project b994239165fc429eb74eb2a61143aa6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:57.300618 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-097f3807-3af0-4451-90d0-c0308cf04bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:57.301796 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-097f3807-3af0-4451-90d0-c0308cf04bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:57.304443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1045/2055] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:56 2022] DELETE /identity/v3/projects/b994239165fc429eb74eb2a61143aa6b => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:57.304443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f3807-3af0-4451-90d0-c0308cf04bbf admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:57.306298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-097f3807-3af0-4451-90d0-c0308cf04bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:57.344467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1011/2056] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:57.344467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d96bb-dddb-412e-a96e-ac8fb6e86135 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:57.344467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4d7d96bb-dddb-412e-a96e-ac8fb6e86135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:57.386059 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f3807-3af0-4451-90d0-c0308cf04bbf admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:57.393254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416af65-b24e-4077-9d2f-120489b2e769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:57.394005 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416af65-b24e-4077-9d2f-120489b2e769 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:57.394296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416af65-b24e-4077-9d2f-120489b2e769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:57.394579 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416af65-b24e-4077-9d2f-120489b2e769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:57.396151 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416af65-b24e-4077-9d2f-120489b2e769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:57.397917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416af65-b24e-4077-9d2f-120489b2e769 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:57.418548 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1046/2057] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:57.418548 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416af65-b24e-4077-9d2f-120489b2e769 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:57.419525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9416af65-b24e-4077-9d2f-120489b2e769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:57.434796 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416af65-b24e-4077-9d2f-120489b2e769 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:57.437635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d96bb-dddb-412e-a96e-ac8fb6e86135 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:57.440286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa7e58-010f-4023-85c7-5ef3c2ed3ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:57.441114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa7e58-010f-4023-85c7-5ef3c2ed3ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:57.441506 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa7e58-010f-4023-85c7-5ef3c2ed3ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:57.441858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa7e58-010f-4023-85c7-5ef3c2ed3ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:57.443274 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa7e58-010f-4023-85c7-5ef3c2ed3ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:57.443674 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999f76b-05a6-4e71-b553-c445dd2b9aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:57.449465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999f76b-05a6-4e71-b553-c445dd2b9aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:57.449465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999f76b-05a6-4e71-b553-c445dd2b9aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:57.449465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999f76b-05a6-4e71-b553-c445dd2b9aa5 admin admin] PATH_INFO: `/v3/users/9891b950e9aa488fa83ffe8cc99df2c1` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:57.449769 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa7e58-010f-4023-85c7-5ef3c2ed3ae2 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:57.449862 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999f76b-05a6-4e71-b553-c445dd2b9aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9891b950e9aa488fa83ffe8cc99df2c1)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:57.449862 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999f76b-05a6-4e71-b553-c445dd2b9aa5 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:57.612412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1047/2058] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:57 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:57.613686 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa7e58-010f-4023-85c7-5ef3c2ed3ae2 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:57.684903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa7e58-010f-4023-85c7-5ef3c2ed3ae2 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:57.689876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443f67f-56f8-4da9-b5f7-415517bea819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:57.691103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443f67f-56f8-4da9-b5f7-415517bea819 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:57.691393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443f67f-56f8-4da9-b5f7-415517bea819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:57.691675 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443f67f-56f8-4da9-b5f7-415517bea819 admin admin] PATH_INFO: `/v3/projects/022a09fe38594d80a896488a74b29474/users/6784d260900742ce96ebc7346ee6d71f/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:57.713967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443f67f-56f8-4da9-b5f7-415517bea819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=022a09fe38594d80a896488a74b29474, user_id=6784d260900742ce96ebc7346ee6d71f, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:57.717179 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443f67f-56f8-4da9-b5f7-415517bea819 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:57.739472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:57.776237 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c999f76b-05a6-4e71-b553-c445dd2b9aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9891b950e9aa488fa83ffe8cc99df2c1'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:57.777096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c999f76b-05a6-4e71-b553-c445dd2b9aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9891b950e9aa488fa83ffe8cc99df2c1'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:57.786874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c999f76b-05a6-4e71-b553-c445dd2b9aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9891b950e9aa488fa83ffe8cc99df2c1'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:57.787780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c999f76b-05a6-4e71-b553-c445dd2b9aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9891b950e9aa488fa83ffe8cc99df2c1'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:57.818150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1048/2059] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:57 2022] PUT /identity/v3/projects/022a09fe38594d80a896488a74b29474/users/6784d260900742ce96ebc7346ee6d71f/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:57.818815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443f67f-56f8-4da9-b5f7-415517bea819 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:57.820412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-7443f67f-56f8-4da9-b5f7-415517bea819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:57.888918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c999f76b-05a6-4e71-b553-c445dd2b9aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9891b950e9aa488fa83ffe8cc99df2c1'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:57.898724 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443f67f-56f8-4da9-b5f7-415517bea819 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:57.906460 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1c87c-84b3-409e-93aa-05b5809c1d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:57.908079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1c87c-84b3-409e-93aa-05b5809c1d5a admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:57.908758 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1c87c-84b3-409e-93aa-05b5809c1d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:57.909502 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1c87c-84b3-409e-93aa-05b5809c1d5a admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:57.910729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1c87c-84b3-409e-93aa-05b5809c1d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:57.913174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1c87c-84b3-409e-93aa-05b5809c1d5a admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:57.916849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1012/2060] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:04:57 2022] DELETE /identity/v3/users/9891b950e9aa488fa83ffe8cc99df2c1 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:57.916849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999f76b-05a6-4e71-b553-c445dd2b9aa5 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:57.933579 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c999f76b-05a6-4e71-b553-c445dd2b9aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:58.018573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1049/2061] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:57 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:04:58.020265 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1c87c-84b3-409e-93aa-05b5809c1d5a admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:58.042344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999f76b-05a6-4e71-b553-c445dd2b9aa5 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:58.042492 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1c87c-84b3-409e-93aa-05b5809c1d5a admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:58.048870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b7744-fe9a-4fed-b593-7de4bb7b34c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:58.049906 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b7744-fe9a-4fed-b593-7de4bb7b34c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:58.050348 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b7744-fe9a-4fed-b593-7de4bb7b34c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:58.050790 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b7744-fe9a-4fed-b593-7de4bb7b34c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:58.051705 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b7744-fe9a-4fed-b593-7de4bb7b34c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:58.053571 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b7744-fe9a-4fed-b593-7de4bb7b34c9 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:58.057903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84463b3b-7e43-45a1-b32c-ed38c79bce8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:58.059023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84463b3b-7e43-45a1-b32c-ed38c79bce8d admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:58.059522 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84463b3b-7e43-45a1-b32c-ed38c79bce8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:58.060029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84463b3b-7e43-45a1-b32c-ed38c79bce8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:58.061479 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84463b3b-7e43-45a1-b32c-ed38c79bce8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:58.064409 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84463b3b-7e43-45a1-b32c-ed38c79bce8d admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:58.065648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1013/2062] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:58.077084 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b7744-fe9a-4fed-b593-7de4bb7b34c9 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:58.089034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b7744-fe9a-4fed-b593-7de4bb7b34c9 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:58.089275 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1050/2063] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:58.090837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84463b3b-7e43-45a1-b32c-ed38c79bce8d admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:58.096567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54136197-ba4f-431b-9c2c-88087132ab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:58.097758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54136197-ba4f-431b-9c2c-88087132ab9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:58.098189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54136197-ba4f-431b-9c2c-88087132ab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:58.099176 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54136197-ba4f-431b-9c2c-88087132ab9a admin admin] PATH_INFO: `/v3/projects/022a09fe38594d80a896488a74b29474/users/6784d260900742ce96ebc7346ee6d71f/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:58.101569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54136197-ba4f-431b-9c2c-88087132ab9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=022a09fe38594d80a896488a74b29474, user_id=6784d260900742ce96ebc7346ee6d71f, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:58.103479 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84463b3b-7e43-45a1-b32c-ed38c79bce8d admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:58.107122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54136197-ba4f-431b-9c2c-88087132ab9a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:58.110771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e137a7-b677-4b14-bf7d-7bf08af40189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:58.112152 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e137a7-b677-4b14-bf7d-7bf08af40189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:58.112587 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e137a7-b677-4b14-bf7d-7bf08af40189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:58.113010 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e137a7-b677-4b14-bf7d-7bf08af40189 admin admin] PATH_INFO: `/v3/projects/92d6611875ad48edb91adfa04ea111b5/users/bc5c8d2578944fd08dfdc0668445de8d/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:58.131094 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e137a7-b677-4b14-bf7d-7bf08af40189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d6611875ad48edb91adfa04ea111b5, user_id=bc5c8d2578944fd08dfdc0668445de8d, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:58.132453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1014/2064] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:58 2022] PUT /identity/v3/projects/022a09fe38594d80a896488a74b29474/users/6784d260900742ce96ebc7346ee6d71f/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:58.133931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e137a7-b677-4b14-bf7d-7bf08af40189 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:58.144495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b62d4-18d3-45e6-accb-9299b9a02dc8 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:58.144880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b62d4-18d3-45e6-accb-9299b9a02dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:58.145205 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b62d4-18d3-45e6-accb-9299b9a02dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:58.175505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-d61b62d4-18d3-45e6-accb-9299b9a02dc8 None None] MFA Rules not processed for user `6784d260900742ce96ebc7346ee6d71f`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:58.177415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d61b62d4-18d3-45e6-accb-9299b9a02dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:58.251811 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1051/2065] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:58 2022] PUT /identity/v3/projects/92d6611875ad48edb91adfa04ea111b5/users/bc5c8d2578944fd08dfdc0668445de8d/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:58.258221 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e137a7-b677-4b14-bf7d-7bf08af40189 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:58.276516 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1015/2066] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:04:58.298672 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b62d4-18d3-45e6-accb-9299b9a02dc8 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:58.300690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d61b62d4-18d3-45e6-accb-9299b9a02dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:58.389514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e137a7-b677-4b14-bf7d-7bf08af40189 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:58.391117 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b62d4-18d3-45e6-accb-9299b9a02dc8 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:58.395931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b540c9-ad49-48dd-812a-8e2d58bd4a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:58.396537 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b540c9-ad49-48dd-812a-8e2d58bd4a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:58.396822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b540c9-ad49-48dd-812a-8e2d58bd4a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:58.397414 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b540c9-ad49-48dd-812a-8e2d58bd4a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:58.398213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b540c9-ad49-48dd-812a-8e2d58bd4a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:58.399903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b540c9-ad49-48dd-812a-8e2d58bd4a4e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:58.411739 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1052/2067] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:58.415880 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b540c9-ad49-48dd-812a-8e2d58bd4a4e admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:58.432241 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b540c9-ad49-48dd-812a-8e2d58bd4a4e admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:58.437943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180b006-0dfb-44b6-b3f4-30d5e04dcadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:58.439393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180b006-0dfb-44b6-b3f4-30d5e04dcadb admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:58.439774 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180b006-0dfb-44b6-b3f4-30d5e04dcadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:58.440155 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180b006-0dfb-44b6-b3f4-30d5e04dcadb admin admin] PATH_INFO: `/v3/projects/92d6611875ad48edb91adfa04ea111b5/users/bc5c8d2578944fd08dfdc0668445de8d/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:58.442646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180b006-0dfb-44b6-b3f4-30d5e04dcadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d6611875ad48edb91adfa04ea111b5, user_id=bc5c8d2578944fd08dfdc0668445de8d, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:58.445610 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180b006-0dfb-44b6-b3f4-30d5e04dcadb admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:58.459454 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e45e9-9444-4642-9d76-b8d8d0f69c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:58.460728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e45e9-9444-4642-9d76-b8d8d0f69c37 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:58.470055 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e45e9-9444-4642-9d76-b8d8d0f69c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:58.470254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1053/2068] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:58 2022] PUT /identity/v3/projects/92d6611875ad48edb91adfa04ea111b5/users/bc5c8d2578944fd08dfdc0668445de8d/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:04:58.470338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e45e9-9444-4642-9d76-b8d8d0f69c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:58.470338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-876e45e9-9444-4642-9d76-b8d8d0f69c37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:58.472922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304cdf1-f43a-4a6e-a70b-602728adef58 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:58.473244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304cdf1-f43a-4a6e-a70b-602728adef58 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:58.479933 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304cdf1-f43a-4a6e-a70b-602728adef58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:58.509062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-1304cdf1-f43a-4a6e-a70b-602728adef58 None None] MFA Rules not processed for user `bc5c8d2578944fd08dfdc0668445de8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:58.511554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-1304cdf1-f43a-4a6e-a70b-602728adef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:58.550596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e45e9-9444-4642-9d76-b8d8d0f69c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:58.552337 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e45e9-9444-4642-9d76-b8d8d0f69c37 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:58.567485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1016/2069] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:04:58.617425 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e45e9-9444-4642-9d76-b8d8d0f69c37 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:58.619508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-876e45e9-9444-4642-9d76-b8d8d0f69c37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:58.636695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e45e9-9444-4642-9d76-b8d8d0f69c37 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:58.658971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1054/2070] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:58.704104 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304cdf1-f43a-4a6e-a70b-602728adef58 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:58.705751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-1304cdf1-f43a-4a6e-a70b-602728adef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:58.752407 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5ed94-c95f-4e68-9ff2-3b0fb50f60ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:58.753858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5ed94-c95f-4e68-9ff2-3b0fb50f60ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:58.754343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5ed94-c95f-4e68-9ff2-3b0fb50f60ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:58.754722 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5ed94-c95f-4e68-9ff2-3b0fb50f60ea admin admin] PATH_INFO: `/v3/projects/1cc5466b36324893a145a4e872fc5e2a` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:58.756548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5ed94-c95f-4e68-9ff2-3b0fb50f60ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc5466b36324893a145a4e872fc5e2a)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:58.758574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5ed94-c95f-4e68-9ff2-3b0fb50f60ea admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:58.778963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304cdf1-f43a-4a6e-a70b-602728adef58 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:58.786478 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19f4ca-2e12-496a-a2a0-1e5a569f2f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:58.787536 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19f4ca-2e12-496a-a2a0-1e5a569f2f2c service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:58.787982 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19f4ca-2e12-496a-a2a0-1e5a569f2f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:58.788401 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19f4ca-2e12-496a-a2a0-1e5a569f2f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:58.800935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19f4ca-2e12-496a-a2a0-1e5a569f2f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:58.804671 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19f4ca-2e12-496a-a2a0-1e5a569f2f2c service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:58.815734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1055/2071] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:04:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:04:58.972519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b7f5ed94-c95f-4e68-9ff2-3b0fb50f60ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc5466b36324893a145a4e872fc5e2a', 'request_id': 'req-b7f5ed94-c95f-4e68-9ff2-3b0fb50f60ea'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:58.981937 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b7f5ed94-c95f-4e68-9ff2-3b0fb50f60ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc5466b36324893a145a4e872fc5e2a', 'request_id': 'req-b7f5ed94-c95f-4e68-9ff2-3b0fb50f60ea'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:58.988774 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b7f5ed94-c95f-4e68-9ff2-3b0fb50f60ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc5466b36324893a145a4e872fc5e2a', 'request_id': 'req-b7f5ed94-c95f-4e68-9ff2-3b0fb50f60ea'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:59.149875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b7f5ed94-c95f-4e68-9ff2-3b0fb50f60ea admin admin] The token cache is being invalidate because project 1cc5466b36324893a145a4e872fc5e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:04:59.150174 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b7f5ed94-c95f-4e68-9ff2-3b0fb50f60ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:59.153510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b7f5ed94-c95f-4e68-9ff2-3b0fb50f60ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:04:59.153510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1017/2072] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:04:58 2022] DELETE /identity/v3/projects/1cc5466b36324893a145a4e872fc5e2a => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:04:59.158560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538c61b-8c36-494b-af46-85f1fa949652 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:59.158854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538c61b-8c36-494b-af46-85f1fa949652 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:59.159137 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538c61b-8c36-494b-af46-85f1fa949652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:59.184245 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-a538c61b-8c36-494b-af46-85f1fa949652 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:59.186260 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a538c61b-8c36-494b-af46-85f1fa949652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:59.273575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1056/2073] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:59.279532 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606bb0a-2eac-4d9a-bd16-276921d50a1f None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:59.279833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606bb0a-2eac-4d9a-bd16-276921d50a1f None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:59.280111 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606bb0a-2eac-4d9a-bd16-276921d50a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:59.300201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-6606bb0a-2eac-4d9a-bd16-276921d50a1f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:04:59.301985 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-6606bb0a-2eac-4d9a-bd16-276921d50a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:04:59.314925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1018/2074] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:04:59.316326 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538c61b-8c36-494b-af46-85f1fa949652 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:59.332483 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538c61b-8c36-494b-af46-85f1fa949652 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:59.337696 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151abe8-ab35-45f7-bd7f-820b59dcd7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:59.338417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151abe8-ab35-45f7-bd7f-820b59dcd7cd admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:59.338700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151abe8-ab35-45f7-bd7f-820b59dcd7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:59.338979 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151abe8-ab35-45f7-bd7f-820b59dcd7cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:59.339712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151abe8-ab35-45f7-bd7f-820b59dcd7cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:04:59.340023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151abe8-ab35-45f7-bd7f-820b59dcd7cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:59.341658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151abe8-ab35-45f7-bd7f-820b59dcd7cd admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:59.355531 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1057/2075] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:04:59.362690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606bb0a-2eac-4d9a-bd16-276921d50a1f None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:59.372038 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606bb0a-2eac-4d9a-bd16-276921d50a1f None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:59.377781 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df284627-1b13-4d78-aed8-f6796169110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:59.378774 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df284627-1b13-4d78-aed8-f6796169110c admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:59.379124 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df284627-1b13-4d78-aed8-f6796169110c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:59.379564 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df284627-1b13-4d78-aed8-f6796169110c admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:59.380287 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df284627-1b13-4d78-aed8-f6796169110c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:59.382240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df284627-1b13-4d78-aed8-f6796169110c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:59.489503 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1019/2076] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:04:59 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:04:59.490939 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151abe8-ab35-45f7-bd7f-820b59dcd7cd admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:59.502255 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151abe8-ab35-45f7-bd7f-820b59dcd7cd admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:59.568422 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8505061-0d74-465f-87ca-686423dded11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:59.569110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8505061-0d74-465f-87ca-686423dded11 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:59.569425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8505061-0d74-465f-87ca-686423dded11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:59.569709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8505061-0d74-465f-87ca-686423dded11 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:59.570421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8505061-0d74-465f-87ca-686423dded11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:59.573301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8505061-0d74-465f-87ca-686423dded11 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:59.725650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1058/2077] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:04:59 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:04:59.745509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df284627-1b13-4d78-aed8-f6796169110c admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:59.759135 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df284627-1b13-4d78-aed8-f6796169110c admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:59.765256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19711e79-707c-411b-8b14-90823952f786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:59.766676 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19711e79-707c-411b-8b14-90823952f786 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:59.766676 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19711e79-707c-411b-8b14-90823952f786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:59.766676 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19711e79-707c-411b-8b14-90823952f786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:59.792490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19711e79-707c-411b-8b14-90823952f786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:59.792490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19711e79-707c-411b-8b14-90823952f786 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:59.792490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1020/2078] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:59.795383 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8505061-0d74-465f-87ca-686423dded11 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:59.807625 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8505061-0d74-465f-87ca-686423dded11 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:59.813087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb03a43-3e93-48d3-9926-98630ffa2f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:59.813782 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb03a43-3e93-48d3-9926-98630ffa2f95 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:59.814661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb03a43-3e93-48d3-9926-98630ffa2f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:59.814661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb03a43-3e93-48d3-9926-98630ffa2f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:59.817357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb03a43-3e93-48d3-9926-98630ffa2f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:59.817357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb03a43-3e93-48d3-9926-98630ffa2f95 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:59.840220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1059/2079] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:04:59.841258 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19711e79-707c-411b-8b14-90823952f786 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:04:59.852298 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19711e79-707c-411b-8b14-90823952f786 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:04:59.857158 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca77254-5f43-4659-859b-77a02296ceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:04:59.858401 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca77254-5f43-4659-859b-77a02296ceae admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:04:59.858799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca77254-5f43-4659-859b-77a02296ceae admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:04:59.859080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca77254-5f43-4659-859b-77a02296ceae admin admin] PATH_INFO: `/v3/projects/e30e856a53cb4727af62b5674a92f9b9/users/3b1f6122bb344d8480a593542e90ab63/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:04:59.875032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca77254-5f43-4659-859b-77a02296ceae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e30e856a53cb4727af62b5674a92f9b9, user_id=3b1f6122bb344d8480a593542e90ab63, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:04:59.877848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca77254-5f43-4659-859b-77a02296ceae admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:04:59.993510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1021/2080] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:04:59 2022] PUT /identity/v3/projects/e30e856a53cb4727af62b5674a92f9b9/users/3b1f6122bb344d8480a593542e90ab63/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:00.005950 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fa8cc-c957-43c1-ac62-b94a0f51388b None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:00.006245 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fa8cc-c957-43c1-ac62-b94a0f51388b None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:00.006532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fa8cc-c957-43c1-ac62-b94a0f51388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:00.035090 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-3b2fa8cc-c957-43c1-ac62-b94a0f51388b None None] MFA Rules not processed for user `3b1f6122bb344d8480a593542e90ab63`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:00.036373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-3b2fa8cc-c957-43c1-ac62-b94a0f51388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:00.082675 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:00.142620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1060/2081] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:00.147269 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca77254-5f43-4659-859b-77a02296ceae admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:00.250712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:00.267507 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca77254-5f43-4659-859b-77a02296ceae admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:00.273169 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317679a-4e72-44e9-a302-630f668e4769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:00.274104 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317679a-4e72-44e9-a302-630f668e4769 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:00.274466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317679a-4e72-44e9-a302-630f668e4769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:00.274819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317679a-4e72-44e9-a302-630f668e4769 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:00.275682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317679a-4e72-44e9-a302-630f668e4769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:00.277755 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317679a-4e72-44e9-a302-630f668e4769 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:00.424031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1022/2082] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:00 2022] POST /identity/v3/projects => generated 381 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:00.425584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fa8cc-c957-43c1-ac62-b94a0f51388b None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:00.437062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fa8cc-c957-43c1-ac62-b94a0f51388b None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:00.542749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f6cea-b8ff-42ba-8d2e-7f7c638c8158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:00.543431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f6cea-b8ff-42ba-8d2e-7f7c638c8158 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:00.543719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f6cea-b8ff-42ba-8d2e-7f7c638c8158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:00.543993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f6cea-b8ff-42ba-8d2e-7f7c638c8158 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:00.544829 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f6cea-b8ff-42ba-8d2e-7f7c638c8158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:00.547702 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f6cea-b8ff-42ba-8d2e-7f7c638c8158 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:00.716286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1061/2083] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:00 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:00.720496 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317679a-4e72-44e9-a302-630f668e4769 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:00.779606 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317679a-4e72-44e9-a302-630f668e4769 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:00.785561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae051d6d-ef26-4f4c-8ca1-338b18fef996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:00.786658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae051d6d-ef26-4f4c-8ca1-338b18fef996 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:00.787711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae051d6d-ef26-4f4c-8ca1-338b18fef996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:00.787711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae051d6d-ef26-4f4c-8ca1-338b18fef996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:00.788875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae051d6d-ef26-4f4c-8ca1-338b18fef996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:00.791783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae051d6d-ef26-4f4c-8ca1-338b18fef996 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:00.807535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1023/2084] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:05:00.812955 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f6cea-b8ff-42ba-8d2e-7f7c638c8158 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:00.826244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f6cea-b8ff-42ba-8d2e-7f7c638c8158 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:00.834923 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c228f-e172-4ece-988c-dd43e9bf4653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:00.835884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c228f-e172-4ece-988c-dd43e9bf4653 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:00.836177 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c228f-e172-4ece-988c-dd43e9bf4653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:00.836462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c228f-e172-4ece-988c-dd43e9bf4653 admin admin] PATH_INFO: `/v3/projects/a22b87987f2d49a0ac68838f49bf71f7/users/6fbf69e23d49448bab2a969874ca9174/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:00.854957 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c228f-e172-4ece-988c-dd43e9bf4653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22b87987f2d49a0ac68838f49bf71f7, user_id=6fbf69e23d49448bab2a969874ca9174, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:00.858147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c228f-e172-4ece-988c-dd43e9bf4653 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:01.005452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1062/2085] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:00 2022] PUT /identity/v3/projects/a22b87987f2d49a0ac68838f49bf71f7/users/6fbf69e23d49448bab2a969874ca9174/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:01.011305 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae051d6d-ef26-4f4c-8ca1-338b18fef996 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:01.031893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae051d6d-ef26-4f4c-8ca1-338b18fef996 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:01.121966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ba804-d020-401b-af34-5b45cab7e4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:01.122789 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ba804-d020-401b-af34-5b45cab7e4ba admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:01.123084 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ba804-d020-401b-af34-5b45cab7e4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:01.123370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ba804-d020-401b-af34-5b45cab7e4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:01.125637 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ba804-d020-401b-af34-5b45cab7e4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:01.128573 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ba804-d020-401b-af34-5b45cab7e4ba admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:01.144317 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c228f-e172-4ece-988c-dd43e9bf4653 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:01.147088 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b59c228f-e172-4ece-988c-dd43e9bf4653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:01.156966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1024/2086] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:01.158643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ba804-d020-401b-af34-5b45cab7e4ba admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:01.174236 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ba804-d020-401b-af34-5b45cab7e4ba admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:01.175660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c228f-e172-4ece-988c-dd43e9bf4653 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:01.182277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68af90b-05bb-47b5-8316-d0a4dd37df5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:01.183383 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68af90b-05bb-47b5-8316-d0a4dd37df5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:01.183733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68af90b-05bb-47b5-8316-d0a4dd37df5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:01.184096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68af90b-05bb-47b5-8316-d0a4dd37df5c admin admin] PATH_INFO: `/v3/projects/a22b87987f2d49a0ac68838f49bf71f7/users/6fbf69e23d49448bab2a969874ca9174/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:01.192263 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ea066-7a8e-47ee-bce0-105af74d4b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:01.192440 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68af90b-05bb-47b5-8316-d0a4dd37df5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22b87987f2d49a0ac68838f49bf71f7, user_id=6fbf69e23d49448bab2a969874ca9174, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:01.197549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ea066-7a8e-47ee-bce0-105af74d4b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:01.198064 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ea066-7a8e-47ee-bce0-105af74d4b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:01.198445 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ea066-7a8e-47ee-bce0-105af74d4b4f admin admin] PATH_INFO: `/v3/users/b8f9c8d3308a4273b801238c2f36d426` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:01.200323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68af90b-05bb-47b5-8316-d0a4dd37df5c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:01.204319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ea066-7a8e-47ee-bce0-105af74d4b4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8f9c8d3308a4273b801238c2f36d426)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:01.209040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ea066-7a8e-47ee-bce0-105af74d4b4f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:01.215445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1025/2087] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:01 2022] PUT /identity/v3/projects/a22b87987f2d49a0ac68838f49bf71f7/users/6fbf69e23d49448bab2a969874ca9174/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:01.228506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b3ad0-0362-4a71-984f-c8266e183028 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:01.228867 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b3ad0-0362-4a71-984f-c8266e183028 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:01.229248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b3ad0-0362-4a71-984f-c8266e183028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:01.273629 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-2f2b3ad0-0362-4a71-984f-c8266e183028 None None] MFA Rules not processed for user `6fbf69e23d49448bab2a969874ca9174`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:01.274983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2f2b3ad0-0362-4a71-984f-c8266e183028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:01.365731 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1026/2088] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:01.465714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b3ad0-0362-4a71-984f-c8266e183028 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:01.465714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2f2b3ad0-0362-4a71-984f-c8266e183028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:01.548689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b3ad0-0362-4a71-984f-c8266e183028 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:01.551339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-301ea066-7a8e-47ee-bce0-105af74d4b4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8f9c8d3308a4273b801238c2f36d426'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:01.553087 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e07b1-cbd0-4a70-84ef-c7b652d02d0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:01.553780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e07b1-cbd0-4a70-84ef-c7b652d02d0e service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:01.554066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e07b1-cbd0-4a70-84ef-c7b652d02d0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:01.554347 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e07b1-cbd0-4a70-84ef-c7b652d02d0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:01.558898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-301ea066-7a8e-47ee-bce0-105af74d4b4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8f9c8d3308a4273b801238c2f36d426'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:01.559797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-301ea066-7a8e-47ee-bce0-105af74d4b4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8f9c8d3308a4273b801238c2f36d426'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:01.565431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e07b1-cbd0-4a70-84ef-c7b652d02d0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:01.567463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e07b1-cbd0-4a70-84ef-c7b652d02d0e service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:01.573563 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-301ea066-7a8e-47ee-bce0-105af74d4b4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8f9c8d3308a4273b801238c2f36d426'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:01.574536 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-301ea066-7a8e-47ee-bce0-105af74d4b4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8f9c8d3308a4273b801238c2f36d426'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:01.578689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1027/2089] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:05:01.746280 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1063/2090] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:01 2022] DELETE /identity/v3/users/b8f9c8d3308a4273b801238c2f36d426 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:01.751587 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c00406-8ecf-4f37-b2f3-1ad9eb95ae3b None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:01.751948 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c00406-8ecf-4f37-b2f3-1ad9eb95ae3b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:01.752360 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c00406-8ecf-4f37-b2f3-1ad9eb95ae3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:01.786747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-58c00406-8ecf-4f37-b2f3-1ad9eb95ae3b None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:01.788414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-58c00406-8ecf-4f37-b2f3-1ad9eb95ae3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:01.849674 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1028/2091] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:01.863191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ea066-7a8e-47ee-bce0-105af74d4b4f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:01.865220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-301ea066-7a8e-47ee-bce0-105af74d4b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:01.992481 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ea066-7a8e-47ee-bce0-105af74d4b4f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:01.998715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2df97-7e15-49b3-8ec8-efa62bbcc6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:01.999460 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2df97-7e15-49b3-8ec8-efa62bbcc6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:02.000773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2df97-7e15-49b3-8ec8-efa62bbcc6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:02.001059 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2df97-7e15-49b3-8ec8-efa62bbcc6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:02.011244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2df97-7e15-49b3-8ec8-efa62bbcc6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:02.012707 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2df97-7e15-49b3-8ec8-efa62bbcc6a8 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:02.023799 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1064/2092] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:02.301722 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c00406-8ecf-4f37-b2f3-1ad9eb95ae3b None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:02.303357 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-58c00406-8ecf-4f37-b2f3-1ad9eb95ae3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:02.303925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2df97-7e15-49b3-8ec8-efa62bbcc6a8 service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:02.305593 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6ab2df97-7e15-49b3-8ec8-efa62bbcc6a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:02.316376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c00406-8ecf-4f37-b2f3-1ad9eb95ae3b None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:02.321297 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa005f98-2554-47f7-8d92-6841454c0d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:02.322257 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa005f98-2554-47f7-8d92-6841454c0d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:02.322546 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa005f98-2554-47f7-8d92-6841454c0d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:02.322825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa005f98-2554-47f7-8d92-6841454c0d86 admin admin] PATH_INFO: `/v3/users/b372b8fbf5e04f378e85ffdc29106b7f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:02.324346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa005f98-2554-47f7-8d92-6841454c0d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b372b8fbf5e04f378e85ffdc29106b7f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:02.326331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa005f98-2554-47f7-8d92-6841454c0d86 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:02.370501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2df97-7e15-49b3-8ec8-efa62bbcc6a8 service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:02.376239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf648a97-b925-4f2a-8427-1e02d40a76a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:02.379368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf648a97-b925-4f2a-8427-1e02d40a76a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:02.379368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf648a97-b925-4f2a-8427-1e02d40a76a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:02.379368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf648a97-b925-4f2a-8427-1e02d40a76a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:02.380800 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-cf648a97-b925-4f2a-8427-1e02d40a76a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:02.455735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf648a97-b925-4f2a-8427-1e02d40a76a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:02.457521 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf648a97-b925-4f2a-8427-1e02d40a76a8 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:02.467629 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1065/2093] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:05:02.733116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-fa005f98-2554-47f7-8d92-6841454c0d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b372b8fbf5e04f378e85ffdc29106b7f'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:02.733808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-fa005f98-2554-47f7-8d92-6841454c0d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b372b8fbf5e04f378e85ffdc29106b7f'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:02.742548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-fa005f98-2554-47f7-8d92-6841454c0d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b372b8fbf5e04f378e85ffdc29106b7f'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:02.743384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-fa005f98-2554-47f7-8d92-6841454c0d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b372b8fbf5e04f378e85ffdc29106b7f'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:02.768439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf648a97-b925-4f2a-8427-1e02d40a76a8 service cinder] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:02.770007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-cf648a97-b925-4f2a-8427-1e02d40a76a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:02.785161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf648a97-b925-4f2a-8427-1e02d40a76a8 service cinder] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:02.790584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af124990-ddba-46fd-8780-b66a0dec316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:02.791599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af124990-ddba-46fd-8780-b66a0dec316e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:02.791867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af124990-ddba-46fd-8780-b66a0dec316e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:02.792138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af124990-ddba-46fd-8780-b66a0dec316e admin admin] PATH_INFO: `/v3/projects/835dc68aefd94fbdbeae078bd12db021` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:02.793399 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af124990-ddba-46fd-8780-b66a0dec316e admin admin] RBAC: Authorizing `identity:delete_project(project_id=835dc68aefd94fbdbeae078bd12db021)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:02.795475 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af124990-ddba-46fd-8780-b66a0dec316e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:02.849108 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-fa005f98-2554-47f7-8d92-6841454c0d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b372b8fbf5e04f378e85ffdc29106b7f'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:02.871095 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1029/2094] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:02 2022] DELETE /identity/v3/users/b372b8fbf5e04f378e85ffdc29106b7f => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:02.875792 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d5815-f5f3-4611-b848-5c885c1bf06d None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:02.876348 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d5815-f5f3-4611-b848-5c885c1bf06d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:02.876630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d5815-f5f3-4611-b848-5c885c1bf06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:02.896286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-1f5d5815-f5f3-4611-b848-5c885c1bf06d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:02.897589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-1f5d5815-f5f3-4611-b848-5c885c1bf06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:02.974096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1030/2095] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:02.985460 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d5815-f5f3-4611-b848-5c885c1bf06d None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:02.987651 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-1f5d5815-f5f3-4611-b848-5c885c1bf06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:02.996041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-af124990-ddba-46fd-8780-b66a0dec316e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '835dc68aefd94fbdbeae078bd12db021', 'request_id': 'req-af124990-ddba-46fd-8780-b66a0dec316e'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:03.003010 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-af124990-ddba-46fd-8780-b66a0dec316e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '835dc68aefd94fbdbeae078bd12db021', 'request_id': 'req-af124990-ddba-46fd-8780-b66a0dec316e'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:03.008705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-af124990-ddba-46fd-8780-b66a0dec316e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '835dc68aefd94fbdbeae078bd12db021', 'request_id': 'req-af124990-ddba-46fd-8780-b66a0dec316e'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:03.049386 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d5815-f5f3-4611-b848-5c885c1bf06d None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:03.088655 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-af124990-ddba-46fd-8780-b66a0dec316e admin admin] The token cache is being invalidate because project 835dc68aefd94fbdbeae078bd12db021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:03.088952 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-af124990-ddba-46fd-8780-b66a0dec316e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:03.089961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-af124990-ddba-46fd-8780-b66a0dec316e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:03.094885 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1066/2096] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:02 2022] DELETE /identity/v3/projects/835dc68aefd94fbdbeae078bd12db021 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:03.095876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af124990-ddba-46fd-8780-b66a0dec316e admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:03.097386 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-af124990-ddba-46fd-8780-b66a0dec316e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:03.103968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1446c-0f74-44eb-8438-37ea40434c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:03.105326 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1446c-0f74-44eb-8438-37ea40434c30 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:03.116582 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1446c-0f74-44eb-8438-37ea40434c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:03.116987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1446c-0f74-44eb-8438-37ea40434c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:03.121688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-25c1446c-0f74-44eb-8438-37ea40434c30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:03.174929 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af124990-ddba-46fd-8780-b66a0dec316e admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:03.182305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7638c-8e0a-46b6-89de-3569df1d4644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:03.183565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7638c-8e0a-46b6-89de-3569df1d4644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:03.183852 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7638c-8e0a-46b6-89de-3569df1d4644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:03.184174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7638c-8e0a-46b6-89de-3569df1d4644 admin admin] PATH_INFO: `/v3/users/bc5c8d2578944fd08dfdc0668445de8d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:03.185825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7638c-8e0a-46b6-89de-3569df1d4644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5c8d2578944fd08dfdc0668445de8d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:03.188103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7638c-8e0a-46b6-89de-3569df1d4644 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:03.196930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1446c-0f74-44eb-8438-37ea40434c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:03.198416 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1446c-0f74-44eb-8438-37ea40434c30 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:03.210027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1031/2097] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:05:03.373898 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1446c-0f74-44eb-8438-37ea40434c30 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:03.375906 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-25c1446c-0f74-44eb-8438-37ea40434c30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:03.451099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1446c-0f74-44eb-8438-37ea40434c30 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:03.457902 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce346d6-974b-47e9-86b0-68d46bc87034 tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbf69e23d49448bab2a969874ca9174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22b87987f2d49a0ac68838f49bf71f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:03.458606 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce346d6-974b-47e9-86b0-68d46bc87034 tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:03.458891 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce346d6-974b-47e9-86b0-68d46bc87034 tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:03.459187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce346d6-974b-47e9-86b0-68d46bc87034 tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:03.459932 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce346d6-974b-47e9-86b0-68d46bc87034 tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:05:03.460247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce346d6-974b-47e9-86b0-68d46bc87034 tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:03.462766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce346d6-974b-47e9-86b0-68d46bc87034 tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:03.476699 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1032/2098] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:05:03.480794 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce346d6-974b-47e9-86b0-68d46bc87034 tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:03.491910 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce346d6-974b-47e9-86b0-68d46bc87034 tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:03.496807 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e00a2-aa94-408c-bd14-867b4ac9648d tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbf69e23d49448bab2a969874ca9174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22b87987f2d49a0ac68838f49bf71f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:03.497548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e00a2-aa94-408c-bd14-867b4ac9648d tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:03.497812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e00a2-aa94-408c-bd14-867b4ac9648d tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:03.498171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e00a2-aa94-408c-bd14-867b4ac9648d tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:03.499080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e00a2-aa94-408c-bd14-867b4ac9648d tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:03.502022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e00a2-aa94-408c-bd14-867b4ac9648d tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:03.525051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-56f7638c-8e0a-46b6-89de-3569df1d4644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5c8d2578944fd08dfdc0668445de8d'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:03.533979 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-56f7638c-8e0a-46b6-89de-3569df1d4644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5c8d2578944fd08dfdc0668445de8d'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:03.534742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-56f7638c-8e0a-46b6-89de-3569df1d4644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5c8d2578944fd08dfdc0668445de8d'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:03.542110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:03.548725 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-56f7638c-8e0a-46b6-89de-3569df1d4644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5c8d2578944fd08dfdc0668445de8d'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:03.549849 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-56f7638c-8e0a-46b6-89de-3569df1d4644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5c8d2578944fd08dfdc0668445de8d'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:03.741165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1067/2099] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:03 2022] DELETE /identity/v3/users/bc5c8d2578944fd08dfdc0668445de8d => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:03.742703 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1033/2100] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:03 2022] POST /identity/v3/projects => generated 355 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:05:03.746735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7638c-8e0a-46b6-89de-3569df1d4644 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:03.748194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-56f7638c-8e0a-46b6-89de-3569df1d4644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:03.872050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:03.895783 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7638c-8e0a-46b6-89de-3569df1d4644 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:03.958152 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01389c4-d9d6-4323-97d6-db05f2cdfefa tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbf69e23d49448bab2a969874ca9174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22b87987f2d49a0ac68838f49bf71f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:03.958837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01389c4-d9d6-4323-97d6-db05f2cdfefa tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:03.959132 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01389c4-d9d6-4323-97d6-db05f2cdfefa tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:03.959414 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01389c4-d9d6-4323-97d6-db05f2cdfefa tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:03.960157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01389c4-d9d6-4323-97d6-db05f2cdfefa tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:05:03.960472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01389c4-d9d6-4323-97d6-db05f2cdfefa tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:03.962222 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01389c4-d9d6-4323-97d6-db05f2cdfefa tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:03.976043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1068/2101] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:05:04.034695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e00a2-aa94-408c-bd14-867b4ac9648d tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:04.048330 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e00a2-aa94-408c-bd14-867b4ac9648d tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:04.048518 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01389c4-d9d6-4323-97d6-db05f2cdfefa tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:04.050302 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c01389c4-d9d6-4323-97d6-db05f2cdfefa tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:04.054269 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a7e8d-02f3-49de-896c-d99614866c6e tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fbf69e23d49448bab2a969874ca9174', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a22b87987f2d49a0ac68838f49bf71f7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:04.055356 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a7e8d-02f3-49de-896c-d99614866c6e tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:04.055814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a7e8d-02f3-49de-896c-d99614866c6e tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:04.056258 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a7e8d-02f3-49de-896c-d99614866c6e tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] PATH_INFO: `/v3/projects/249230a26b5c4c5c890d7e65fcf1888d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:04.057777 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a7e8d-02f3-49de-896c-d99614866c6e tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] RBAC: Authorizing `identity:delete_project(project_id=249230a26b5c4c5c890d7e65fcf1888d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:04.060099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a7e8d-02f3-49de-896c-d99614866c6e tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:04.136240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01389c4-d9d6-4323-97d6-db05f2cdfefa tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:04.141697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f86a19-fd67-4a13-9f53-97070d3825f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:04.142570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f86a19-fd67-4a13-9f53-97070d3825f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:04.142857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f86a19-fd67-4a13-9f53-97070d3825f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:04.143223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f86a19-fd67-4a13-9f53-97070d3825f8 admin admin] PATH_INFO: `/v3/projects/95e310d9416b4f838838df59ca5a421e` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:04.144424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f86a19-fd67-4a13-9f53-97070d3825f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e310d9416b4f838838df59ca5a421e)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:04.146441 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f86a19-fd67-4a13-9f53-97070d3825f8 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:04.265506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-304a7e8d-02f3-49de-896c-d99614866c6e tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249230a26b5c4c5c890d7e65fcf1888d', 'request_id': 'req-304a7e8d-02f3-49de-896c-d99614866c6e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:04.272649 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-304a7e8d-02f3-49de-896c-d99614866c6e tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249230a26b5c4c5c890d7e65fcf1888d', 'request_id': 'req-304a7e8d-02f3-49de-896c-d99614866c6e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:04.278632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-304a7e8d-02f3-49de-896c-d99614866c6e tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249230a26b5c4c5c890d7e65fcf1888d', 'request_id': 'req-304a7e8d-02f3-49de-896c-d99614866c6e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:04.362891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-83f86a19-fd67-4a13-9f53-97070d3825f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e310d9416b4f838838df59ca5a421e', 'request_id': 'req-83f86a19-fd67-4a13-9f53-97070d3825f8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:04.370848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-83f86a19-fd67-4a13-9f53-97070d3825f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e310d9416b4f838838df59ca5a421e', 'request_id': 'req-83f86a19-fd67-4a13-9f53-97070d3825f8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:04.379147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-83f86a19-fd67-4a13-9f53-97070d3825f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e310d9416b4f838838df59ca5a421e', 'request_id': 'req-83f86a19-fd67-4a13-9f53-97070d3825f8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:04.402642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-304a7e8d-02f3-49de-896c-d99614866c6e tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] The token cache is being invalidate because project 249230a26b5c4c5c890d7e65fcf1888d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:04.403298 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-304a7e8d-02f3-49de-896c-d99614866c6e tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:04.404876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-304a7e8d-02f3-49de-896c-d99614866c6e tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:04.410390 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1034/2102] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:04 2022] DELETE /identity/v3/projects/249230a26b5c4c5c890d7e65fcf1888d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:04.412156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a7e8d-02f3-49de-896c-d99614866c6e tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:04.422781 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-304a7e8d-02f3-49de-896c-d99614866c6e tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:04.553828 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a7e8d-02f3-49de-896c-d99614866c6e tempest-VolumeQuotaClassesTest-1819771480 tempest-VolumeQuotaClassesTest-1819771480-project-admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:04.621765 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc57f5e-b314-4ee7-9cc2-8d9c29f56676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:04.622978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc57f5e-b314-4ee7-9cc2-8d9c29f56676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:04.623262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc57f5e-b314-4ee7-9cc2-8d9c29f56676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:04.623810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc57f5e-b314-4ee7-9cc2-8d9c29f56676 admin admin] PATH_INFO: `/v3/projects/92d6611875ad48edb91adfa04ea111b5` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:04.625099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc57f5e-b314-4ee7-9cc2-8d9c29f56676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d6611875ad48edb91adfa04ea111b5)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:04.627055 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc57f5e-b314-4ee7-9cc2-8d9c29f56676 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:04.663362 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-83f86a19-fd67-4a13-9f53-97070d3825f8 admin admin] The token cache is being invalidate because project 95e310d9416b4f838838df59ca5a421e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:04.663745 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-83f86a19-fd67-4a13-9f53-97070d3825f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:04.664566 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-83f86a19-fd67-4a13-9f53-97070d3825f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:04.666546 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1069/2103] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:04 2022] DELETE /identity/v3/projects/95e310d9416b4f838838df59ca5a421e => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:04.672174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f86a19-fd67-4a13-9f53-97070d3825f8 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:04.673776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-83f86a19-fd67-4a13-9f53-97070d3825f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:04.686809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f86a19-fd67-4a13-9f53-97070d3825f8 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:04.691519 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c443390-3d1f-4518-865c-97fa7a6803aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:04.692404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c443390-3d1f-4518-865c-97fa7a6803aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:04.692691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c443390-3d1f-4518-865c-97fa7a6803aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:04.692971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c443390-3d1f-4518-865c-97fa7a6803aa admin admin] PATH_INFO: `/v3/users/2835eae846fa47d4852f562c5b871ff4` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:04.694209 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c443390-3d1f-4518-865c-97fa7a6803aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2835eae846fa47d4852f562c5b871ff4)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:04.696140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c443390-3d1f-4518-865c-97fa7a6803aa admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:04.798587 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-dcc57f5e-b314-4ee7-9cc2-8d9c29f56676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d6611875ad48edb91adfa04ea111b5', 'request_id': 'req-dcc57f5e-b314-4ee7-9cc2-8d9c29f56676'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:04.804867 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-dcc57f5e-b314-4ee7-9cc2-8d9c29f56676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d6611875ad48edb91adfa04ea111b5', 'request_id': 'req-dcc57f5e-b314-4ee7-9cc2-8d9c29f56676'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:04.810694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-dcc57f5e-b314-4ee7-9cc2-8d9c29f56676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d6611875ad48edb91adfa04ea111b5', 'request_id': 'req-dcc57f5e-b314-4ee7-9cc2-8d9c29f56676'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:05.004001 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-dcc57f5e-b314-4ee7-9cc2-8d9c29f56676 admin admin] The token cache is being invalidate because project 92d6611875ad48edb91adfa04ea111b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:05.004299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-dcc57f5e-b314-4ee7-9cc2-8d9c29f56676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:05.004988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-dcc57f5e-b314-4ee7-9cc2-8d9c29f56676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:05.006833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1035/2104] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:04 2022] DELETE /identity/v3/projects/92d6611875ad48edb91adfa04ea111b5 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:05.011698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65c408-5906-434b-b668-63a2773af168 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:05.012125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65c408-5906-434b-b668-63a2773af168 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:05.012562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65c408-5906-434b-b668-63a2773af168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:05.042065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-3c443390-3d1f-4518-865c-97fa7a6803aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2835eae846fa47d4852f562c5b871ff4'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:05.049487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-3c443390-3d1f-4518-865c-97fa7a6803aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2835eae846fa47d4852f562c5b871ff4'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:05.050175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-3c443390-3d1f-4518-865c-97fa7a6803aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2835eae846fa47d4852f562c5b871ff4'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:05.064791 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-ce65c408-5906-434b-b668-63a2773af168 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:05.066066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ce65c408-5906-434b-b668-63a2773af168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:05.066692 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-3c443390-3d1f-4518-865c-97fa7a6803aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2835eae846fa47d4852f562c5b871ff4'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:05.067526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-3c443390-3d1f-4518-865c-97fa7a6803aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2835eae846fa47d4852f562c5b871ff4'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:05.133916 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1070/2105] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:04 2022] DELETE /identity/v3/users/2835eae846fa47d4852f562c5b871ff4 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:05:05.134832 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c443390-3d1f-4518-865c-97fa7a6803aa admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:05.135158 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1036/2106] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:05.136860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-3c443390-3d1f-4518-865c-97fa7a6803aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:05.144974 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c3ea-ff37-4cfb-82b9-29376d012507 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:05.145317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c3ea-ff37-4cfb-82b9-29376d012507 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:05.145605 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887c3ea-ff37-4cfb-82b9-29376d012507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:05.165121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-2887c3ea-ff37-4cfb-82b9-29376d012507 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:05.166487 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2887c3ea-ff37-4cfb-82b9-29376d012507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:05.210091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c443390-3d1f-4518-865c-97fa7a6803aa admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:05.215419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad0b5b-82ef-4586-b5d3-d818be533cb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:05.216749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad0b5b-82ef-4586-b5d3-d818be533cb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:05.217267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad0b5b-82ef-4586-b5d3-d818be533cb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:05.217762 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad0b5b-82ef-4586-b5d3-d818be533cb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:05.220203 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b0ad0b5b-82ef-4586-b5d3-d818be533cb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:05.244943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1037/2107] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:05.246663 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887c3ea-ff37-4cfb-82b9-29376d012507 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:05.257593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887c3ea-ff37-4cfb-82b9-29376d012507 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:05.265118 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96714714-6aac-44b7-8a76-8ceeec7ae58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:05.265853 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96714714-6aac-44b7-8a76-8ceeec7ae58c admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:05.266144 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96714714-6aac-44b7-8a76-8ceeec7ae58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:05.266495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96714714-6aac-44b7-8a76-8ceeec7ae58c admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:05.267249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96714714-6aac-44b7-8a76-8ceeec7ae58c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:05:05.267567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96714714-6aac-44b7-8a76-8ceeec7ae58c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:05.269241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96714714-6aac-44b7-8a76-8ceeec7ae58c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:05.288907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1038/2108] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:05:05.291293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96714714-6aac-44b7-8a76-8ceeec7ae58c admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:05.304472 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96714714-6aac-44b7-8a76-8ceeec7ae58c admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:05.310899 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14ea52-965b-4779-b465-b5d98236f706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:05.311700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14ea52-965b-4779-b465-b5d98236f706 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:05.312457 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14ea52-965b-4779-b465-b5d98236f706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:05.312584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14ea52-965b-4779-b465-b5d98236f706 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:05.313423 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14ea52-965b-4779-b465-b5d98236f706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:05.316136 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14ea52-965b-4779-b465-b5d98236f706 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:05.319624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad0b5b-82ef-4586-b5d3-d818be533cb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:05.336489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad0b5b-82ef-4586-b5d3-d818be533cb2 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:05.350420 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1071/2109] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:05.437946 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1039/2110] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:05 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:05.446070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad0b5b-82ef-4586-b5d3-d818be533cb2 service cinder] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:05.453475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14ea52-965b-4779-b465-b5d98236f706 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:05.455328 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-5b14ea52-965b-4779-b465-b5d98236f706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:05.459217 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad0b5b-82ef-4586-b5d3-d818be533cb2 service cinder] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:05.538693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c060211-92ae-45e3-930a-a3c2dedc2b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:05.539389 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c060211-92ae-45e3-930a-a3c2dedc2b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:05.539684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c060211-92ae-45e3-930a-a3c2dedc2b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:05.539970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c060211-92ae-45e3-930a-a3c2dedc2b9b admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:05.540686 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c060211-92ae-45e3-930a-a3c2dedc2b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:05.542792 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c060211-92ae-45e3-930a-a3c2dedc2b9b admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:05.563927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14ea52-965b-4779-b465-b5d98236f706 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:05.574154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d3c43-8d8c-4b28-84d1-a328f630ffaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:05.575109 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d3c43-8d8c-4b28-84d1-a328f630ffaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:05.575394 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d3c43-8d8c-4b28-84d1-a328f630ffaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:05.575675 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d3c43-8d8c-4b28-84d1-a328f630ffaa admin admin] PATH_INFO: `/v3/users/3b1f6122bb344d8480a593542e90ab63` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:05.576945 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d3c43-8d8c-4b28-84d1-a328f630ffaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b1f6122bb344d8480a593542e90ab63)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:05.579645 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d3c43-8d8c-4b28-84d1-a328f630ffaa admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:05.726138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1072/2111] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:05 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:05:05.730948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c060211-92ae-45e3-930a-a3c2dedc2b9b admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:05.733089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-8c060211-92ae-45e3-930a-a3c2dedc2b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:05.762823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c060211-92ae-45e3-930a-a3c2dedc2b9b admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:05.775600 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c68fab-e68e-4b64-9835-b7e8c3626b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:05.777097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c68fab-e68e-4b64-9835-b7e8c3626b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:05.778355 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c68fab-e68e-4b64-9835-b7e8c3626b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:05.778800 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c68fab-e68e-4b64-9835-b7e8c3626b86 admin admin] PATH_INFO: `/v3/projects/21f73962368c4d1f995e3dd0ebb03acc` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:05.781431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c68fab-e68e-4b64-9835-b7e8c3626b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f73962368c4d1f995e3dd0ebb03acc)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:05.784719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c68fab-e68e-4b64-9835-b7e8c3626b86 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:05.841646 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-639d3c43-8d8c-4b28-84d1-a328f630ffaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b1f6122bb344d8480a593542e90ab63'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:05.842325 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-639d3c43-8d8c-4b28-84d1-a328f630ffaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b1f6122bb344d8480a593542e90ab63'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:05.850423 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-639d3c43-8d8c-4b28-84d1-a328f630ffaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b1f6122bb344d8480a593542e90ab63'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:05.851122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-639d3c43-8d8c-4b28-84d1-a328f630ffaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b1f6122bb344d8480a593542e90ab63'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:05.877371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:05.925695 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a2c68fab-e68e-4b64-9835-b7e8c3626b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f73962368c4d1f995e3dd0ebb03acc', 'request_id': 'req-a2c68fab-e68e-4b64-9835-b7e8c3626b86'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:05.932273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a2c68fab-e68e-4b64-9835-b7e8c3626b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f73962368c4d1f995e3dd0ebb03acc', 'request_id': 'req-a2c68fab-e68e-4b64-9835-b7e8c3626b86'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:05.934465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-639d3c43-8d8c-4b28-84d1-a328f630ffaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b1f6122bb344d8480a593542e90ab63'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:05.940064 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a2c68fab-e68e-4b64-9835-b7e8c3626b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f73962368c4d1f995e3dd0ebb03acc', 'request_id': 'req-a2c68fab-e68e-4b64-9835-b7e8c3626b86'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:05.954046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1040/2112] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:05 2022] DELETE /identity/v3/users/3b1f6122bb344d8480a593542e90ab63 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:05.955154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d3c43-8d8c-4b28-84d1-a328f630ffaa admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:05.956657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-639d3c43-8d8c-4b28-84d1-a328f630ffaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:06.026419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d3c43-8d8c-4b28-84d1-a328f630ffaa admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:06.033663 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878e99a-91ab-44e0-9a4d-31cd2fe6ba5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:06.034584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878e99a-91ab-44e0-9a4d-31cd2fe6ba5b admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:06.035065 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878e99a-91ab-44e0-9a4d-31cd2fe6ba5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:06.035463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878e99a-91ab-44e0-9a4d-31cd2fe6ba5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:06.036257 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878e99a-91ab-44e0-9a4d-31cd2fe6ba5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:06.038336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878e99a-91ab-44e0-9a4d-31cd2fe6ba5b admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:06.053034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1041/2113] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:06.053034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a84dfb-5a57-4836-a8f7-a6f53d264129 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:06.053034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a84dfb-5a57-4836-a8f7-a6f53d264129 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:06.053034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a84dfb-5a57-4836-a8f7-a6f53d264129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:06.071803 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-63a84dfb-5a57-4836-a8f7-a6f53d264129 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:06.073075 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-63a84dfb-5a57-4836-a8f7-a6f53d264129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:06.081662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1042/2114] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:06.082617 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a84dfb-5a57-4836-a8f7-a6f53d264129 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:06.092779 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a84dfb-5a57-4836-a8f7-a6f53d264129 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:06.097634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea067d5-b52d-46d1-94f4-76c4bf4c0411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:06.098326 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea067d5-b52d-46d1-94f4-76c4bf4c0411 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:06.098609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea067d5-b52d-46d1-94f4-76c4bf4c0411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:06.098884 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea067d5-b52d-46d1-94f4-76c4bf4c0411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:06.099608 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea067d5-b52d-46d1-94f4-76c4bf4c0411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:06.101256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea067d5-b52d-46d1-94f4-76c4bf4c0411 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:06.114180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1043/2115] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:06.114180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea067d5-b52d-46d1-94f4-76c4bf4c0411 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:06.114897 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-5ea067d5-b52d-46d1-94f4-76c4bf4c0411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:06.129472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a2c68fab-e68e-4b64-9835-b7e8c3626b86 admin admin] The token cache is being invalidate because project 21f73962368c4d1f995e3dd0ebb03acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:06.130016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a2c68fab-e68e-4b64-9835-b7e8c3626b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:06.130896 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a2c68fab-e68e-4b64-9835-b7e8c3626b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:06.132757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1073/2116] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:05 2022] DELETE /identity/v3/projects/21f73962368c4d1f995e3dd0ebb03acc => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:06.133562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c68fab-e68e-4b64-9835-b7e8c3626b86 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:06.134984 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a2c68fab-e68e-4b64-9835-b7e8c3626b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:06.180653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea067d5-b52d-46d1-94f4-76c4bf4c0411 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:06.184638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97b089-438e-4dae-9250-f6dde81c8f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:06.185386 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97b089-438e-4dae-9250-f6dde81c8f97 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:06.185672 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97b089-438e-4dae-9250-f6dde81c8f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:06.185978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97b089-438e-4dae-9250-f6dde81c8f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:06.191522 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-0f97b089-438e-4dae-9250-f6dde81c8f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:06.208889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97b089-438e-4dae-9250-f6dde81c8f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:06.209222 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c68fab-e68e-4b64-9835-b7e8c3626b86 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:06.210372 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97b089-438e-4dae-9250-f6dde81c8f97 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:06.213803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fb767-2ada-4d18-a8cb-02e040af7b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:06.215028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fb767-2ada-4d18-a8cb-02e040af7b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:06.215320 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fb767-2ada-4d18-a8cb-02e040af7b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:06.215599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fb767-2ada-4d18-a8cb-02e040af7b1e admin admin] PATH_INFO: `/v3/projects/38184b85095d455784690b0366fc939d/users/6ce1e972dc9c44d08fb96e5dcefbc60a/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:06.221534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1044/2117] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:06.223006 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7c3c8-2e14-43e2-8951-ecf10bf36515 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:06.223303 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7c3c8-2e14-43e2-8951-ecf10bf36515 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:06.223584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7c3c8-2e14-43e2-8951-ecf10bf36515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:06.233813 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fb767-2ada-4d18-a8cb-02e040af7b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=38184b85095d455784690b0366fc939d, user_id=6ce1e972dc9c44d08fb96e5dcefbc60a, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:06.237039 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fb767-2ada-4d18-a8cb-02e040af7b1e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:06.244153 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-96a7c3c8-2e14-43e2-8951-ecf10bf36515 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:06.245634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-96a7c3c8-2e14-43e2-8951-ecf10bf36515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:06.254516 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1045/2118] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:06.263602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfa139-b339-4beb-9025-bef0886d2629 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:06.263922 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfa139-b339-4beb-9025-bef0886d2629 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:06.264170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfa139-b339-4beb-9025-bef0886d2629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:06.287069 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-d0dfa139-b339-4beb-9025-bef0886d2629 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:06.288250 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d0dfa139-b339-4beb-9025-bef0886d2629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:06.297376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1046/2119] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:06.306784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfa139-b339-4beb-9025-bef0886d2629 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:06.317539 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfa139-b339-4beb-9025-bef0886d2629 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:06.322773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36e3f9-5ec8-412d-9149-ad78ca569af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:06.326374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36e3f9-5ec8-412d-9149-ad78ca569af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:06.326374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36e3f9-5ec8-412d-9149-ad78ca569af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:06.326374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36e3f9-5ec8-412d-9149-ad78ca569af0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:06.326374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36e3f9-5ec8-412d-9149-ad78ca569af0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:05:06.326374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36e3f9-5ec8-412d-9149-ad78ca569af0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:06.326800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36e3f9-5ec8-412d-9149-ad78ca569af0 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:06.339905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1047/2120] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:05:06.344262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36e3f9-5ec8-412d-9149-ad78ca569af0 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:06.354673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36e3f9-5ec8-412d-9149-ad78ca569af0 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:06.360217 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8b001-e962-44e7-aa0b-2b15977a6da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:06.360872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8b001-e962-44e7-aa0b-2b15977a6da2 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:06.361177 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8b001-e962-44e7-aa0b-2b15977a6da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:06.361455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8b001-e962-44e7-aa0b-2b15977a6da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:06.362156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8b001-e962-44e7-aa0b-2b15977a6da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:06.364180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8b001-e962-44e7-aa0b-2b15977a6da2 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:06.367976 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1074/2121] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:06 2022] PUT /identity/v3/projects/38184b85095d455784690b0366fc939d/users/6ce1e972dc9c44d08fb96e5dcefbc60a/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:06.384914 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a8d4f-3a42-44e1-9d28-e48513954dd5 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:06.385297 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a8d4f-3a42-44e1-9d28-e48513954dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:06.385542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a8d4f-3a42-44e1-9d28-e48513954dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:06.428841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-204a8d4f-3a42-44e1-9d28-e48513954dd5 None None] MFA Rules not processed for user `6ce1e972dc9c44d08fb96e5dcefbc60a`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:06.428841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-204a8d4f-3a42-44e1-9d28-e48513954dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:06.506415 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1075/2122] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:06.510352 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a8d4f-3a42-44e1-9d28-e48513954dd5 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:06.515472 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1048/2123] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:06 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:05:06.522266 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8b001-e962-44e7-aa0b-2b15977a6da2 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:06.592164 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a8d4f-3a42-44e1-9d28-e48513954dd5 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:06.604110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8b001-e962-44e7-aa0b-2b15977a6da2 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:06.620090 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab84fdc-321b-4b14-81d8-e4b773cd3920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:06.621117 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab84fdc-321b-4b14-81d8-e4b773cd3920 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:06.621599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab84fdc-321b-4b14-81d8-e4b773cd3920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:06.621978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab84fdc-321b-4b14-81d8-e4b773cd3920 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:06.622819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab84fdc-321b-4b14-81d8-e4b773cd3920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:06.627809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab84fdc-321b-4b14-81d8-e4b773cd3920 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:06.633284 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:06.672972 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629312fb-edfe-4b7a-8e6b-c737c94ad8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:06.673689 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629312fb-edfe-4b7a-8e6b-c737c94ad8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:06.674002 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629312fb-edfe-4b7a-8e6b-c737c94ad8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:06.674283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629312fb-edfe-4b7a-8e6b-c737c94ad8b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:06.675027 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629312fb-edfe-4b7a-8e6b-c737c94ad8b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:06.677073 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629312fb-edfe-4b7a-8e6b-c737c94ad8b9 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:06.776251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1049/2124] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:06 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:06.780620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab84fdc-321b-4b14-81d8-e4b773cd3920 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:06.796643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab84fdc-321b-4b14-81d8-e4b773cd3920 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:06.803535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f76ce1-7b9a-453f-b479-990f49f99dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:06.804226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f76ce1-7b9a-453f-b479-990f49f99dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:06.804517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f76ce1-7b9a-453f-b479-990f49f99dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:06.804798 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f76ce1-7b9a-453f-b479-990f49f99dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:06.805596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f76ce1-7b9a-453f-b479-990f49f99dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:06.809704 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f76ce1-7b9a-453f-b479-990f49f99dc5 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:06.824807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1076/2125] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:06 2022] POST /identity/v3/projects => generated 387 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:06.833791 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1050/2126] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:05:06.834888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f76ce1-7b9a-453f-b479-990f49f99dc5 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:06.842080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629312fb-edfe-4b7a-8e6b-c737c94ad8b9 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:06.846394 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f76ce1-7b9a-453f-b479-990f49f99dc5 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:06.846701 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-629312fb-edfe-4b7a-8e6b-c737c94ad8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:06.959256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de57b0e-3072-46e9-a224-77ee9e01f4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:06.961851 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de57b0e-3072-46e9-a224-77ee9e01f4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:06.962601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de57b0e-3072-46e9-a224-77ee9e01f4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:06.963305 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de57b0e-3072-46e9-a224-77ee9e01f4d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:06.964585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de57b0e-3072-46e9-a224-77ee9e01f4d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:06.967286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de57b0e-3072-46e9-a224-77ee9e01f4d3 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:06.970981 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629312fb-edfe-4b7a-8e6b-c737c94ad8b9 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:06.976474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07497091-182a-4804-bf60-c14ee4d798da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:06.977655 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07497091-182a-4804-bf60-c14ee4d798da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:06.978123 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07497091-182a-4804-bf60-c14ee4d798da admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:06.978588 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07497091-182a-4804-bf60-c14ee4d798da admin admin] PATH_INFO: `/v3/projects/e30e856a53cb4727af62b5674a92f9b9` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:06.980196 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07497091-182a-4804-bf60-c14ee4d798da admin admin] RBAC: Authorizing `identity:delete_project(project_id=e30e856a53cb4727af62b5674a92f9b9)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:06.983123 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07497091-182a-4804-bf60-c14ee4d798da admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:07.097649 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1051/2127] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:06 2022] POST /identity/v3/users => generated 300 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:07.098336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de57b0e-3072-46e9-a224-77ee9e01f4d3 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:07.109793 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de57b0e-3072-46e9-a224-77ee9e01f4d3 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:07.116682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e5912-6e6b-4b7f-9d70-786b4889271b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:07.118004 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e5912-6e6b-4b7f-9d70-786b4889271b admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:07.118618 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e5912-6e6b-4b7f-9d70-786b4889271b admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:07.119340 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e5912-6e6b-4b7f-9d70-786b4889271b admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:07.120528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e5912-6e6b-4b7f-9d70-786b4889271b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:07.123027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e5912-6e6b-4b7f-9d70-786b4889271b admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:07.139127 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1052/2128] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:07.139127 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e5912-6e6b-4b7f-9d70-786b4889271b admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:07.141416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-07497091-182a-4804-bf60-c14ee4d798da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e30e856a53cb4727af62b5674a92f9b9', 'request_id': 'req-07497091-182a-4804-bf60-c14ee4d798da'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:07.144594 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-07497091-182a-4804-bf60-c14ee4d798da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e30e856a53cb4727af62b5674a92f9b9', 'request_id': 'req-07497091-182a-4804-bf60-c14ee4d798da'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:07.148050 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e5912-6e6b-4b7f-9d70-786b4889271b admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:07.151072 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-07497091-182a-4804-bf60-c14ee4d798da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e30e856a53cb4727af62b5674a92f9b9', 'request_id': 'req-07497091-182a-4804-bf60-c14ee4d798da'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:07.234496 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d3b5f-eb4d-454b-83b2-5eafedd2fb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:07.235359 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d3b5f-eb4d-454b-83b2-5eafedd2fb1a admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:07.235769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d3b5f-eb4d-454b-83b2-5eafedd2fb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:07.236005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d3b5f-eb4d-454b-83b2-5eafedd2fb1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:07.236687 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d3b5f-eb4d-454b-83b2-5eafedd2fb1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:07.238326 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d3b5f-eb4d-454b-83b2-5eafedd2fb1a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:07.254162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-07497091-182a-4804-bf60-c14ee4d798da admin admin] The token cache is being invalidate because project e30e856a53cb4727af62b5674a92f9b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:07.254162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-07497091-182a-4804-bf60-c14ee4d798da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:07.254162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-07497091-182a-4804-bf60-c14ee4d798da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:07.254162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1077/2129] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:06 2022] DELETE /identity/v3/projects/e30e856a53cb4727af62b5674a92f9b9 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:07.254162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07497091-182a-4804-bf60-c14ee4d798da admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:07.254932 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1053/2130] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:07.256145 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d3b5f-eb4d-454b-83b2-5eafedd2fb1a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:07.258888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-07497091-182a-4804-bf60-c14ee4d798da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:07.262290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-152d3b5f-eb4d-454b-83b2-5eafedd2fb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:07.280318 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07497091-182a-4804-bf60-c14ee4d798da admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:07.283164 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d3b5f-eb4d-454b-83b2-5eafedd2fb1a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:07.288276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de6c4d-5b96-49f3-b603-aa08fc75461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:07.290234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de6c4d-5b96-49f3-b603-aa08fc75461a admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:07.290234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de6c4d-5b96-49f3-b603-aa08fc75461a admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:07.290687 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de6c4d-5b96-49f3-b603-aa08fc75461a admin admin] PATH_INFO: `/v3/projects/0bb542b2876c45068095f2fbca08ee48/users/0a3775f4f5174656bb2640cf04634100/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:07.290809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc2814-1a09-4634-be82-c3cd59b737af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:07.292153 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc2814-1a09-4634-be82-c3cd59b737af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:07.292600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc2814-1a09-4634-be82-c3cd59b737af admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:07.293040 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc2814-1a09-4634-be82-c3cd59b737af admin admin] PATH_INFO: `/v3/users/6fbf69e23d49448bab2a969874ca9174` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:07.295056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc2814-1a09-4634-be82-c3cd59b737af admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fbf69e23d49448bab2a969874ca9174)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:07.299455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc2814-1a09-4634-be82-c3cd59b737af admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:07.320734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de6c4d-5b96-49f3-b603-aa08fc75461a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bb542b2876c45068095f2fbca08ee48, user_id=0a3775f4f5174656bb2640cf04634100, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:07.322639 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de6c4d-5b96-49f3-b603-aa08fc75461a admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:07.466571 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1078/2131] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:07 2022] PUT /identity/v3/projects/0bb542b2876c45068095f2fbca08ee48/users/0a3775f4f5174656bb2640cf04634100/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:07.467580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de6c4d-5b96-49f3-b603-aa08fc75461a admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:07.469850 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b5de6c4d-5b96-49f3-b603-aa08fc75461a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:07.560213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de6c4d-5b96-49f3-b603-aa08fc75461a admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:07.566140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a6fb2-ce09-44b7-ab94-2634d09aa4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:07.567202 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a6fb2-ce09-44b7-ab94-2634d09aa4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:07.567489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a6fb2-ce09-44b7-ab94-2634d09aa4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:07.567771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a6fb2-ce09-44b7-ab94-2634d09aa4c1 admin admin] PATH_INFO: `/v3/projects/e71a792622ee4a6294d4bfe508ef9fad/users/ec1d5abe46bd45ddaa775224e83cb4b2/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:07.584501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a6fb2-ce09-44b7-ab94-2634d09aa4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71a792622ee4a6294d4bfe508ef9fad, user_id=ec1d5abe46bd45ddaa775224e83cb4b2, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:07.587204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a6fb2-ce09-44b7-ab94-2634d09aa4c1 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:07.612088 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-94bc2814-1a09-4634-be82-c3cd59b737af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fbf69e23d49448bab2a969874ca9174'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:07.612799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-94bc2814-1a09-4634-be82-c3cd59b737af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fbf69e23d49448bab2a969874ca9174'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:07.626130 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-94bc2814-1a09-4634-be82-c3cd59b737af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fbf69e23d49448bab2a969874ca9174'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:07.628393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-94bc2814-1a09-4634-be82-c3cd59b737af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fbf69e23d49448bab2a969874ca9174'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:07.713926 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1079/2132] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:07 2022] PUT /identity/v3/projects/e71a792622ee4a6294d4bfe508ef9fad/users/ec1d5abe46bd45ddaa775224e83cb4b2/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:07.715642 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cfe7b-4791-455a-8d5f-6f8bd44be160 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:07.716028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cfe7b-4791-455a-8d5f-6f8bd44be160 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:07.716399 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cfe7b-4791-455a-8d5f-6f8bd44be160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:07.728865 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-94bc2814-1a09-4634-be82-c3cd59b737af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fbf69e23d49448bab2a969874ca9174'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:07.742716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-433cfe7b-4791-455a-8d5f-6f8bd44be160 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:07.744788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-433cfe7b-4791-455a-8d5f-6f8bd44be160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:07.755349 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1054/2133] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:07 2022] DELETE /identity/v3/users/6fbf69e23d49448bab2a969874ca9174 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:07.756415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc2814-1a09-4634-be82-c3cd59b737af admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:07.757872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-94bc2814-1a09-4634-be82-c3cd59b737af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:07.819202 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1080/2134] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:07.824128 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:07.835041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cfe7b-4791-455a-8d5f-6f8bd44be160 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:07.835041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-433cfe7b-4791-455a-8d5f-6f8bd44be160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:07.839839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc2814-1a09-4634-be82-c3cd59b737af admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:07.851748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70c4e2-a4b5-45e1-9537-56af3be77ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:07.852490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70c4e2-a4b5-45e1-9537-56af3be77ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:07.852780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70c4e2-a4b5-45e1-9537-56af3be77ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:07.853065 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70c4e2-a4b5-45e1-9537-56af3be77ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:07.853907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70c4e2-a4b5-45e1-9537-56af3be77ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:07.855776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70c4e2-a4b5-45e1-9537-56af3be77ddc admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:07.868332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1055/2135] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:07.872982 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70c4e2-a4b5-45e1-9537-56af3be77ddc admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:07.884293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70c4e2-a4b5-45e1-9537-56af3be77ddc admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:07.889392 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ba8ef-abc8-4da2-91fd-e282741066de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:07.890845 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ba8ef-abc8-4da2-91fd-e282741066de admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:07.891141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ba8ef-abc8-4da2-91fd-e282741066de admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:07.891449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ba8ef-abc8-4da2-91fd-e282741066de admin admin] PATH_INFO: `/v3/projects/e71a792622ee4a6294d4bfe508ef9fad/users/ec1d5abe46bd45ddaa775224e83cb4b2/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:07.893636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ba8ef-abc8-4da2-91fd-e282741066de admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71a792622ee4a6294d4bfe508ef9fad, user_id=ec1d5abe46bd45ddaa775224e83cb4b2, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:07.896338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ba8ef-abc8-4da2-91fd-e282741066de admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:07.906400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cfe7b-4791-455a-8d5f-6f8bd44be160 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:07.911539 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1056/2136] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:07 2022] PUT /identity/v3/projects/e71a792622ee4a6294d4bfe508ef9fad/users/ec1d5abe46bd45ddaa775224e83cb4b2/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:07.922427 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b069b78-36fc-4c05-b0ce-d6d4124e2047 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:07.922712 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b069b78-36fc-4c05-b0ce-d6d4124e2047 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:07.922970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b069b78-36fc-4c05-b0ce-d6d4124e2047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:07.965992 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-2b069b78-36fc-4c05-b0ce-d6d4124e2047 None None] MFA Rules not processed for user `ec1d5abe46bd45ddaa775224e83cb4b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:07.967289 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2b069b78-36fc-4c05-b0ce-d6d4124e2047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:07.988624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238e88a-16c9-4de1-a913-01e5fa3281fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:07.990502 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e88a-16c9-4de1-a913-01e5fa3281fe service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:07.991036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e88a-16c9-4de1-a913-01e5fa3281fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:07.991759 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e88a-16c9-4de1-a913-01e5fa3281fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:07.994286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:08.089685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1057/2137] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:08.102564 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b069b78-36fc-4c05-b0ce-d6d4124e2047 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:08.104389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2b069b78-36fc-4c05-b0ce-d6d4124e2047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:08.115724 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238e88a-16c9-4de1-a913-01e5fa3281fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:08.118142 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238e88a-16c9-4de1-a913-01e5fa3281fe service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:08.132083 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1081/2138] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:05:08.180566 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b069b78-36fc-4c05-b0ce-d6d4124e2047 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:08.184603 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1162f-b769-4a69-879c-1fc2a007b2d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:08.185306 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1162f-b769-4a69-879c-1fc2a007b2d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:08.185601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1162f-b769-4a69-879c-1fc2a007b2d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:08.185883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1162f-b769-4a69-879c-1fc2a007b2d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:08.198113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1162f-b769-4a69-879c-1fc2a007b2d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:08.200566 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1162f-b769-4a69-879c-1fc2a007b2d2 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:08.212326 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1058/2139] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:05:08.290237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238e88a-16c9-4de1-a913-01e5fa3281fe service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:08.308092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238e88a-16c9-4de1-a913-01e5fa3281fe service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:08.312604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25790f7-dc92-4ecd-b3d7-190cdcf3a74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:08.313540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25790f7-dc92-4ecd-b3d7-190cdcf3a74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:08.313831 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25790f7-dc92-4ecd-b3d7-190cdcf3a74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:08.314143 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25790f7-dc92-4ecd-b3d7-190cdcf3a74f admin admin] PATH_INFO: `/v3/users/6ce1e972dc9c44d08fb96e5dcefbc60a` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:08.315493 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25790f7-dc92-4ecd-b3d7-190cdcf3a74f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce1e972dc9c44d08fb96e5dcefbc60a)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:08.317714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25790f7-dc92-4ecd-b3d7-190cdcf3a74f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:08.408756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:08.418679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1162f-b769-4a69-879c-1fc2a007b2d2 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:08.420379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a2c1162f-b769-4a69-879c-1fc2a007b2d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:08.439221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1162f-b769-4a69-879c-1fc2a007b2d2 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:08.447817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6097e6-e511-4feb-b551-e0c966a48509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:08.448854 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6097e6-e511-4feb-b551-e0c966a48509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:08.449163 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6097e6-e511-4feb-b551-e0c966a48509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:08.449457 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6097e6-e511-4feb-b551-e0c966a48509 admin admin] PATH_INFO: `/v3/projects/a22b87987f2d49a0ac68838f49bf71f7` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:08.451015 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6097e6-e511-4feb-b551-e0c966a48509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22b87987f2d49a0ac68838f49bf71f7)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:08.453499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6097e6-e511-4feb-b551-e0c966a48509 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:08.838816 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-f25790f7-dc92-4ecd-b3d7-190cdcf3a74f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce1e972dc9c44d08fb96e5dcefbc60a'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:08.842514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-5b6097e6-e511-4feb-b551-e0c966a48509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22b87987f2d49a0ac68838f49bf71f7', 'request_id': 'req-5b6097e6-e511-4feb-b551-e0c966a48509'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:08.849693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-f25790f7-dc92-4ecd-b3d7-190cdcf3a74f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce1e972dc9c44d08fb96e5dcefbc60a'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:08.850869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-f25790f7-dc92-4ecd-b3d7-190cdcf3a74f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce1e972dc9c44d08fb96e5dcefbc60a'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:08.851038 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-5b6097e6-e511-4feb-b551-e0c966a48509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22b87987f2d49a0ac68838f49bf71f7', 'request_id': 'req-5b6097e6-e511-4feb-b551-e0c966a48509'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:08.861259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-5b6097e6-e511-4feb-b551-e0c966a48509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22b87987f2d49a0ac68838f49bf71f7', 'request_id': 'req-5b6097e6-e511-4feb-b551-e0c966a48509'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:08.871935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-f25790f7-dc92-4ecd-b3d7-190cdcf3a74f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce1e972dc9c44d08fb96e5dcefbc60a'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:08.873440 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-f25790f7-dc92-4ecd-b3d7-190cdcf3a74f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce1e972dc9c44d08fb96e5dcefbc60a'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:08.995334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-5b6097e6-e511-4feb-b551-e0c966a48509 admin admin] The token cache is being invalidate because project a22b87987f2d49a0ac68838f49bf71f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:08.995860 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-5b6097e6-e511-4feb-b551-e0c966a48509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:08.996859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-5b6097e6-e511-4feb-b551-e0c966a48509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:08.999195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1059/2140] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:08 2022] DELETE /identity/v3/projects/a22b87987f2d49a0ac68838f49bf71f7 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:05:09.004896 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31bc7c-8bd9-47fc-9322-439bb1bfdb1d None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:09.005221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31bc7c-8bd9-47fc-9322-439bb1bfdb1d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:09.005506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31bc7c-8bd9-47fc-9322-439bb1bfdb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:09.025912 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-fe31bc7c-8bd9-47fc-9322-439bb1bfdb1d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:09.027169 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-fe31bc7c-8bd9-47fc-9322-439bb1bfdb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:09.061155 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1082/2141] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:08 2022] DELETE /identity/v3/users/6ce1e972dc9c44d08fb96e5dcefbc60a => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:09.068001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2061d-aa9d-4b47-b8eb-78d50c358333 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:09.068298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2061d-aa9d-4b47-b8eb-78d50c358333 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:09.069479 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2061d-aa9d-4b47-b8eb-78d50c358333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:09.095340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-a0f2061d-aa9d-4b47-b8eb-78d50c358333 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:09.096747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a0f2061d-aa9d-4b47-b8eb-78d50c358333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:09.107361 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1060/2142] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:09.115204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac463c8-5ef0-4966-84b3-b850a4acab94 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:09.115613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac463c8-5ef0-4966-84b3-b850a4acab94 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:09.116094 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac463c8-5ef0-4966-84b3-b850a4acab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:09.138434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-eac463c8-5ef0-4966-84b3-b850a4acab94 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:09.139782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-eac463c8-5ef0-4966-84b3-b850a4acab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:09.184365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1083/2143] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:09.196088 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2061d-aa9d-4b47-b8eb-78d50c358333 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:09.200497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a0f2061d-aa9d-4b47-b8eb-78d50c358333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:09.218593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1061/2144] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:09.222973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac463c8-5ef0-4966-84b3-b850a4acab94 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:09.237715 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac463c8-5ef0-4966-84b3-b850a4acab94 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:09.242942 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a3a8a-09e7-4d78-a35f-b50f875da223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:09.243639 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a3a8a-09e7-4d78-a35f-b50f875da223 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:09.244041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a3a8a-09e7-4d78-a35f-b50f875da223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:09.244324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a3a8a-09e7-4d78-a35f-b50f875da223 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:09.245071 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a3a8a-09e7-4d78-a35f-b50f875da223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:05:09.245573 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a3a8a-09e7-4d78-a35f-b50f875da223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:09.247286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a3a8a-09e7-4d78-a35f-b50f875da223 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:09.267666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1062/2145] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:05:09.267666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a3a8a-09e7-4d78-a35f-b50f875da223 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:09.274824 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2061d-aa9d-4b47-b8eb-78d50c358333 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:09.277686 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a3a8a-09e7-4d78-a35f-b50f875da223 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:09.278734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d57734-b8e7-4574-be7d-d8b96d7e1685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:09.279400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d57734-b8e7-4574-be7d-d8b96d7e1685 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:09.279686 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d57734-b8e7-4574-be7d-d8b96d7e1685 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:09.279962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d57734-b8e7-4574-be7d-d8b96d7e1685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:09.284334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b846b2-6ff9-4444-a861-bda6fd32a074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:09.285017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b846b2-6ff9-4444-a861-bda6fd32a074 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:09.285340 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b846b2-6ff9-4444-a861-bda6fd32a074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:09.285625 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b846b2-6ff9-4444-a861-bda6fd32a074 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:09.286352 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b846b2-6ff9-4444-a861-bda6fd32a074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:09.288314 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b846b2-6ff9-4444-a861-bda6fd32a074 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:09.290898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d57734-b8e7-4574-be7d-d8b96d7e1685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:09.292391 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d57734-b8e7-4574-be7d-d8b96d7e1685 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:09.307214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1084/2146] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:05:09.411419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1063/2147] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:09 2022] POST /identity/v3/projects => generated 401 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:09.416691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d57734-b8e7-4574-be7d-d8b96d7e1685 service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:09.433258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d57734-b8e7-4574-be7d-d8b96d7e1685 service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:09.506101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66bd5a-bfd6-4eba-9c06-3f2a23ceeadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:09.506872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66bd5a-bfd6-4eba-9c06-3f2a23ceeadd admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:09.507378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66bd5a-bfd6-4eba-9c06-3f2a23ceeadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:09.507739 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66bd5a-bfd6-4eba-9c06-3f2a23ceeadd admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:09.508503 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66bd5a-bfd6-4eba-9c06-3f2a23ceeadd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:09.512080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66bd5a-bfd6-4eba-9c06-3f2a23ceeadd admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:09.680651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1085/2148] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:09 2022] POST /identity/v3/users => generated 301 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:05:09.680779 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b846b2-6ff9-4444-a861-bda6fd32a074 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:09.689425 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b846b2-6ff9-4444-a861-bda6fd32a074 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:09.694693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd900fc7-e604-488b-953b-32cf240de9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:09.701433 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd900fc7-e604-488b-953b-32cf240de9db admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:09.701816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd900fc7-e604-488b-953b-32cf240de9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:09.702109 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd900fc7-e604-488b-953b-32cf240de9db admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:09.703414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd900fc7-e604-488b-953b-32cf240de9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:09.705055 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd900fc7-e604-488b-953b-32cf240de9db admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:09.720469 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1064/2149] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:09.742979 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66bd5a-bfd6-4eba-9c06-3f2a23ceeadd admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:09.756285 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66bd5a-bfd6-4eba-9c06-3f2a23ceeadd admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:09.761797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0c2eb-9875-46cf-b974-2cbcc61703e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:09.762693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0c2eb-9875-46cf-b974-2cbcc61703e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:09.763079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0c2eb-9875-46cf-b974-2cbcc61703e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:09.763456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0c2eb-9875-46cf-b974-2cbcc61703e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:09.766252 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0c2eb-9875-46cf-b974-2cbcc61703e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:09.769471 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0c2eb-9875-46cf-b974-2cbcc61703e0 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:09.784365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1086/2150] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:05:09.785368 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd900fc7-e604-488b-953b-32cf240de9db admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:09.799420 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd900fc7-e604-488b-953b-32cf240de9db admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:09.804628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249bbbe-babc-4bca-bae9-1ffa77c526f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:09.805916 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249bbbe-babc-4bca-bae9-1ffa77c526f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:09.806212 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249bbbe-babc-4bca-bae9-1ffa77c526f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:09.806641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249bbbe-babc-4bca-bae9-1ffa77c526f6 admin admin] PATH_INFO: `/v3/projects/7fa1e2d30e3f42c9be59813286132661/users/3e96610f6e924314817be1cc919d9924/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:09.833536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249bbbe-babc-4bca-bae9-1ffa77c526f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa1e2d30e3f42c9be59813286132661, user_id=3e96610f6e924314817be1cc919d9924, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:09.836408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249bbbe-babc-4bca-bae9-1ffa77c526f6 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:10.013619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1065/2151] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:09 2022] PUT /identity/v3/projects/7fa1e2d30e3f42c9be59813286132661/users/3e96610f6e924314817be1cc919d9924/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:10.018639 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0c2eb-9875-46cf-b974-2cbcc61703e0 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:10.020733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-96e0c2eb-9875-46cf-b974-2cbcc61703e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:10.031876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485e063-d098-4bb4-b4a8-780838e310af None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:10.032487 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485e063-d098-4bb4-b4a8-780838e310af None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:10.034227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485e063-d098-4bb4-b4a8-780838e310af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:10.039905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0c2eb-9875-46cf-b974-2cbcc61703e0 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:10.072211 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-e485e063-d098-4bb4-b4a8-780838e310af None None] MFA Rules not processed for user `3e96610f6e924314817be1cc919d9924`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:10.073661 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e485e063-d098-4bb4-b4a8-780838e310af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:10.121191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26dacb-cca8-4a8f-863a-1636b04a6327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:10.122574 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26dacb-cca8-4a8f-863a-1636b04a6327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:10.123038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26dacb-cca8-4a8f-863a-1636b04a6327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:10.123513 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26dacb-cca8-4a8f-863a-1636b04a6327 admin admin] PATH_INFO: `/v3/projects/38184b85095d455784690b0366fc939d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:10.125681 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26dacb-cca8-4a8f-863a-1636b04a6327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38184b85095d455784690b0366fc939d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:10.129288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26dacb-cca8-4a8f-863a-1636b04a6327 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:10.168561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1066/2152] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:10.177456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485e063-d098-4bb4-b4a8-780838e310af None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:10.197396 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485e063-d098-4bb4-b4a8-780838e310af None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:10.206739 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da73d1-4e65-4385-8ce3-7dff68792288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:10.207475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da73d1-4e65-4385-8ce3-7dff68792288 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:10.207761 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da73d1-4e65-4385-8ce3-7dff68792288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:10.208920 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da73d1-4e65-4385-8ce3-7dff68792288 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:10.209692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da73d1-4e65-4385-8ce3-7dff68792288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:10.212879 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da73d1-4e65-4385-8ce3-7dff68792288 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:10.317907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1067/2153] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:10 2022] POST /identity/v3/projects => generated 399 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:05:10.317907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef90c3-1996-4674-ba43-7c668b6c8dab None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:10.317907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef90c3-1996-4674-ba43-7c668b6c8dab None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:10.317907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef90c3-1996-4674-ba43-7c668b6c8dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:10.318852 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ca26dacb-cca8-4a8f-863a-1636b04a6327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38184b85095d455784690b0366fc939d', 'request_id': 'req-ca26dacb-cca8-4a8f-863a-1636b04a6327'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:10.328582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ca26dacb-cca8-4a8f-863a-1636b04a6327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38184b85095d455784690b0366fc939d', 'request_id': 'req-ca26dacb-cca8-4a8f-863a-1636b04a6327'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:10.335437 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ca26dacb-cca8-4a8f-863a-1636b04a6327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38184b85095d455784690b0366fc939d', 'request_id': 'req-ca26dacb-cca8-4a8f-863a-1636b04a6327'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:10.338389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:10.357518 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-7cef90c3-1996-4674-ba43-7c668b6c8dab None None] MFA Rules not processed for user `0a3775f4f5174656bb2640cf04634100`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:10.359901 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-7cef90c3-1996-4674-ba43-7c668b6c8dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:10.435502 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ca26dacb-cca8-4a8f-863a-1636b04a6327 admin admin] The token cache is being invalidate because project 38184b85095d455784690b0366fc939d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:10.435873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ca26dacb-cca8-4a8f-863a-1636b04a6327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:10.436576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ca26dacb-cca8-4a8f-863a-1636b04a6327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:10.441331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1087/2154] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:10 2022] DELETE /identity/v3/projects/38184b85095d455784690b0366fc939d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:10.441331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26dacb-cca8-4a8f-863a-1636b04a6327 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:10.441331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ca26dacb-cca8-4a8f-863a-1636b04a6327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:10.445760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1068/2155] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:10.446475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef90c3-1996-4674-ba43-7c668b6c8dab None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:10.534111 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:10.537282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef90c3-1996-4674-ba43-7c668b6c8dab None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:10.544479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeff8e4-030b-4b5f-925b-5f4221eb5829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:10.545438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeff8e4-030b-4b5f-925b-5f4221eb5829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:10.551817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeff8e4-030b-4b5f-925b-5f4221eb5829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:10.551817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeff8e4-030b-4b5f-925b-5f4221eb5829 admin admin] PATH_INFO: `/v3/users/ec1d5abe46bd45ddaa775224e83cb4b2` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:10.558140 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeff8e4-030b-4b5f-925b-5f4221eb5829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1d5abe46bd45ddaa775224e83cb4b2)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:10.558140 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeff8e4-030b-4b5f-925b-5f4221eb5829 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:10.558641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26dacb-cca8-4a8f-863a-1636b04a6327 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:10.579248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e646f-dba8-4c82-bc54-286d4e63b75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:10.580256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e646f-dba8-4c82-bc54-286d4e63b75f admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:10.580256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e646f-dba8-4c82-bc54-286d4e63b75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:10.580514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e646f-dba8-4c82-bc54-286d4e63b75f admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:10.581354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e646f-dba8-4c82-bc54-286d4e63b75f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:10.583307 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e646f-dba8-4c82-bc54-286d4e63b75f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:10.713945 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1088/2156] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:10 2022] POST /identity/v3/users => generated 306 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:10.714774 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e646f-dba8-4c82-bc54-286d4e63b75f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:10.720668 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ae8e646f-dba8-4c82-bc54-286d4e63b75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:10.738186 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e646f-dba8-4c82-bc54-286d4e63b75f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:10.750231 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81d9f3-a729-4008-abd9-a70b9f8fa4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:10.750945 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81d9f3-a729-4008-abd9-a70b9f8fa4bc admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:10.751242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81d9f3-a729-4008-abd9-a70b9f8fa4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:10.751567 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81d9f3-a729-4008-abd9-a70b9f8fa4bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:10.752405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81d9f3-a729-4008-abd9-a70b9f8fa4bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:10.754475 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81d9f3-a729-4008-abd9-a70b9f8fa4bc admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:10.889378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-daeff8e4-030b-4b5f-925b-5f4221eb5829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1d5abe46bd45ddaa775224e83cb4b2'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:10.890569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-daeff8e4-030b-4b5f-925b-5f4221eb5829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1d5abe46bd45ddaa775224e83cb4b2'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:10.897485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-daeff8e4-030b-4b5f-925b-5f4221eb5829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1d5abe46bd45ddaa775224e83cb4b2'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:10.898134 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-daeff8e4-030b-4b5f-925b-5f4221eb5829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1d5abe46bd45ddaa775224e83cb4b2'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:10.947838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1089/2157] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:10 2022] POST /identity/v3/projects => generated 373 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:10.948927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81d9f3-a729-4008-abd9-a70b9f8fa4bc admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:10.950674 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4e81d9f3-a729-4008-abd9-a70b9f8fa4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:11.036658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81d9f3-a729-4008-abd9-a70b9f8fa4bc admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:11.041526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d628b-6748-481a-ac2f-ec2f41455cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:11.042298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d628b-6748-481a-ac2f-ec2f41455cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:11.042587 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d628b-6748-481a-ac2f-ec2f41455cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:11.042872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d628b-6748-481a-ac2f-ec2f41455cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:11.043611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d628b-6748-481a-ac2f-ec2f41455cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:11.045261 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d628b-6748-481a-ac2f-ec2f41455cd6 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:11.055980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1090/2158] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:11.056870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d628b-6748-481a-ac2f-ec2f41455cd6 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:11.058612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-467d628b-6748-481a-ac2f-ec2f41455cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:11.072690 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d628b-6748-481a-ac2f-ec2f41455cd6 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:11.077239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-daeff8e4-030b-4b5f-925b-5f4221eb5829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1d5abe46bd45ddaa775224e83cb4b2'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:11.077713 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c36bc3-d0d2-4544-9390-ef02414175f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:11.086009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c36bc3-d0d2-4544-9390-ef02414175f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:11.086009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c36bc3-d0d2-4544-9390-ef02414175f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:11.086009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c36bc3-d0d2-4544-9390-ef02414175f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:11.086009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c36bc3-d0d2-4544-9390-ef02414175f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:11.086009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c36bc3-d0d2-4544-9390-ef02414175f6 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:11.099004 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1069/2159] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:10 2022] DELETE /identity/v3/users/ec1d5abe46bd45ddaa775224e83cb4b2 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:11.099858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeff8e4-030b-4b5f-925b-5f4221eb5829 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:11.165984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeff8e4-030b-4b5f-925b-5f4221eb5829 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:11.171766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4602fb-65f7-47fd-a725-e1b2a6312b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:11.172610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4602fb-65f7-47fd-a725-e1b2a6312b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:11.172904 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4602fb-65f7-47fd-a725-e1b2a6312b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:11.173364 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4602fb-65f7-47fd-a725-e1b2a6312b90 admin admin] PATH_INFO: `/v3/projects/ad7a492e49d34eabaf653dd33e03de69/users/35c110831e96415c9dc456f2d84633f4/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:11.191419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4602fb-65f7-47fd-a725-e1b2a6312b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad7a492e49d34eabaf653dd33e03de69, user_id=35c110831e96415c9dc456f2d84633f4, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:11.196310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4602fb-65f7-47fd-a725-e1b2a6312b90 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:11.242639 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1091/2160] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:11 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:11.246579 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c36bc3-d0d2-4544-9390-ef02414175f6 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:11.259570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c36bc3-d0d2-4544-9390-ef02414175f6 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:11.264630 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1641f50-ea3d-4354-b1c7-23b80114bf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:11.265388 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1641f50-ea3d-4354-b1c7-23b80114bf0f admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:11.265675 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1641f50-ea3d-4354-b1c7-23b80114bf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:11.265954 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1641f50-ea3d-4354-b1c7-23b80114bf0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:11.266787 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1641f50-ea3d-4354-b1c7-23b80114bf0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:11.268875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1641f50-ea3d-4354-b1c7-23b80114bf0f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:11.298211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1092/2161] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:05:11.300988 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1641f50-ea3d-4354-b1c7-23b80114bf0f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:11.311460 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1641f50-ea3d-4354-b1c7-23b80114bf0f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:11.316185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c974e6-7a74-4712-9fe0-a175913c0ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:11.317414 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c974e6-7a74-4712-9fe0-a175913c0ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:11.317706 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c974e6-7a74-4712-9fe0-a175913c0ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:11.317988 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c974e6-7a74-4712-9fe0-a175913c0ab5 admin admin] PATH_INFO: `/v3/projects/8abc66c85058453b96aef20075ff5e3d/users/98ba7b6718f440129efb215621e53b1c/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:11.335350 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c974e6-7a74-4712-9fe0-a175913c0ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8abc66c85058453b96aef20075ff5e3d, user_id=98ba7b6718f440129efb215621e53b1c, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:11.338472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c974e6-7a74-4712-9fe0-a175913c0ab5 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:11.382189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1070/2162] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:11 2022] PUT /identity/v3/projects/ad7a492e49d34eabaf653dd33e03de69/users/35c110831e96415c9dc456f2d84633f4/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:11.386182 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4602fb-65f7-47fd-a725-e1b2a6312b90 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:11.471650 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4602fb-65f7-47fd-a725-e1b2a6312b90 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:11.472543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1093/2163] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:11 2022] PUT /identity/v3/projects/8abc66c85058453b96aef20075ff5e3d/users/98ba7b6718f440129efb215621e53b1c/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:11.477948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c974e6-7a74-4712-9fe0-a175913c0ab5 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:11.541825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce4654-72c5-4472-a57b-fd20c2f8c01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:11.542897 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce4654-72c5-4472-a57b-fd20c2f8c01b admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:11.563034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce4654-72c5-4472-a57b-fd20c2f8c01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:11.563034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce4654-72c5-4472-a57b-fd20c2f8c01b admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:11.563034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce4654-72c5-4472-a57b-fd20c2f8c01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:11.563034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce4654-72c5-4472-a57b-fd20c2f8c01b admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:11.563034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1071/2164] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:05:11.564321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce4654-72c5-4472-a57b-fd20c2f8c01b admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:11.574995 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c974e6-7a74-4712-9fe0-a175913c0ab5 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:11.576470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce4654-72c5-4472-a57b-fd20c2f8c01b admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:11.580292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a49c4-f28f-40e2-8291-1314385ffd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:11.580983 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a49c4-f28f-40e2-8291-1314385ffd7d admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:11.581402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a49c4-f28f-40e2-8291-1314385ffd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:11.581685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a49c4-f28f-40e2-8291-1314385ffd7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:11.582539 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a49c4-f28f-40e2-8291-1314385ffd7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:11.590043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3d7d7-e669-4fb0-9436-383581a12e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:11.590296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a49c4-f28f-40e2-8291-1314385ffd7d admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:11.590388 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3d7d7-e669-4fb0-9436-383581a12e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:11.590388 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3d7d7-e669-4fb0-9436-383581a12e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:11.590388 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3d7d7-e669-4fb0-9436-383581a12e20 admin admin] PATH_INFO: `/v3/projects/ad7a492e49d34eabaf653dd33e03de69/users/35c110831e96415c9dc456f2d84633f4/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:11.590388 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3d7d7-e669-4fb0-9436-383581a12e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad7a492e49d34eabaf653dd33e03de69, user_id=35c110831e96415c9dc456f2d84633f4, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:11.595022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3d7d7-e669-4fb0-9436-383581a12e20 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:11.595512 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1094/2165] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:11.603591 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a49c4-f28f-40e2-8291-1314385ffd7d admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:11.622408 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a49c4-f28f-40e2-8291-1314385ffd7d admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:11.623098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1072/2166] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:11 2022] PUT /identity/v3/projects/ad7a492e49d34eabaf653dd33e03de69/users/35c110831e96415c9dc456f2d84633f4/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:11.624652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6475e7-b600-42df-8130-c405fa67e591 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:11.625030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6475e7-b600-42df-8130-c405fa67e591 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:11.625283 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6475e7-b600-42df-8130-c405fa67e591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:11.663440 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-5b6475e7-b600-42df-8130-c405fa67e591 None None] MFA Rules not processed for user `35c110831e96415c9dc456f2d84633f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:11.665424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-5b6475e7-b600-42df-8130-c405fa67e591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:11.696023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4f2c5-c1e2-432c-b167-497239e45d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:11.697017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4f2c5-c1e2-432c-b167-497239e45d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:11.697409 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4f2c5-c1e2-432c-b167-497239e45d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:11.697761 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4f2c5-c1e2-432c-b167-497239e45d10 admin admin] PATH_INFO: `/v3/projects/8abc66c85058453b96aef20075ff5e3d/users/98ba7b6718f440129efb215621e53b1c/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:11.699887 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4f2c5-c1e2-432c-b167-497239e45d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8abc66c85058453b96aef20075ff5e3d, user_id=98ba7b6718f440129efb215621e53b1c, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:11.703100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4f2c5-c1e2-432c-b167-497239e45d10 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:11.713989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1095/2167] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:11 2022] PUT /identity/v3/projects/8abc66c85058453b96aef20075ff5e3d/users/98ba7b6718f440129efb215621e53b1c/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:05:11.717497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4f2c5-c1e2-432c-b167-497239e45d10 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:11.720745 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-28e4f2c5-c1e2-432c-b167-497239e45d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:11.770657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1073/2168] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:11 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:11.770657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6475e7-b600-42df-8130-c405fa67e591 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:11.783644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-5b6475e7-b600-42df-8130-c405fa67e591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:11.800029 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6475e7-b600-42df-8130-c405fa67e591 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:11.825812 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4f2c5-c1e2-432c-b167-497239e45d10 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:11.830873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52127022-c2ff-45c4-b790-bde0a246aab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:11.830873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52127022-c2ff-45c4-b790-bde0a246aab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:11.831169 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52127022-c2ff-45c4-b790-bde0a246aab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:11.831273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52127022-c2ff-45c4-b790-bde0a246aab6 admin admin] PATH_INFO: `/v3/users/df6048d396ca4cc79818941a46b4d153` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:11.832514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52127022-c2ff-45c4-b790-bde0a246aab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6048d396ca4cc79818941a46b4d153)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:11.834593 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52127022-c2ff-45c4-b790-bde0a246aab6 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:11.886455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3036f2d-50de-4730-be19-1b866cc80d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:11.887436 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3036f2d-50de-4730-be19-1b866cc80d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:11.887730 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3036f2d-50de-4730-be19-1b866cc80d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:11.888072 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3036f2d-50de-4730-be19-1b866cc80d06 admin admin] PATH_INFO: `/v3/projects/e71a792622ee4a6294d4bfe508ef9fad` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:11.889558 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3036f2d-50de-4730-be19-1b866cc80d06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e71a792622ee4a6294d4bfe508ef9fad)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:11.892526 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3036f2d-50de-4730-be19-1b866cc80d06 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:12.083135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-52127022-c2ff-45c4-b790-bde0a246aab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6048d396ca4cc79818941a46b4d153'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:12.088286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d3036f2d-50de-4730-be19-1b866cc80d06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71a792622ee4a6294d4bfe508ef9fad', 'request_id': 'req-d3036f2d-50de-4730-be19-1b866cc80d06'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:12.093780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-52127022-c2ff-45c4-b790-bde0a246aab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6048d396ca4cc79818941a46b4d153'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:12.094657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-52127022-c2ff-45c4-b790-bde0a246aab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6048d396ca4cc79818941a46b4d153'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:12.096028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d3036f2d-50de-4730-be19-1b866cc80d06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71a792622ee4a6294d4bfe508ef9fad', 'request_id': 'req-d3036f2d-50de-4730-be19-1b866cc80d06'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:12.103694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d3036f2d-50de-4730-be19-1b866cc80d06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71a792622ee4a6294d4bfe508ef9fad', 'request_id': 'req-d3036f2d-50de-4730-be19-1b866cc80d06'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:12.115803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-52127022-c2ff-45c4-b790-bde0a246aab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6048d396ca4cc79818941a46b4d153'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:12.116863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-52127022-c2ff-45c4-b790-bde0a246aab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6048d396ca4cc79818941a46b4d153'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:12.242831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d3036f2d-50de-4730-be19-1b866cc80d06 admin admin] The token cache is being invalidate because project e71a792622ee4a6294d4bfe508ef9fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:12.243127 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d3036f2d-50de-4730-be19-1b866cc80d06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:12.243814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d3036f2d-50de-4730-be19-1b866cc80d06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:12.246151 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1074/2169] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:11 2022] DELETE /identity/v3/projects/e71a792622ee4a6294d4bfe508ef9fad => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:12.246363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3036f2d-50de-4730-be19-1b866cc80d06 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:12.247607 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d3036f2d-50de-4730-be19-1b866cc80d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:12.324463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3036f2d-50de-4730-be19-1b866cc80d06 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:12.328887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2e0b0-f2ea-41e1-9ad0-a2a034ece641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:12.329662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2e0b0-f2ea-41e1-9ad0-a2a034ece641 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:12.330031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2e0b0-f2ea-41e1-9ad0-a2a034ece641 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:12.330391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2e0b0-f2ea-41e1-9ad0-a2a034ece641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:12.332318 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a5b2e0b0-f2ea-41e1-9ad0-a2a034ece641 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:12.369292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1096/2170] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:11 2022] DELETE /identity/v3/users/df6048d396ca4cc79818941a46b4d153 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:12.371559 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e553a-3528-4197-9f6d-9d376f7a14e8 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:12.372098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e553a-3528-4197-9f6d-9d376f7a14e8 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:12.375173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e553a-3528-4197-9f6d-9d376f7a14e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:12.411591 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-5a3e553a-3528-4197-9f6d-9d376f7a14e8 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:12.413694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5a3e553a-3528-4197-9f6d-9d376f7a14e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:12.415465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2e0b0-f2ea-41e1-9ad0-a2a034ece641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:12.416921 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2e0b0-f2ea-41e1-9ad0-a2a034ece641 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:12.428610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1075/2171] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:12 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:12.430155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad16e35-6a74-46e8-b443-1dca801a5e32 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:12.430476 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad16e35-6a74-46e8-b443-1dca801a5e32 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:12.430801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad16e35-6a74-46e8-b443-1dca801a5e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:12.448787 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-9ad16e35-6a74-46e8-b443-1dca801a5e32 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:12.450111 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-9ad16e35-6a74-46e8-b443-1dca801a5e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:12.498158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1097/2172] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:12.506522 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de066-e1f8-41d2-bb48-f6baddc4948e None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:12.506814 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de066-e1f8-41d2-bb48-f6baddc4948e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:12.507259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de066-e1f8-41d2-bb48-f6baddc4948e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:12.520166 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1076/2173] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:12.527254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-b06de066-e1f8-41d2-bb48-f6baddc4948e None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:12.528749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b06de066-e1f8-41d2-bb48-f6baddc4948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:12.530064 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad16e35-6a74-46e8-b443-1dca801a5e32 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:12.532093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-9ad16e35-6a74-46e8-b443-1dca801a5e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:12.537870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1098/2174] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:12.541898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06de066-e1f8-41d2-bb48-f6baddc4948e None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:12.552233 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06de066-e1f8-41d2-bb48-f6baddc4948e None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:12.559172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40165460-6024-499f-a43a-c1527d4c5fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:12.559850 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40165460-6024-499f-a43a-c1527d4c5fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:12.560141 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40165460-6024-499f-a43a-c1527d4c5fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:12.560427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40165460-6024-499f-a43a-c1527d4c5fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:12.561180 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40165460-6024-499f-a43a-c1527d4c5fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:05:12.561499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40165460-6024-499f-a43a-c1527d4c5fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:12.563716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40165460-6024-499f-a43a-c1527d4c5fa1 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:12.568845 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:12.602550 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1099/2175] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:05:12.603483 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad16e35-6a74-46e8-b443-1dca801a5e32 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:12.606478 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40165460-6024-499f-a43a-c1527d4c5fa1 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:12.608232 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d8281-f5a1-4af6-836a-510e8e52406a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:12.609946 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d8281-f5a1-4af6-836a-510e8e52406a service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:12.610289 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d8281-f5a1-4af6-836a-510e8e52406a service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:12.610637 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d8281-f5a1-4af6-836a-510e8e52406a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:12.622728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d8281-f5a1-4af6-836a-510e8e52406a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:12.623617 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40165460-6024-499f-a43a-c1527d4c5fa1 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:12.625756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d8281-f5a1-4af6-836a-510e8e52406a service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:12.629517 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bca555-0874-4831-9f33-e48ac22cac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:12.630548 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bca555-0874-4831-9f33-e48ac22cac2b admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:12.630840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bca555-0874-4831-9f33-e48ac22cac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:12.631124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bca555-0874-4831-9f33-e48ac22cac2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:12.631997 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bca555-0874-4831-9f33-e48ac22cac2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:12.634002 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bca555-0874-4831-9f33-e48ac22cac2b admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:12.639217 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1077/2176] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:05:12.740208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d8281-f5a1-4af6-836a-510e8e52406a service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:12.760454 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1100/2177] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:12 2022] POST /identity/v3/projects => generated 365 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:12.764717 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bca555-0874-4831-9f33-e48ac22cac2b admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:12.807657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d8281-f5a1-4af6-836a-510e8e52406a service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:12.845091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bca555-0874-4831-9f33-e48ac22cac2b admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:12.852239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb70be-555f-462b-904a-aad2a0ce619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:12.852929 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb70be-555f-462b-904a-aad2a0ce619f admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:12.853301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb70be-555f-462b-904a-aad2a0ce619f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:12.853579 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb70be-555f-462b-904a-aad2a0ce619f admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:12.854285 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb70be-555f-462b-904a-aad2a0ce619f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:12.856325 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb70be-555f-462b-904a-aad2a0ce619f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:12.879527 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae680b9c-b4bc-41f5-b189-918c3124f68b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:12.880245 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae680b9c-b4bc-41f5-b189-918c3124f68b service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:12.880537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae680b9c-b4bc-41f5-b189-918c3124f68b service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:12.880819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae680b9c-b4bc-41f5-b189-918c3124f68b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:12.883137 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ae680b9c-b4bc-41f5-b189-918c3124f68b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:12.957650 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae680b9c-b4bc-41f5-b189-918c3124f68b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:12.959170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae680b9c-b4bc-41f5-b189-918c3124f68b service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:12.971035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1078/2178] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:05:12.996200 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1101/2179] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:12 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:13.000526 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae680b9c-b4bc-41f5-b189-918c3124f68b service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:13.013385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae680b9c-b4bc-41f5-b189-918c3124f68b service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:13.020888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d66401-5a0f-4951-8cca-278fe9b44152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:13.021663 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d66401-5a0f-4951-8cca-278fe9b44152 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.023045 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d66401-5a0f-4951-8cca-278fe9b44152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.023045 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d66401-5a0f-4951-8cca-278fe9b44152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.023045 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d66401-5a0f-4951-8cca-278fe9b44152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:13.024617 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d66401-5a0f-4951-8cca-278fe9b44152 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:13.036689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1079/2180] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:13.040535 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb70be-555f-462b-904a-aad2a0ce619f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:13.051503 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb70be-555f-462b-904a-aad2a0ce619f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:13.056841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0e538-3155-44e1-981d-b2fedb0b68a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:13.059765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0e538-3155-44e1-981d-b2fedb0b68a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.059765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0e538-3155-44e1-981d-b2fedb0b68a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.059765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0e538-3155-44e1-981d-b2fedb0b68a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.059765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0e538-3155-44e1-981d-b2fedb0b68a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:13.060954 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0e538-3155-44e1-981d-b2fedb0b68a1 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:13.077744 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1102/2181] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:13.079280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d66401-5a0f-4951-8cca-278fe9b44152 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:13.092849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d66401-5a0f-4951-8cca-278fe9b44152 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:13.099853 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d6c39-b49c-479c-b869-b7b3afe11340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:13.103634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d6c39-b49c-479c-b869-b7b3afe11340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.103634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d6c39-b49c-479c-b869-b7b3afe11340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.103634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d6c39-b49c-479c-b869-b7b3afe11340 admin admin] PATH_INFO: `/v3/projects/36e1d17d9816408f9975a3564a63b046/users/83eb3b6770df4c6eb58ac69890c69346/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.130114 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d6c39-b49c-479c-b869-b7b3afe11340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e1d17d9816408f9975a3564a63b046, user_id=83eb3b6770df4c6eb58ac69890c69346, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:13.135100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d6c39-b49c-479c-b869-b7b3afe11340 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:13.254250 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1080/2182] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:13 2022] PUT /identity/v3/projects/36e1d17d9816408f9975a3564a63b046/users/83eb3b6770df4c6eb58ac69890c69346/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:13.265883 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62b1cb-cdea-4d57-804a-5758f06dd08f None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.266156 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62b1cb-cdea-4d57-804a-5758f06dd08f None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.266416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62b1cb-cdea-4d57-804a-5758f06dd08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.297194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-9a62b1cb-cdea-4d57-804a-5758f06dd08f None None] MFA Rules not processed for user `83eb3b6770df4c6eb58ac69890c69346`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:13.298809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9a62b1cb-cdea-4d57-804a-5758f06dd08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:13.369055 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1103/2183] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:13.373999 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d6c39-b49c-479c-b869-b7b3afe11340 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:13.415108 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:13.443558 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d6c39-b49c-479c-b869-b7b3afe11340 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:13.448442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbb6a5-680c-4257-94d6-1fae28b7026d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:13.449092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbb6a5-680c-4257-94d6-1fae28b7026d admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.449415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbb6a5-680c-4257-94d6-1fae28b7026d admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.449697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbb6a5-680c-4257-94d6-1fae28b7026d admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.450418 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbb6a5-680c-4257-94d6-1fae28b7026d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:13.452325 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbb6a5-680c-4257-94d6-1fae28b7026d admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:13.496228 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62b1cb-cdea-4d57-804a-5758f06dd08f None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:13.497749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9a62b1cb-cdea-4d57-804a-5758f06dd08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:13.513039 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62b1cb-cdea-4d57-804a-5758f06dd08f None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:13.521887 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191182d-7a53-4277-9da7-e19b243c063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:13.522800 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191182d-7a53-4277-9da7-e19b243c063f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.523084 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191182d-7a53-4277-9da7-e19b243c063f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.523357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191182d-7a53-4277-9da7-e19b243c063f admin admin] PATH_INFO: `/v3/projects/d5889e3e6a584f54a450f7514e0a339d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.524761 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191182d-7a53-4277-9da7-e19b243c063f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5889e3e6a584f54a450f7514e0a339d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:13.526563 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191182d-7a53-4277-9da7-e19b243c063f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:13.766873 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1081/2184] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:13 2022] POST /identity/v3/projects => generated 367 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:13.770849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbb6a5-680c-4257-94d6-1fae28b7026d admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:13.837193 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbb6a5-680c-4257-94d6-1fae28b7026d admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:13.841928 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac183d-114f-438e-a8a4-6407718a93a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:13.842659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac183d-114f-438e-a8a4-6407718a93a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:13.842905 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac183d-114f-438e-a8a4-6407718a93a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:13.843716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac183d-114f-438e-a8a4-6407718a93a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:13.844447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac183d-114f-438e-a8a4-6407718a93a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:13.854502 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac183d-114f-438e-a8a4-6407718a93a8 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:13.900578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5191182d-7a53-4277-9da7-e19b243c063f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5889e3e6a584f54a450f7514e0a339d', 'request_id': 'req-5191182d-7a53-4277-9da7-e19b243c063f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:13.907542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5191182d-7a53-4277-9da7-e19b243c063f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5889e3e6a584f54a450f7514e0a339d', 'request_id': 'req-5191182d-7a53-4277-9da7-e19b243c063f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:13.918130 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5191182d-7a53-4277-9da7-e19b243c063f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5889e3e6a584f54a450f7514e0a339d', 'request_id': 'req-5191182d-7a53-4277-9da7-e19b243c063f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:14.088975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1082/2185] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:13 2022] POST /identity/v3/users => generated 290 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:05:14.090028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5815a77-edf8-4b2a-8354-b99c9f9ce1e1 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:14.090329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5815a77-edf8-4b2a-8354-b99c9f9ce1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:14.090610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5815a77-edf8-4b2a-8354-b99c9f9ce1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:14.123928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5191182d-7a53-4277-9da7-e19b243c063f admin admin] The token cache is being invalidate because project d5889e3e6a584f54a450f7514e0a339d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:14.131658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5191182d-7a53-4277-9da7-e19b243c063f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:14.134146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5191182d-7a53-4277-9da7-e19b243c063f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:14.137838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1104/2186] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:13 2022] DELETE /identity/v3/projects/d5889e3e6a584f54a450f7514e0a339d => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:05:14.138501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191182d-7a53-4277-9da7-e19b243c063f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:14.143957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-c5815a77-edf8-4b2a-8354-b99c9f9ce1e1 None None] MFA Rules not processed for user `98ba7b6718f440129efb215621e53b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:14.145284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5191182d-7a53-4277-9da7-e19b243c063f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:14.145520 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c5815a77-edf8-4b2a-8354-b99c9f9ce1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:14.234531 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191182d-7a53-4277-9da7-e19b243c063f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:14.239621 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfc869-2f14-4dca-8493-4927f9007013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:14.240542 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfc869-2f14-4dca-8493-4927f9007013 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:14.240839 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfc869-2f14-4dca-8493-4927f9007013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:14.241138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfc869-2f14-4dca-8493-4927f9007013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:14.241895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfc869-2f14-4dca-8493-4927f9007013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:14.243855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfc869-2f14-4dca-8493-4927f9007013 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:14.245292 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1083/2187] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:14.247014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5815a77-edf8-4b2a-8354-b99c9f9ce1e1 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:14.248754 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c5815a77-edf8-4b2a-8354-b99c9f9ce1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:14.269213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1105/2188] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:14.281341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3089d03-2d8f-49fc-9eff-612860926954 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:14.281341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3089d03-2d8f-49fc-9eff-612860926954 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:14.281341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3089d03-2d8f-49fc-9eff-612860926954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:14.282649 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5815a77-edf8-4b2a-8354-b99c9f9ce1e1 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:14.293375 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b188ef8-20e5-47a0-92ba-9ef191432f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:14.294300 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b188ef8-20e5-47a0-92ba-9ef191432f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:14.294590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b188ef8-20e5-47a0-92ba-9ef191432f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:14.294897 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b188ef8-20e5-47a0-92ba-9ef191432f24 admin admin] PATH_INFO: `/v3/users/d9ee8c3d3084450c8f64775474d8d4c7` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:14.297900 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b188ef8-20e5-47a0-92ba-9ef191432f24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ee8c3d3084450c8f64775474d8d4c7)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:14.300241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b188ef8-20e5-47a0-92ba-9ef191432f24 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:14.315367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-b3089d03-2d8f-49fc-9eff-612860926954 None None] MFA Rules not processed for user `0a3775f4f5174656bb2640cf04634100`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:14.315367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b3089d03-2d8f-49fc-9eff-612860926954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:14.394832 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1106/2189] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:14.395905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3089d03-2d8f-49fc-9eff-612860926954 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:14.409534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3089d03-2d8f-49fc-9eff-612860926954 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:14.414739 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb79603-d724-4cbf-b79d-80018e5b80e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:14.415697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb79603-d724-4cbf-b79d-80018e5b80e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:14.415986 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb79603-d724-4cbf-b79d-80018e5b80e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:14.416293 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb79603-d724-4cbf-b79d-80018e5b80e6 admin admin] PATH_INFO: `/v3/projects/9226514c6ff143bd9f0cde1f3363aa2b/users/3e5e56389874462fac3704485cbbf02b/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:14.432522 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb79603-d724-4cbf-b79d-80018e5b80e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9226514c6ff143bd9f0cde1f3363aa2b, user_id=3e5e56389874462fac3704485cbbf02b, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:14.435585 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb79603-d724-4cbf-b79d-80018e5b80e6 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:14.598601 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1107/2190] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:14 2022] PUT /identity/v3/projects/9226514c6ff143bd9f0cde1f3363aa2b/users/3e5e56389874462fac3704485cbbf02b/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:14.603570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb79603-d724-4cbf-b79d-80018e5b80e6 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:14.603570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-afb79603-d724-4cbf-b79d-80018e5b80e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:14.648927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-7b188ef8-20e5-47a0-92ba-9ef191432f24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ee8c3d3084450c8f64775474d8d4c7'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:14.655240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-7b188ef8-20e5-47a0-92ba-9ef191432f24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ee8c3d3084450c8f64775474d8d4c7'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:14.657681 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-7b188ef8-20e5-47a0-92ba-9ef191432f24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ee8c3d3084450c8f64775474d8d4c7'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:14.658385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-7b188ef8-20e5-47a0-92ba-9ef191432f24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ee8c3d3084450c8f64775474d8d4c7'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:14.680311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb79603-d724-4cbf-b79d-80018e5b80e6 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:14.686184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1411e-e5f7-4597-9b18-e87d27792dbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:14.686889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1411e-e5f7-4597-9b18-e87d27792dbf service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:14.687755 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1411e-e5f7-4597-9b18-e87d27792dbf service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:14.688032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1411e-e5f7-4597-9b18-e87d27792dbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:14.689909 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-f2d1411e-e5f7-4597-9b18-e87d27792dbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:14.735426 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-7b188ef8-20e5-47a0-92ba-9ef191432f24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ee8c3d3084450c8f64775474d8d4c7'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:14.755944 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1411e-e5f7-4597-9b18-e87d27792dbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:14.756710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1084/2191] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:14 2022] DELETE /identity/v3/users/d9ee8c3d3084450c8f64775474d8d4c7 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:14.759654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1411e-e5f7-4597-9b18-e87d27792dbf service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:14.759780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b188ef8-20e5-47a0-92ba-9ef191432f24 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:14.759780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-7b188ef8-20e5-47a0-92ba-9ef191432f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:14.769086 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1108/2192] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:14.852534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b188ef8-20e5-47a0-92ba-9ef191432f24 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:14.859554 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e813550-c0ad-4453-aa06-21bbabfaa22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:14.860250 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e813550-c0ad-4453-aa06-21bbabfaa22a admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:14.860538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e813550-c0ad-4453-aa06-21bbabfaa22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:14.860819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e813550-c0ad-4453-aa06-21bbabfaa22a admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:14.861604 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e813550-c0ad-4453-aa06-21bbabfaa22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:14.863309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e813550-c0ad-4453-aa06-21bbabfaa22a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:14.877309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1085/2193] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:14.881597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1411e-e5f7-4597-9b18-e87d27792dbf service nova] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:14.948638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1411e-e5f7-4597-9b18-e87d27792dbf service nova] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:14.954880 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c854f-7fa7-4baa-b28a-f314cf1ae403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:14.955803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c854f-7fa7-4baa-b28a-f314cf1ae403 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:14.956086 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c854f-7fa7-4baa-b28a-f314cf1ae403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:14.956477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c854f-7fa7-4baa-b28a-f314cf1ae403 admin admin] PATH_INFO: `/v3/projects/9226514c6ff143bd9f0cde1f3363aa2b/users/3e5e56389874462fac3704485cbbf02b/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:14.971207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c854f-7fa7-4baa-b28a-f314cf1ae403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9226514c6ff143bd9f0cde1f3363aa2b, user_id=3e5e56389874462fac3704485cbbf02b, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:14.978022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c854f-7fa7-4baa-b28a-f314cf1ae403 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:14.992496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1109/2194] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:14 2022] PUT /identity/v3/projects/9226514c6ff143bd9f0cde1f3363aa2b/users/3e5e56389874462fac3704485cbbf02b/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:05:15.006220 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f004be-db0e-4486-940f-56bfe90fd128 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:15.006461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f004be-db0e-4486-940f-56bfe90fd128 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:15.006747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f004be-db0e-4486-940f-56bfe90fd128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:15.044453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-47f004be-db0e-4486-940f-56bfe90fd128 None None] MFA Rules not processed for user `3e5e56389874462fac3704485cbbf02b`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:15.047715 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-47f004be-db0e-4486-940f-56bfe90fd128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:15.134062 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1086/2195] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:15.142666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c854f-7fa7-4baa-b28a-f314cf1ae403 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:15.144743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-529c854f-7fa7-4baa-b28a-f314cf1ae403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:15.207630 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c854f-7fa7-4baa-b28a-f314cf1ae403 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:15.220425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3e990-42b5-40e9-af0f-00515b4da154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:15.220909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f004be-db0e-4486-940f-56bfe90fd128 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:15.221628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3e990-42b5-40e9-af0f-00515b4da154 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:15.221628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3e990-42b5-40e9-af0f-00515b4da154 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:15.221908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3e990-42b5-40e9-af0f-00515b4da154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:15.223124 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-47f004be-db0e-4486-940f-56bfe90fd128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:15.232729 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3e990-42b5-40e9-af0f-00515b4da154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:15.235608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3e990-42b5-40e9-af0f-00515b4da154 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:15.247464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1110/2196] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:15.322826 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f004be-db0e-4486-940f-56bfe90fd128 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:15.328574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd23505-8db1-4e83-9600-49766b69224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:15.329122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd23505-8db1-4e83-9600-49766b69224c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:15.329479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd23505-8db1-4e83-9600-49766b69224c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:15.329761 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd23505-8db1-4e83-9600-49766b69224c admin admin] PATH_INFO: `/v3/projects/ad5898f8921d4ea78163f0c2b1c1f8c9` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:15.331194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd23505-8db1-4e83-9600-49766b69224c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad5898f8921d4ea78163f0c2b1c1f8c9)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:15.333259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd23505-8db1-4e83-9600-49766b69224c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:15.518976 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3e990-42b5-40e9-af0f-00515b4da154 service cinder] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:15.520391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-cdd23505-8db1-4e83-9600-49766b69224c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad5898f8921d4ea78163f0c2b1c1f8c9', 'request_id': 'req-cdd23505-8db1-4e83-9600-49766b69224c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:15.529752 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-cdd23505-8db1-4e83-9600-49766b69224c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad5898f8921d4ea78163f0c2b1c1f8c9', 'request_id': 'req-cdd23505-8db1-4e83-9600-49766b69224c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:15.536862 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-cdd23505-8db1-4e83-9600-49766b69224c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad5898f8921d4ea78163f0c2b1c1f8c9', 'request_id': 'req-cdd23505-8db1-4e83-9600-49766b69224c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:15.540746 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3e990-42b5-40e9-af0f-00515b4da154 service cinder] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:15.606168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:15.626568 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36382b9-b767-42f7-abf3-a3bf4fb7dd17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:15.627238 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36382b9-b767-42f7-abf3-a3bf4fb7dd17 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:15.627694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36382b9-b767-42f7-abf3-a3bf4fb7dd17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:15.627984 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36382b9-b767-42f7-abf3-a3bf4fb7dd17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:15.630424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e36382b9-b767-42f7-abf3-a3bf4fb7dd17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:15.649484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-cdd23505-8db1-4e83-9600-49766b69224c admin admin] The token cache is being invalidate because project ad5898f8921d4ea78163f0c2b1c1f8c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:15.649484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-cdd23505-8db1-4e83-9600-49766b69224c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:15.649484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-cdd23505-8db1-4e83-9600-49766b69224c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:15.649484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1087/2197] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:15 2022] DELETE /identity/v3/projects/ad5898f8921d4ea78163f0c2b1c1f8c9 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:15.652272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd23505-8db1-4e83-9600-49766b69224c admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:15.653844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-cdd23505-8db1-4e83-9600-49766b69224c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:15.721493 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36382b9-b767-42f7-abf3-a3bf4fb7dd17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:15.722904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36382b9-b767-42f7-abf3-a3bf4fb7dd17 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:15.734492 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1111/2198] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:15.734746 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd23505-8db1-4e83-9600-49766b69224c admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:15.742828 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3ec98-402f-4405-98e1-c477e60d411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:15.742828 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3ec98-402f-4405-98e1-c477e60d411a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:15.742828 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3ec98-402f-4405-98e1-c477e60d411a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:15.742828 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3ec98-402f-4405-98e1-c477e60d411a admin admin] PATH_INFO: `/v3/users/6784d260900742ce96ebc7346ee6d71f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:15.743181 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3ec98-402f-4405-98e1-c477e60d411a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6784d260900742ce96ebc7346ee6d71f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:15.744449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3ec98-402f-4405-98e1-c477e60d411a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:16.006129 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ffe3ec98-402f-4405-98e1-c477e60d411a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6784d260900742ce96ebc7346ee6d71f'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:16.006800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ffe3ec98-402f-4405-98e1-c477e60d411a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6784d260900742ce96ebc7346ee6d71f'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:16.014115 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ffe3ec98-402f-4405-98e1-c477e60d411a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6784d260900742ce96ebc7346ee6d71f'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:16.018545 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ffe3ec98-402f-4405-98e1-c477e60d411a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6784d260900742ce96ebc7346ee6d71f'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:16.137423 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ffe3ec98-402f-4405-98e1-c477e60d411a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6784d260900742ce96ebc7346ee6d71f'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:16.163103 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1088/2199] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:15 2022] DELETE /identity/v3/users/6784d260900742ce96ebc7346ee6d71f => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:05:16.424087 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:16.710258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36382b9-b767-42f7-abf3-a3bf4fb7dd17 service cinder] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:16.728972 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36382b9-b767-42f7-abf3-a3bf4fb7dd17 service cinder] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:16.819764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ba46-6d0d-4762-a63c-3e669f71132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:16.821586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ba46-6d0d-4762-a63c-3e669f71132c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:16.822066 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ba46-6d0d-4762-a63c-3e669f71132c admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:16.822541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ba46-6d0d-4762-a63c-3e669f71132c admin admin] PATH_INFO: `/v3/projects/022a09fe38594d80a896488a74b29474` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:16.824529 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1ba46-6d0d-4762-a63c-3e669f71132c admin admin] RBAC: Authorizing `identity:delete_project(project_id=022a09fe38594d80a896488a74b29474)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:16.828990 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1ba46-6d0d-4762-a63c-3e669f71132c admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:16.977114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-cfc1ba46-6d0d-4762-a63c-3e669f71132c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '022a09fe38594d80a896488a74b29474', 'request_id': 'req-cfc1ba46-6d0d-4762-a63c-3e669f71132c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:16.985210 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-cfc1ba46-6d0d-4762-a63c-3e669f71132c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '022a09fe38594d80a896488a74b29474', 'request_id': 'req-cfc1ba46-6d0d-4762-a63c-3e669f71132c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:16.994069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-cfc1ba46-6d0d-4762-a63c-3e669f71132c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '022a09fe38594d80a896488a74b29474', 'request_id': 'req-cfc1ba46-6d0d-4762-a63c-3e669f71132c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:17.139379 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-cfc1ba46-6d0d-4762-a63c-3e669f71132c admin admin] The token cache is being invalidate because project 022a09fe38594d80a896488a74b29474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:17.139731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-cfc1ba46-6d0d-4762-a63c-3e669f71132c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:17.140366 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-cfc1ba46-6d0d-4762-a63c-3e669f71132c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:17.142064 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1112/2200] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:16 2022] DELETE /identity/v3/projects/022a09fe38594d80a896488a74b29474 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:05:17.147191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf825-650a-4fb9-b69a-d9995b2407a9 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:17.152062 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf825-650a-4fb9-b69a-d9995b2407a9 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:17.152062 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cf825-650a-4fb9-b69a-d9995b2407a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:17.178243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-2d8cf825-650a-4fb9-b69a-d9995b2407a9 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:17.179402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2d8cf825-650a-4fb9-b69a-d9995b2407a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:17.246463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1089/2201] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:17.255248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c7bc-f743-497d-8003-d62b2606984a None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:17.255536 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c7bc-f743-497d-8003-d62b2606984a None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:17.255834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c7bc-f743-497d-8003-d62b2606984a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:17.276675 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-d350c7bc-f743-497d-8003-d62b2606984a None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:17.278416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-d350c7bc-f743-497d-8003-d62b2606984a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:17.290543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1113/2202] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:17.294092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf825-650a-4fb9-b69a-d9995b2407a9 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:17.305586 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cf825-650a-4fb9-b69a-d9995b2407a9 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:17.310551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f53724-a9a5-4dfa-922a-0d6a4a8187f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:17.318351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f53724-a9a5-4dfa-922a-0d6a4a8187f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:17.318351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f53724-a9a5-4dfa-922a-0d6a4a8187f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:17.318351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f53724-a9a5-4dfa-922a-0d6a4a8187f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:17.318351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f53724-a9a5-4dfa-922a-0d6a4a8187f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:05:17.318351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f53724-a9a5-4dfa-922a-0d6a4a8187f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:17.318351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f53724-a9a5-4dfa-922a-0d6a4a8187f9 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:17.330217 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1090/2203] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:05:17.331464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350c7bc-f743-497d-8003-d62b2606984a None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:17.341650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350c7bc-f743-497d-8003-d62b2606984a None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:17.347160 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b0278-492b-49d5-8869-488b1ee33a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:17.347875 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b0278-492b-49d5-8869-488b1ee33a2c admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:17.352641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b0278-492b-49d5-8869-488b1ee33a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:17.352641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b0278-492b-49d5-8869-488b1ee33a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:17.352641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b0278-492b-49d5-8869-488b1ee33a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:17.352641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b0278-492b-49d5-8869-488b1ee33a2c admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:17.473963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1114/2204] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:17 2022] POST /identity/v3/projects => generated 369 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:17.479796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f53724-a9a5-4dfa-922a-0d6a4a8187f9 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:17.490852 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f53724-a9a5-4dfa-922a-0d6a4a8187f9 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:17.556901 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630ed91-a905-40a8-8d69-ec5636824b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:17.557619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630ed91-a905-40a8-8d69-ec5636824b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:17.557949 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630ed91-a905-40a8-8d69-ec5636824b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:17.558232 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630ed91-a905-40a8-8d69-ec5636824b07 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:17.558940 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630ed91-a905-40a8-8d69-ec5636824b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:17.560944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630ed91-a905-40a8-8d69-ec5636824b07 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:17.671266 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1091/2205] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:17 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:05:17.672438 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b0278-492b-49d5-8869-488b1ee33a2c admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:17.692994 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b0278-492b-49d5-8869-488b1ee33a2c admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:17.704077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d46d3-c912-4377-b8b2-9bf2dfd473e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:17.705080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d46d3-c912-4377-b8b2-9bf2dfd473e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:17.705626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d46d3-c912-4377-b8b2-9bf2dfd473e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:17.705927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d46d3-c912-4377-b8b2-9bf2dfd473e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:17.706713 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d46d3-c912-4377-b8b2-9bf2dfd473e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:17.708607 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d46d3-c912-4377-b8b2-9bf2dfd473e9 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:17.720705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1115/2206] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:17.725992 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630ed91-a905-40a8-8d69-ec5636824b07 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:17.737502 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630ed91-a905-40a8-8d69-ec5636824b07 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:17.742310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430ec28-2bd0-4fb0-adb7-af8c32ae304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:17.743061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430ec28-2bd0-4fb0-adb7-af8c32ae304e admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:17.743353 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430ec28-2bd0-4fb0-adb7-af8c32ae304e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:17.743663 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430ec28-2bd0-4fb0-adb7-af8c32ae304e admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:17.744440 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430ec28-2bd0-4fb0-adb7-af8c32ae304e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:17.746180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430ec28-2bd0-4fb0-adb7-af8c32ae304e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:17.757707 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1092/2207] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:17.762277 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d46d3-c912-4377-b8b2-9bf2dfd473e9 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:17.774027 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d46d3-c912-4377-b8b2-9bf2dfd473e9 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:17.779737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b15699-7a0e-4853-a2ad-690b5e9a2117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:17.781442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b15699-7a0e-4853-a2ad-690b5e9a2117 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:17.782179 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b15699-7a0e-4853-a2ad-690b5e9a2117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:17.782628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b15699-7a0e-4853-a2ad-690b5e9a2117 admin admin] PATH_INFO: `/v3/projects/ea4e970e5614488882d6bf04fae8a177/users/e44aeac5ec084a64be4af38c2c938bba/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:17.800453 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b15699-7a0e-4853-a2ad-690b5e9a2117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea4e970e5614488882d6bf04fae8a177, user_id=e44aeac5ec084a64be4af38c2c938bba, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:17.803254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b15699-7a0e-4853-a2ad-690b5e9a2117 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:17.884584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1116/2208] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:17 2022] PUT /identity/v3/projects/ea4e970e5614488882d6bf04fae8a177/users/e44aeac5ec084a64be4af38c2c938bba/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:17.898274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25934d2b-c850-4e51-b30c-0853c65125d9 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:17.898500 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25934d2b-c850-4e51-b30c-0853c65125d9 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:17.898789 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25934d2b-c850-4e51-b30c-0853c65125d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:17.932195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-25934d2b-c850-4e51-b30c-0853c65125d9 None None] MFA Rules not processed for user `e44aeac5ec084a64be4af38c2c938bba`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:17.933556 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-25934d2b-c850-4e51-b30c-0853c65125d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:18.016452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1093/2209] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:18.032079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b15699-7a0e-4853-a2ad-690b5e9a2117 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:18.033836 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-43b15699-7a0e-4853-a2ad-690b5e9a2117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:18.092708 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b15699-7a0e-4853-a2ad-690b5e9a2117 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:18.099454 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a21b37-33ea-415c-be5e-02db6084d8b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8f268ca2cb34c06b188908495cdcd53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:18.100127 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a21b37-33ea-415c-be5e-02db6084d8b7 service glance] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:18.100420 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a21b37-33ea-415c-be5e-02db6084d8b7 service glance] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:18.104398 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a21b37-33ea-415c-be5e-02db6084d8b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:18.111501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a21b37-33ea-415c-be5e-02db6084d8b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:18.113037 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a21b37-33ea-415c-be5e-02db6084d8b7 service glance] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:18.123514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1117/2210] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:18 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:18.352917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:19.215371 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:20.147113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25934d2b-c850-4e51-b30c-0853c65125d9 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:20.149319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-25934d2b-c850-4e51-b30c-0853c65125d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:20.224047 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25934d2b-c850-4e51-b30c-0853c65125d9 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:20.229005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15712b3a-5056-4c10-a355-f9a43aab2b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:20.229996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15712b3a-5056-4c10-a355-f9a43aab2b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:20.230283 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15712b3a-5056-4c10-a355-f9a43aab2b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:20.230565 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15712b3a-5056-4c10-a355-f9a43aab2b81 admin admin] PATH_INFO: `/v3/users/3e96610f6e924314817be1cc919d9924` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:20.231870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15712b3a-5056-4c10-a355-f9a43aab2b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e96610f6e924314817be1cc919d9924)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:20.234654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15712b3a-5056-4c10-a355-f9a43aab2b81 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:20.428315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:20.552027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-15712b3a-5056-4c10-a355-f9a43aab2b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e96610f6e924314817be1cc919d9924'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:20.553033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-15712b3a-5056-4c10-a355-f9a43aab2b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e96610f6e924314817be1cc919d9924'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:20.561119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-15712b3a-5056-4c10-a355-f9a43aab2b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e96610f6e924314817be1cc919d9924'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:20.562523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-15712b3a-5056-4c10-a355-f9a43aab2b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e96610f6e924314817be1cc919d9924'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:20.666256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-15712b3a-5056-4c10-a355-f9a43aab2b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e96610f6e924314817be1cc919d9924'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:20.689156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1094/2211] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:20 2022] DELETE /identity/v3/users/3e96610f6e924314817be1cc919d9924 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:20.694456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff537719-c688-4cea-b12c-ace922bcb92d None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:20.694752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff537719-c688-4cea-b12c-ace922bcb92d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:20.695066 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff537719-c688-4cea-b12c-ace922bcb92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:20.713375 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-ff537719-c688-4cea-b12c-ace922bcb92d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:20.714602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ff537719-c688-4cea-b12c-ace922bcb92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:20.784229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1118/2212] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:20.790818 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15712b3a-5056-4c10-a355-f9a43aab2b81 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:20.792251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-15712b3a-5056-4c10-a355-f9a43aab2b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:20.892440 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15712b3a-5056-4c10-a355-f9a43aab2b81 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:20.898544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a8524-1427-4841-891e-3c38de46c4af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:20.900057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a8524-1427-4841-891e-3c38de46c4af service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:20.900540 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a8524-1427-4841-891e-3c38de46c4af service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:20.900997 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a8524-1427-4841-891e-3c38de46c4af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:20.927209 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a8524-1427-4841-891e-3c38de46c4af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:20.928992 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a8524-1427-4841-891e-3c38de46c4af service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:20.956497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1095/2213] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:21.392470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:21.551070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff537719-c688-4cea-b12c-ace922bcb92d None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:21.552558 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ff537719-c688-4cea-b12c-ace922bcb92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:21.577715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff537719-c688-4cea-b12c-ace922bcb92d None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:21.594176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea68ef-4c49-411f-aaeb-75fa68596355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:21.597696 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea68ef-4c49-411f-aaeb-75fa68596355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:21.598000 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea68ef-4c49-411f-aaeb-75fa68596355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:21.599109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea68ef-4c49-411f-aaeb-75fa68596355 admin admin] PATH_INFO: `/v3/projects/7fa1e2d30e3f42c9be59813286132661` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:21.600872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea68ef-4c49-411f-aaeb-75fa68596355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fa1e2d30e3f42c9be59813286132661)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:21.605300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea68ef-4c49-411f-aaeb-75fa68596355 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:21.764548 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-75ea68ef-4c49-411f-aaeb-75fa68596355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa1e2d30e3f42c9be59813286132661', 'request_id': 'req-75ea68ef-4c49-411f-aaeb-75fa68596355'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:21.772374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-75ea68ef-4c49-411f-aaeb-75fa68596355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa1e2d30e3f42c9be59813286132661', 'request_id': 'req-75ea68ef-4c49-411f-aaeb-75fa68596355'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:21.779709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-75ea68ef-4c49-411f-aaeb-75fa68596355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa1e2d30e3f42c9be59813286132661', 'request_id': 'req-75ea68ef-4c49-411f-aaeb-75fa68596355'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:21.888598 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-75ea68ef-4c49-411f-aaeb-75fa68596355 admin admin] The token cache is being invalidate because project 7fa1e2d30e3f42c9be59813286132661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:21.889057 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-75ea68ef-4c49-411f-aaeb-75fa68596355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:21.889757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-75ea68ef-4c49-411f-aaeb-75fa68596355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:21.892193 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1119/2214] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:21 2022] DELETE /identity/v3/projects/7fa1e2d30e3f42c9be59813286132661 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:21.896159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a8524-1427-4841-891e-3c38de46c4af service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:21.908566 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a8524-1427-4841-891e-3c38de46c4af service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:21.970299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f2af5-e3d7-4922-8966-ebd815c3e0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:21.971225 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f2af5-e3d7-4922-8966-ebd815c3e0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:21.971513 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f2af5-e3d7-4922-8966-ebd815c3e0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:21.971788 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f2af5-e3d7-4922-8966-ebd815c3e0e1 admin admin] PATH_INFO: `/v3/users/35c110831e96415c9dc456f2d84633f4` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:21.973058 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f2af5-e3d7-4922-8966-ebd815c3e0e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c110831e96415c9dc456f2d84633f4)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:21.975874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f2af5-e3d7-4922-8966-ebd815c3e0e1 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:22.198617 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d62f2af5-e3d7-4922-8966-ebd815c3e0e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c110831e96415c9dc456f2d84633f4'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:22.199334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d62f2af5-e3d7-4922-8966-ebd815c3e0e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c110831e96415c9dc456f2d84633f4'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:22.208571 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d62f2af5-e3d7-4922-8966-ebd815c3e0e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c110831e96415c9dc456f2d84633f4'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:22.209617 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d62f2af5-e3d7-4922-8966-ebd815c3e0e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c110831e96415c9dc456f2d84633f4'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:22.313538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-d62f2af5-e3d7-4922-8966-ebd815c3e0e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c110831e96415c9dc456f2d84633f4'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:22.354393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1096/2215] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:21 2022] DELETE /identity/v3/users/35c110831e96415c9dc456f2d84633f4 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:22.768389 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:22.980228 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:22.981752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea68ef-4c49-411f-aaeb-75fa68596355 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:22.984170 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-75ea68ef-4c49-411f-aaeb-75fa68596355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:22.997865 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea68ef-4c49-411f-aaeb-75fa68596355 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:23.089882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a3051-1c89-43bf-8a93-0469b489ce90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:23.091048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a3051-1c89-43bf-8a93-0469b489ce90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:23.091489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a3051-1c89-43bf-8a93-0469b489ce90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:23.091763 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a3051-1c89-43bf-8a93-0469b489ce90 admin admin] PATH_INFO: `/v3/projects/ad7a492e49d34eabaf653dd33e03de69` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:23.093102 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a3051-1c89-43bf-8a93-0469b489ce90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad7a492e49d34eabaf653dd33e03de69)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:23.097268 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a3051-1c89-43bf-8a93-0469b489ce90 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:23.280723 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a64a3051-1c89-43bf-8a93-0469b489ce90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad7a492e49d34eabaf653dd33e03de69', 'request_id': 'req-a64a3051-1c89-43bf-8a93-0469b489ce90'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:23.290346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a64a3051-1c89-43bf-8a93-0469b489ce90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad7a492e49d34eabaf653dd33e03de69', 'request_id': 'req-a64a3051-1c89-43bf-8a93-0469b489ce90'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:23.300468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a64a3051-1c89-43bf-8a93-0469b489ce90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad7a492e49d34eabaf653dd33e03de69', 'request_id': 'req-a64a3051-1c89-43bf-8a93-0469b489ce90'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:23.461765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a64a3051-1c89-43bf-8a93-0469b489ce90 admin admin] The token cache is being invalidate because project ad7a492e49d34eabaf653dd33e03de69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:23.462108 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a64a3051-1c89-43bf-8a93-0469b489ce90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:23.463002 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a64a3051-1c89-43bf-8a93-0469b489ce90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:23.474771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1120/2216] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:22 2022] DELETE /identity/v3/projects/ad7a492e49d34eabaf653dd33e03de69 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:23.475886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b670-0b15-4f94-af23-de0ae68944f6 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:23.475886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b670-0b15-4f94-af23-de0ae68944f6 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:23.475886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b670-0b15-4f94-af23-de0ae68944f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:23.494050 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-60a1b670-0b15-4f94-af23-de0ae68944f6 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:23.495300 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-60a1b670-0b15-4f94-af23-de0ae68944f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:23.564760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1097/2217] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:23.572850 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72216e-b935-4a9c-b205-1178ff17d19c None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:23.573360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72216e-b935-4a9c-b205-1178ff17d19c None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:23.573643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72216e-b935-4a9c-b205-1178ff17d19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:23.593762 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-6e72216e-b935-4a9c-b205-1178ff17d19c None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:23.594980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6e72216e-b935-4a9c-b205-1178ff17d19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:23.603409 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1121/2218] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:23.609429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1b670-0b15-4f94-af23-de0ae68944f6 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:23.620816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1b670-0b15-4f94-af23-de0ae68944f6 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:23.626495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9a475-5640-4820-9e72-3f06684960a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:23.627268 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9a475-5640-4820-9e72-3f06684960a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:23.627624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9a475-5640-4820-9e72-3f06684960a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:23.628307 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9a475-5640-4820-9e72-3f06684960a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:23.628949 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9a475-5640-4820-9e72-3f06684960a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:05:23.629305 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9a475-5640-4820-9e72-3f06684960a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:23.630948 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9a475-5640-4820-9e72-3f06684960a5 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:23.645452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1098/2219] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:05:23.651347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72216e-b935-4a9c-b205-1178ff17d19c None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:23.661809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72216e-b935-4a9c-b205-1178ff17d19c None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:23.675825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08015e3-4455-4a49-b2e7-75457e3b1ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:23.676661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08015e3-4455-4a49-b2e7-75457e3b1ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:23.677108 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08015e3-4455-4a49-b2e7-75457e3b1ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:23.677570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08015e3-4455-4a49-b2e7-75457e3b1ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:23.678384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08015e3-4455-4a49-b2e7-75457e3b1ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:23.681546 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08015e3-4455-4a49-b2e7-75457e3b1ee8 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:23.913414 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1122/2220] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:23 2022] POST /identity/v3/projects => generated 381 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:05:23.919151 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9a475-5640-4820-9e72-3f06684960a5 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:23.930713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9a475-5640-4820-9e72-3f06684960a5 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:24.000665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89497db8-cdbe-40b5-9a23-fde877076424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:24.001608 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89497db8-cdbe-40b5-9a23-fde877076424 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:24.001894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89497db8-cdbe-40b5-9a23-fde877076424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:24.002205 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89497db8-cdbe-40b5-9a23-fde877076424 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:24.002907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89497db8-cdbe-40b5-9a23-fde877076424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:24.004840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89497db8-cdbe-40b5-9a23-fde877076424 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:24.173810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1099/2221] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:23 2022] POST /identity/v3/users => generated 291 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:24.184270 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08015e3-4455-4a49-b2e7-75457e3b1ee8 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:24.195219 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08015e3-4455-4a49-b2e7-75457e3b1ee8 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:24.199874 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3c5e8-f5e6-4b77-8d79-d6df80470cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:24.200553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3c5e8-f5e6-4b77-8d79-d6df80470cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:24.200841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3c5e8-f5e6-4b77-8d79-d6df80470cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:24.201120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3c5e8-f5e6-4b77-8d79-d6df80470cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:24.201904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3c5e8-f5e6-4b77-8d79-d6df80470cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:24.203564 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3c5e8-f5e6-4b77-8d79-d6df80470cd1 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:24.214699 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1123/2222] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:24.220313 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89497db8-cdbe-40b5-9a23-fde877076424 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:24.240921 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89497db8-cdbe-40b5-9a23-fde877076424 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:24.246502 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c670f8-f8ce-427a-a721-67d72a8d8047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:24.247245 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c670f8-f8ce-427a-a721-67d72a8d8047 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:24.247607 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c670f8-f8ce-427a-a721-67d72a8d8047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:24.247896 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c670f8-f8ce-427a-a721-67d72a8d8047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:24.248657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c670f8-f8ce-427a-a721-67d72a8d8047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:24.250467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c670f8-f8ce-427a-a721-67d72a8d8047 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:24.266570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1100/2223] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:24.271970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3c5e8-f5e6-4b77-8d79-d6df80470cd1 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:24.284942 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3c5e8-f5e6-4b77-8d79-d6df80470cd1 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:24.289959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90df670-8a3a-4e99-b9ea-ebe781101079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:24.290857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90df670-8a3a-4e99-b9ea-ebe781101079 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:24.291146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90df670-8a3a-4e99-b9ea-ebe781101079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:24.291427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90df670-8a3a-4e99-b9ea-ebe781101079 admin admin] PATH_INFO: `/v3/projects/384ed0fd81164f13b0b926eddbcc4f5c/users/2e61e109ca1e41a5aa3f490bae3f2c16/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:24.309938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90df670-8a3a-4e99-b9ea-ebe781101079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=384ed0fd81164f13b0b926eddbcc4f5c, user_id=2e61e109ca1e41a5aa3f490bae3f2c16, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:24.312722 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90df670-8a3a-4e99-b9ea-ebe781101079 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:24.433822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1124/2224] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:24 2022] PUT /identity/v3/projects/384ed0fd81164f13b0b926eddbcc4f5c/users/2e61e109ca1e41a5aa3f490bae3f2c16/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:24.435413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf7905-ad08-4b2d-89e9-9ee6c02bcacb None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:24.435709 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf7905-ad08-4b2d-89e9-9ee6c02bcacb None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:24.435990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf7905-ad08-4b2d-89e9-9ee6c02bcacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:24.465245 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-d3bf7905-ad08-4b2d-89e9-9ee6c02bcacb None None] MFA Rules not processed for user `2e61e109ca1e41a5aa3f490bae3f2c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:24.466619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d3bf7905-ad08-4b2d-89e9-9ee6c02bcacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:24.546018 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1101/2225] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:24.550667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90df670-8a3a-4e99-b9ea-ebe781101079 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:24.619602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90df670-8a3a-4e99-b9ea-ebe781101079 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:24.624461 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc431c3-eaf2-4990-b06e-6d7612073289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:24.625409 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc431c3-eaf2-4990-b06e-6d7612073289 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:24.625775 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc431c3-eaf2-4990-b06e-6d7612073289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:24.626068 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc431c3-eaf2-4990-b06e-6d7612073289 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:24.626817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc431c3-eaf2-4990-b06e-6d7612073289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:24.628879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc431c3-eaf2-4990-b06e-6d7612073289 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:24.798084 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1125/2226] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:24 2022] POST /identity/v3/projects => generated 383 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:05:24.811580 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf7905-ad08-4b2d-89e9-9ee6c02bcacb None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:24.823722 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf7905-ad08-4b2d-89e9-9ee6c02bcacb None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:24.891458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04442719-a215-44c5-b356-321a01226173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:24.892138 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04442719-a215-44c5-b356-321a01226173 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:24.893625 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04442719-a215-44c5-b356-321a01226173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:24.893625 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04442719-a215-44c5-b356-321a01226173 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:24.893625 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04442719-a215-44c5-b356-321a01226173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:24.895409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04442719-a215-44c5-b356-321a01226173 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:25.027236 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1102/2227] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:24 2022] POST /identity/v3/users => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:25.031858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc431c3-eaf2-4990-b06e-6d7612073289 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:25.042390 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc431c3-eaf2-4990-b06e-6d7612073289 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:25.050227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263747b-9761-4e85-bb1a-c6042edc84ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:25.051071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263747b-9761-4e85-bb1a-c6042edc84ec admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:25.052921 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263747b-9761-4e85-bb1a-c6042edc84ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:25.052921 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263747b-9761-4e85-bb1a-c6042edc84ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:25.052921 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263747b-9761-4e85-bb1a-c6042edc84ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:25.054673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263747b-9761-4e85-bb1a-c6042edc84ec admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:25.066264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1126/2228] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:05:25.070791 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04442719-a215-44c5-b356-321a01226173 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:25.081293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04442719-a215-44c5-b356-321a01226173 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:25.087341 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ae286-e078-455a-afc7-0ebe6c07948b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:25.088328 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ae286-e078-455a-afc7-0ebe6c07948b admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:25.088508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ae286-e078-455a-afc7-0ebe6c07948b admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:25.088796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ae286-e078-455a-afc7-0ebe6c07948b admin admin] PATH_INFO: `/v3/projects/e460f9f6529846d2964d7206d492306b/users/40ff0aaa02b84fc2b146d2b9085d6719/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:25.104950 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ae286-e078-455a-afc7-0ebe6c07948b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e460f9f6529846d2964d7206d492306b, user_id=40ff0aaa02b84fc2b146d2b9085d6719, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:25.107695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ae286-e078-455a-afc7-0ebe6c07948b admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:25.289626 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1103/2229] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:25 2022] PUT /identity/v3/projects/e460f9f6529846d2964d7206d492306b/users/40ff0aaa02b84fc2b146d2b9085d6719/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:25.301511 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263747b-9761-4e85-bb1a-c6042edc84ec admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:25.321010 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263747b-9761-4e85-bb1a-c6042edc84ec admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:25.392854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe617a-bbad-4e6c-bf4c-3f5710051bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:25.393791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe617a-bbad-4e6c-bf4c-3f5710051bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:25.394222 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe617a-bbad-4e6c-bf4c-3f5710051bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:25.394508 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe617a-bbad-4e6c-bf4c-3f5710051bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:25.395340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe617a-bbad-4e6c-bf4c-3f5710051bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:25.397068 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe617a-bbad-4e6c-bf4c-3f5710051bd1 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:25.412181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1127/2230] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:25.417806 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ae286-e078-455a-afc7-0ebe6c07948b admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:25.428402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ae286-e078-455a-afc7-0ebe6c07948b admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:25.433319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5f842-d714-487d-8867-ab7f15af45cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:25.437569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5f842-d714-487d-8867-ab7f15af45cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:25.437569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5f842-d714-487d-8867-ab7f15af45cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:25.437569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5f842-d714-487d-8867-ab7f15af45cb admin admin] PATH_INFO: `/v3/projects/e460f9f6529846d2964d7206d492306b/users/40ff0aaa02b84fc2b146d2b9085d6719/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:25.437569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5f842-d714-487d-8867-ab7f15af45cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e460f9f6529846d2964d7206d492306b, user_id=40ff0aaa02b84fc2b146d2b9085d6719, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:25.439404 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5f842-d714-487d-8867-ab7f15af45cb admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:25.450028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1104/2231] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:25 2022] PUT /identity/v3/projects/e460f9f6529846d2964d7206d492306b/users/40ff0aaa02b84fc2b146d2b9085d6719/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:25.461246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f64e4a-fe9f-44fa-aadb-acf1b0820f9a None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:25.461686 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f64e4a-fe9f-44fa-aadb-acf1b0820f9a None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:25.462000 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f64e4a-fe9f-44fa-aadb-acf1b0820f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:25.488029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-e6f64e4a-fe9f-44fa-aadb-acf1b0820f9a None None] MFA Rules not processed for user `40ff0aaa02b84fc2b146d2b9085d6719`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:25.489274 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e6f64e4a-fe9f-44fa-aadb-acf1b0820f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:25.556511 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1128/2232] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:25.569500 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5f842-d714-487d-8867-ab7f15af45cb admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:25.571369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-9dc5f842-d714-487d-8867-ab7f15af45cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:25.600486 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:25.632652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5f842-d714-487d-8867-ab7f15af45cb admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:25.636559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb5e05-92e7-4aab-bc00-1984d14e4ad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:25.637235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb5e05-92e7-4aab-bc00-1984d14e4ad6 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:25.637520 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb5e05-92e7-4aab-bc00-1984d14e4ad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:25.637798 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb5e05-92e7-4aab-bc00-1984d14e4ad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:25.647951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb5e05-92e7-4aab-bc00-1984d14e4ad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:25.649398 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb5e05-92e7-4aab-bc00-1984d14e4ad6 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:25.659083 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1105/2233] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:25.855475 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:26.302718 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f64e4a-fe9f-44fa-aadb-acf1b0820f9a None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:26.306360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e6f64e4a-fe9f-44fa-aadb-acf1b0820f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:26.322898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f64e4a-fe9f-44fa-aadb-acf1b0820f9a None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:26.330293 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f626b-000f-40aa-91ea-0f1f9d4cf331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:26.331296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f626b-000f-40aa-91ea-0f1f9d4cf331 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:26.331742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f626b-000f-40aa-91ea-0f1f9d4cf331 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:26.332171 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f626b-000f-40aa-91ea-0f1f9d4cf331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:26.417892 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f626b-000f-40aa-91ea-0f1f9d4cf331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:26.419406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f626b-000f-40aa-91ea-0f1f9d4cf331 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:26.430370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1129/2234] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:27.409560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb5e05-92e7-4aab-bc00-1984d14e4ad6 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:27.412923 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-96bb5e05-92e7-4aab-bc00-1984d14e4ad6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:27.496412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb5e05-92e7-4aab-bc00-1984d14e4ad6 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:27.504423 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757fa85-741c-496f-a26d-1f1f2427b48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:27.506427 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757fa85-741c-496f-a26d-1f1f2427b48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:27.507102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757fa85-741c-496f-a26d-1f1f2427b48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:27.507913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757fa85-741c-496f-a26d-1f1f2427b48d admin admin] PATH_INFO: `/v3/users/83eb3b6770df4c6eb58ac69890c69346` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:27.510373 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757fa85-741c-496f-a26d-1f1f2427b48d admin admin] RBAC: Authorizing `identity:delete_user(user_id=83eb3b6770df4c6eb58ac69890c69346)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:27.513535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757fa85-741c-496f-a26d-1f1f2427b48d admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:27.861324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-f757fa85-741c-496f-a26d-1f1f2427b48d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83eb3b6770df4c6eb58ac69890c69346'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:27.862023 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-f757fa85-741c-496f-a26d-1f1f2427b48d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83eb3b6770df4c6eb58ac69890c69346'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:27.873146 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-f757fa85-741c-496f-a26d-1f1f2427b48d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83eb3b6770df4c6eb58ac69890c69346'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:27.874272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-f757fa85-741c-496f-a26d-1f1f2427b48d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83eb3b6770df4c6eb58ac69890c69346'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:27.962039 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-f757fa85-741c-496f-a26d-1f1f2427b48d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83eb3b6770df4c6eb58ac69890c69346'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:28.000327 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1106/2235] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:27 2022] DELETE /identity/v3/users/83eb3b6770df4c6eb58ac69890c69346 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:28.003123 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e10f59-e38d-4ae5-9440-570a5af4af06 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:28.003854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e10f59-e38d-4ae5-9440-570a5af4af06 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:28.003990 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e10f59-e38d-4ae5-9440-570a5af4af06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:28.029546 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-37e10f59-e38d-4ae5-9440-570a5af4af06 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:28.031328 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-37e10f59-e38d-4ae5-9440-570a5af4af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:28.095176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1130/2236] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:28.105421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757fa85-741c-496f-a26d-1f1f2427b48d admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:28.107028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f757fa85-741c-496f-a26d-1f1f2427b48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:28.167365 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757fa85-741c-496f-a26d-1f1f2427b48d admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:28.171288 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61add3-100c-4880-82a2-8c354875de7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:28.171976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61add3-100c-4880-82a2-8c354875de7f service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:28.172266 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61add3-100c-4880-82a2-8c354875de7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:28.172548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61add3-100c-4880-82a2-8c354875de7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:28.182539 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61add3-100c-4880-82a2-8c354875de7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:28.186050 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61add3-100c-4880-82a2-8c354875de7f service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:28.196064 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1107/2237] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:28.301188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e10f59-e38d-4ae5-9440-570a5af4af06 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:28.302810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-37e10f59-e38d-4ae5-9440-570a5af4af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:28.326828 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e10f59-e38d-4ae5-9440-570a5af4af06 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:28.341045 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553d8c-a922-4c48-9f30-d6cd20f17263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:28.342815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553d8c-a922-4c48-9f30-d6cd20f17263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:28.344599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553d8c-a922-4c48-9f30-d6cd20f17263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:28.345093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64553d8c-a922-4c48-9f30-d6cd20f17263 admin admin] PATH_INFO: `/v3/users/f3c9b306f1664b148ed024581563f16c` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:28.348249 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64553d8c-a922-4c48-9f30-d6cd20f17263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c9b306f1664b148ed024581563f16c)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:28.352292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64553d8c-a922-4c48-9f30-d6cd20f17263 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:28.786678 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-64553d8c-a922-4c48-9f30-d6cd20f17263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c9b306f1664b148ed024581563f16c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:28.794135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-64553d8c-a922-4c48-9f30-d6cd20f17263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c9b306f1664b148ed024581563f16c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:28.794847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-64553d8c-a922-4c48-9f30-d6cd20f17263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c9b306f1664b148ed024581563f16c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:28.807205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-64553d8c-a922-4c48-9f30-d6cd20f17263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c9b306f1664b148ed024581563f16c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:28.807861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-64553d8c-a922-4c48-9f30-d6cd20f17263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c9b306f1664b148ed024581563f16c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:28.879579 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed93cb-442a-44e0-9d23-2ff622af192d None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:28.880908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed93cb-442a-44e0-9d23-2ff622af192d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:28.881554 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed93cb-442a-44e0-9d23-2ff622af192d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:28.915321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-76ed93cb-442a-44e0-9d23-2ff622af192d None None] MFA Rules not processed for user `0d3510e93cba44078ede0016f88d1032`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:28.917181 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-76ed93cb-442a-44e0-9d23-2ff622af192d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:28.942118 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1131/2238] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:28 2022] DELETE /identity/v3/users/f3c9b306f1664b148ed024581563f16c => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:28.943171 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553d8c-a922-4c48-9f30-d6cd20f17263 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:28.944560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-64553d8c-a922-4c48-9f30-d6cd20f17263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:29.048300 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1108/2239] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:29.050990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807b94c-5e76-41f2-b9ed-95003f997953 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:29.053281 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807b94c-5e76-41f2-b9ed-95003f997953 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:29.053872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807b94c-5e76-41f2-b9ed-95003f997953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:29.059147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64553d8c-a922-4c48-9f30-d6cd20f17263 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:29.065727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798c9db-51f0-4217-b927-c1d867432e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:29.066749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798c9db-51f0-4217-b927-c1d867432e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:29.067036 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798c9db-51f0-4217-b927-c1d867432e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:29.067309 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798c9db-51f0-4217-b927-c1d867432e3e admin admin] PATH_INFO: `/v3/projects/36e1d17d9816408f9975a3564a63b046` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:29.069071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798c9db-51f0-4217-b927-c1d867432e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e1d17d9816408f9975a3564a63b046)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:29.071354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798c9db-51f0-4217-b927-c1d867432e3e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:29.076173 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-b807b94c-5e76-41f2-b9ed-95003f997953 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:29.078844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b807b94c-5e76-41f2-b9ed-95003f997953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:29.090000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1109/2240] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:29.101440 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807b94c-5e76-41f2-b9ed-95003f997953 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:29.102864 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b807b94c-5e76-41f2-b9ed-95003f997953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:29.186951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807b94c-5e76-41f2-b9ed-95003f997953 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:29.192266 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91c394-294a-45a9-a96a-f102e75aff33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:29.193114 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91c394-294a-45a9-a96a-f102e75aff33 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:29.198846 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91c394-294a-45a9-a96a-f102e75aff33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:29.198846 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91c394-294a-45a9-a96a-f102e75aff33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:29.206732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91c394-294a-45a9-a96a-f102e75aff33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:29.208649 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91c394-294a-45a9-a96a-f102e75aff33 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:29.230499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-1798c9db-51f0-4217-b927-c1d867432e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e1d17d9816408f9975a3564a63b046', 'request_id': 'req-1798c9db-51f0-4217-b927-c1d867432e3e'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:29.239597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1110/2241] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:05:29.239781 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-1798c9db-51f0-4217-b927-c1d867432e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e1d17d9816408f9975a3564a63b046', 'request_id': 'req-1798c9db-51f0-4217-b927-c1d867432e3e'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:29.247547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-1798c9db-51f0-4217-b927-c1d867432e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e1d17d9816408f9975a3564a63b046', 'request_id': 'req-1798c9db-51f0-4217-b927-c1d867432e3e'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:29.345738 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-1798c9db-51f0-4217-b927-c1d867432e3e admin admin] The token cache is being invalidate because project 36e1d17d9816408f9975a3564a63b046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:29.346033 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-1798c9db-51f0-4217-b927-c1d867432e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:29.346952 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-1798c9db-51f0-4217-b927-c1d867432e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:29.349336 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1132/2242] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:28 2022] DELETE /identity/v3/projects/36e1d17d9816408f9975a3564a63b046 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:29.353871 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91c394-294a-45a9-a96a-f102e75aff33 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:29.365690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91c394-294a-45a9-a96a-f102e75aff33 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:29.441378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281802-1ee4-4d18-bbdd-459f13bb6afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:29.442590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281802-1ee4-4d18-bbdd-459f13bb6afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:29.442947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281802-1ee4-4d18-bbdd-459f13bb6afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:29.443302 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281802-1ee4-4d18-bbdd-459f13bb6afb admin admin] PATH_INFO: `/v3/users/3e5e56389874462fac3704485cbbf02b` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:29.444899 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39281802-1ee4-4d18-bbdd-459f13bb6afb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5e56389874462fac3704485cbbf02b)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:29.447051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39281802-1ee4-4d18-bbdd-459f13bb6afb admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:29.754501 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-39281802-1ee4-4d18-bbdd-459f13bb6afb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5e56389874462fac3704485cbbf02b'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:29.755331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-39281802-1ee4-4d18-bbdd-459f13bb6afb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5e56389874462fac3704485cbbf02b'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:29.763759 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-39281802-1ee4-4d18-bbdd-459f13bb6afb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5e56389874462fac3704485cbbf02b'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:29.764678 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-39281802-1ee4-4d18-bbdd-459f13bb6afb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5e56389874462fac3704485cbbf02b'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:29.779804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798c9db-51f0-4217-b927-c1d867432e3e admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:29.781983 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-1798c9db-51f0-4217-b927-c1d867432e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:29.803366 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798c9db-51f0-4217-b927-c1d867432e3e admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:29.827110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fbb8c-7a09-4773-ac92-e087a2740aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:29.831017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fbb8c-7a09-4773-ac92-e087a2740aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:29.831436 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fbb8c-7a09-4773-ac92-e087a2740aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:29.832196 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fbb8c-7a09-4773-ac92-e087a2740aca admin admin] PATH_INFO: `/v3/projects/5e5ad595e21947feba7668fb4c07291c` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:29.837447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fbb8c-7a09-4773-ac92-e087a2740aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5ad595e21947feba7668fb4c07291c)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:29.837447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fbb8c-7a09-4773-ac92-e087a2740aca admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:29.891367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-39281802-1ee4-4d18-bbdd-459f13bb6afb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5e56389874462fac3704485cbbf02b'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:29.942614 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1111/2243] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:29 2022] DELETE /identity/v3/users/3e5e56389874462fac3704485cbbf02b => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:30.024357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-948fbb8c-7a09-4773-ac92-e087a2740aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5ad595e21947feba7668fb4c07291c', 'request_id': 'req-948fbb8c-7a09-4773-ac92-e087a2740aca'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:30.025848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:30.035458 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-948fbb8c-7a09-4773-ac92-e087a2740aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5ad595e21947feba7668fb4c07291c', 'request_id': 'req-948fbb8c-7a09-4773-ac92-e087a2740aca'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:30.045459 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-948fbb8c-7a09-4773-ac92-e087a2740aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5ad595e21947feba7668fb4c07291c', 'request_id': 'req-948fbb8c-7a09-4773-ac92-e087a2740aca'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:30.162979 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-948fbb8c-7a09-4773-ac92-e087a2740aca admin admin] The token cache is being invalidate because project 5e5ad595e21947feba7668fb4c07291c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:30.163679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-948fbb8c-7a09-4773-ac92-e087a2740aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:30.163811 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-948fbb8c-7a09-4773-ac92-e087a2740aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:30.165630 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1133/2244] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:29 2022] DELETE /identity/v3/projects/5e5ad595e21947feba7668fb4c07291c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:30.176437 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8085c-e491-4503-8ff7-44e36d2ddb0d None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:30.176908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8085c-e491-4503-8ff7-44e36d2ddb0d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:30.177218 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8085c-e491-4503-8ff7-44e36d2ddb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:30.213660 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-21f8085c-e491-4503-8ff7-44e36d2ddb0d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:30.214932 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-21f8085c-e491-4503-8ff7-44e36d2ddb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:30.321519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1112/2245] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:30.330604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36c1f3-b138-4d17-9b8e-d6b4667def89 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:30.330946 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36c1f3-b138-4d17-9b8e-d6b4667def89 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:30.331208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36c1f3-b138-4d17-9b8e-d6b4667def89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:30.361209 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-6c36c1f3-b138-4d17-9b8e-d6b4667def89 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:30.363255 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6c36c1f3-b138-4d17-9b8e-d6b4667def89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:30.381594 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1134/2246] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:30.382291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8085c-e491-4503-8ff7-44e36d2ddb0d None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:30.387073 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:30.412205 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8085c-e491-4503-8ff7-44e36d2ddb0d None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:30.416796 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08726fc5-20b7-4ce5-be87-377c12e531de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:30.417481 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08726fc5-20b7-4ce5-be87-377c12e531de admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:30.417857 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08726fc5-20b7-4ce5-be87-377c12e531de admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:30.418222 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08726fc5-20b7-4ce5-be87-377c12e531de admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:30.419081 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08726fc5-20b7-4ce5-be87-377c12e531de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:05:30.420102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08726fc5-20b7-4ce5-be87-377c12e531de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:30.422565 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08726fc5-20b7-4ce5-be87-377c12e531de admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:30.441233 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1113/2247] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:05:30.446886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36c1f3-b138-4d17-9b8e-d6b4667def89 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:30.461179 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36c1f3-b138-4d17-9b8e-d6b4667def89 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:30.486387 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc3f3d-ef66-4735-8094-65f9310a31f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:30.487199 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc3f3d-ef66-4735-8094-65f9310a31f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:30.487408 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc3f3d-ef66-4735-8094-65f9310a31f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:30.487687 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc3f3d-ef66-4735-8094-65f9310a31f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:30.489266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc3f3d-ef66-4735-8094-65f9310a31f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:30.492679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc3f3d-ef66-4735-8094-65f9310a31f4 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:30.660329 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1135/2248] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:30 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:05:30.665877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08726fc5-20b7-4ce5-be87-377c12e531de admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:30.687759 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08726fc5-20b7-4ce5-be87-377c12e531de admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:30.764417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc3f3d-ef66-4735-8094-65f9310a31f4 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:30.766758 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-87cc3f3d-ef66-4735-8094-65f9310a31f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:30.785714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b275a7-9048-4a90-b127-e9864515f204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:30.785714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b275a7-9048-4a90-b127-e9864515f204 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:30.785714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b275a7-9048-4a90-b127-e9864515f204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:30.785714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b275a7-9048-4a90-b127-e9864515f204 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:30.786232 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b275a7-9048-4a90-b127-e9864515f204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:30.789683 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b275a7-9048-4a90-b127-e9864515f204 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:30.869392 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc3f3d-ef66-4735-8094-65f9310a31f4 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:30.874681 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85205a-69c0-498e-b2f9-4e8d8227080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:30.875705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85205a-69c0-498e-b2f9-4e8d8227080b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:30.876089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85205a-69c0-498e-b2f9-4e8d8227080b admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:30.876444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85205a-69c0-498e-b2f9-4e8d8227080b admin admin] PATH_INFO: `/v3/projects/9226514c6ff143bd9f0cde1f3363aa2b` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:30.877882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85205a-69c0-498e-b2f9-4e8d8227080b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9226514c6ff143bd9f0cde1f3363aa2b)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:30.879910 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85205a-69c0-498e-b2f9-4e8d8227080b admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:30.981700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1114/2249] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:30 2022] POST /identity/v3/users => generated 291 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:30.988554 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b275a7-9048-4a90-b127-e9864515f204 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:31.001098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b275a7-9048-4a90-b127-e9864515f204 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:31.008344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cee8e3-e999-4755-8114-e85b3b1ea88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:31.008943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cee8e3-e999-4755-8114-e85b3b1ea88f admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:31.009273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cee8e3-e999-4755-8114-e85b3b1ea88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:31.009562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cee8e3-e999-4755-8114-e85b3b1ea88f admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:31.010836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cee8e3-e999-4755-8114-e85b3b1ea88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:31.012089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cee8e3-e999-4755-8114-e85b3b1ea88f admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:31.028315 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1115/2250] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:31.029974 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cee8e3-e999-4755-8114-e85b3b1ea88f admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:31.042576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cee8e3-e999-4755-8114-e85b3b1ea88f admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:31.069518 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cdd68-8c01-497d-b3de-bd82db9b7ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:31.070433 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cdd68-8c01-497d-b3de-bd82db9b7ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:31.070806 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cdd68-8c01-497d-b3de-bd82db9b7ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:31.071251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cdd68-8c01-497d-b3de-bd82db9b7ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:31.072787 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cdd68-8c01-497d-b3de-bd82db9b7ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:31.074942 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cdd68-8c01-497d-b3de-bd82db9b7ef3 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:31.095090 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7a85205a-69c0-498e-b2f9-4e8d8227080b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9226514c6ff143bd9f0cde1f3363aa2b', 'request_id': 'req-7a85205a-69c0-498e-b2f9-4e8d8227080b'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:31.098893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1116/2251] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:31.098893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cdd68-8c01-497d-b3de-bd82db9b7ef3 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:31.099941 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-993cdd68-8c01-497d-b3de-bd82db9b7ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:31.109878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7a85205a-69c0-498e-b2f9-4e8d8227080b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9226514c6ff143bd9f0cde1f3363aa2b', 'request_id': 'req-7a85205a-69c0-498e-b2f9-4e8d8227080b'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:31.118736 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cdd68-8c01-497d-b3de-bd82db9b7ef3 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:31.122551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7a85205a-69c0-498e-b2f9-4e8d8227080b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9226514c6ff143bd9f0cde1f3363aa2b', 'request_id': 'req-7a85205a-69c0-498e-b2f9-4e8d8227080b'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:31.241298 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a379fbe-2850-475a-8219-ab136a89c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:31.242549 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a379fbe-2850-475a-8219-ab136a89c591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:31.242819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a379fbe-2850-475a-8219-ab136a89c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:31.243182 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a379fbe-2850-475a-8219-ab136a89c591 admin admin] PATH_INFO: `/v3/users/2e61e109ca1e41a5aa3f490bae3f2c16` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:31.244642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a379fbe-2850-475a-8219-ab136a89c591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e61e109ca1e41a5aa3f490bae3f2c16)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:31.246793 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a379fbe-2850-475a-8219-ab136a89c591 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:31.285273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7a85205a-69c0-498e-b2f9-4e8d8227080b admin admin] The token cache is being invalidate because project 9226514c6ff143bd9f0cde1f3363aa2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:31.286237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7a85205a-69c0-498e-b2f9-4e8d8227080b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:31.287113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7a85205a-69c0-498e-b2f9-4e8d8227080b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:31.288787 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1136/2252] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:30 2022] DELETE /identity/v3/projects/9226514c6ff143bd9f0cde1f3363aa2b => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:05:31.289610 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85205a-69c0-498e-b2f9-4e8d8227080b admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:31.295386 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-7a85205a-69c0-498e-b2f9-4e8d8227080b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:31.306794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85205a-69c0-498e-b2f9-4e8d8227080b admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:31.319723 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dde93f-13b1-4319-aac4-5b696a0b1389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:31.322210 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dde93f-13b1-4319-aac4-5b696a0b1389 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:31.322370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dde93f-13b1-4319-aac4-5b696a0b1389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:31.322775 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dde93f-13b1-4319-aac4-5b696a0b1389 admin admin] PATH_INFO: `/v3/projects/0ca953ddf1d649e5b124c86bdb1ab869/users/97a476fcf8104eb698196d20ce9e2e30/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:31.341893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dde93f-13b1-4319-aac4-5b696a0b1389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca953ddf1d649e5b124c86bdb1ab869, user_id=97a476fcf8104eb698196d20ce9e2e30, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:31.345463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dde93f-13b1-4319-aac4-5b696a0b1389 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:31.439965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1137/2253] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:31 2022] PUT /identity/v3/projects/0ca953ddf1d649e5b124c86bdb1ab869/users/97a476fcf8104eb698196d20ce9e2e30/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:31.441342 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b123ea-1a76-4b32-a88d-233830af5808 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:31.441637 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b123ea-1a76-4b32-a88d-233830af5808 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:31.441925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b123ea-1a76-4b32-a88d-233830af5808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:31.461866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-26b123ea-1a76-4b32-a88d-233830af5808 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:31.463186 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-26b123ea-1a76-4b32-a88d-233830af5808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:31.533979 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1138/2254] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:31.535503 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48060643-964c-4938-a131-9f5efc73a235 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:31.535804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48060643-964c-4938-a131-9f5efc73a235 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:31.536085 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48060643-964c-4938-a131-9f5efc73a235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:31.555759 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-48060643-964c-4938-a131-9f5efc73a235 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:31.557078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-48060643-964c-4938-a131-9f5efc73a235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:31.558337 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4a379fbe-2850-475a-8219-ab136a89c591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e61e109ca1e41a5aa3f490bae3f2c16'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:31.559035 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4a379fbe-2850-475a-8219-ab136a89c591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e61e109ca1e41a5aa3f490bae3f2c16'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:31.565954 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1139/2255] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:31.567316 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99e4a3-e5b1-44d3-96fd-8b8803fd38ac None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:31.567610 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99e4a3-e5b1-44d3-96fd-8b8803fd38ac None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:31.567860 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4a379fbe-2850-475a-8219-ab136a89c591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e61e109ca1e41a5aa3f490bae3f2c16'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:31.567964 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99e4a3-e5b1-44d3-96fd-8b8803fd38ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:31.568781 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4a379fbe-2850-475a-8219-ab136a89c591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e61e109ca1e41a5aa3f490bae3f2c16'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:31.595649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-4b99e4a3-e5b1-44d3-96fd-8b8803fd38ac None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:31.596986 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4b99e4a3-e5b1-44d3-96fd-8b8803fd38ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:31.605626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1140/2256] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:31.606192 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99e4a3-e5b1-44d3-96fd-8b8803fd38ac None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:31.607535 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4b99e4a3-e5b1-44d3-96fd-8b8803fd38ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:31.677693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4a379fbe-2850-475a-8219-ab136a89c591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e61e109ca1e41a5aa3f490bae3f2c16'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:31.692229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99e4a3-e5b1-44d3-96fd-8b8803fd38ac None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:31.697390 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b71e8-cfaf-43cb-8bfe-48bfb149faa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:31.698067 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b71e8-cfaf-43cb-8bfe-48bfb149faa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:31.698354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b71e8-cfaf-43cb-8bfe-48bfb149faa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:31.698635 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b71e8-cfaf-43cb-8bfe-48bfb149faa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:31.706454 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1117/2257] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:31 2022] DELETE /identity/v3/users/2e61e109ca1e41a5aa3f490bae3f2c16 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:31.706454 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a379fbe-2850-475a-8219-ab136a89c591 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:31.710063 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b71e8-cfaf-43cb-8bfe-48bfb149faa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:31.711684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b71e8-cfaf-43cb-8bfe-48bfb149faa7 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:31.725257 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1141/2258] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:31.726657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88091d3-4517-4def-acd9-e610151d65c6 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:31.727661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88091d3-4517-4def-acd9-e610151d65c6 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:31.727661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88091d3-4517-4def-acd9-e610151d65c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:31.767210 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-f88091d3-4517-4def-acd9-e610151d65c6 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:31.768878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-f88091d3-4517-4def-acd9-e610151d65c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:31.812587 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a379fbe-2850-475a-8219-ab136a89c591 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:31.819808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c7d37-1372-46c8-99ba-adb5e63bf42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:31.820510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c7d37-1372-46c8-99ba-adb5e63bf42a admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:31.820797 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c7d37-1372-46c8-99ba-adb5e63bf42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:31.821077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c7d37-1372-46c8-99ba-adb5e63bf42a admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:31.821853 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c7d37-1372-46c8-99ba-adb5e63bf42a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:05:31.822174 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c7d37-1372-46c8-99ba-adb5e63bf42a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:31.825054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c7d37-1372-46c8-99ba-adb5e63bf42a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:31.842592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1118/2259] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:05:31.844862 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c7d37-1372-46c8-99ba-adb5e63bf42a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:31.855916 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c7d37-1372-46c8-99ba-adb5e63bf42a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:31.857117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1142/2260] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:31.869990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d281bb-c112-4dce-b243-e9a95929e458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:31.869990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d281bb-c112-4dce-b243-e9a95929e458 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:31.869990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d281bb-c112-4dce-b243-e9a95929e458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:31.869990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d281bb-c112-4dce-b243-e9a95929e458 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:31.870507 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d281bb-c112-4dce-b243-e9a95929e458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:31.870721 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88091d3-4517-4def-acd9-e610151d65c6 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:31.871651 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d281bb-c112-4dce-b243-e9a95929e458 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:31.873020 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-f88091d3-4517-4def-acd9-e610151d65c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:31.967488 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88091d3-4517-4def-acd9-e610151d65c6 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:31.974761 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e12c5d-5a8f-4484-8a7a-023c2d42f9f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:31.975904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e12c5d-5a8f-4484-8a7a-023c2d42f9f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:31.976267 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e12c5d-5a8f-4484-8a7a-023c2d42f9f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:31.976582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e12c5d-5a8f-4484-8a7a-023c2d42f9f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:31.997561 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e12c5d-5a8f-4484-8a7a-023c2d42f9f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:32.000185 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e12c5d-5a8f-4484-8a7a-023c2d42f9f3 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:32.022948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1143/2261] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:32.025490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1119/2262] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:31 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:32.034022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e12c5d-5a8f-4484-8a7a-023c2d42f9f3 service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:32.040184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e12c5d-5a8f-4484-8a7a-023c2d42f9f3 service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:32.156199 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30036fe0-22b0-4554-b45e-88ba646f7d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:32.157357 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30036fe0-22b0-4554-b45e-88ba646f7d21 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:32.157734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30036fe0-22b0-4554-b45e-88ba646f7d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:32.158246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30036fe0-22b0-4554-b45e-88ba646f7d21 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:32.159162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30036fe0-22b0-4554-b45e-88ba646f7d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:32.167415 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30036fe0-22b0-4554-b45e-88ba646f7d21 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:32.313181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1144/2263] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:32 2022] POST /identity/v3/users => generated 288 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:32.321897 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d281bb-c112-4dce-b243-e9a95929e458 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:32.329343 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d281bb-c112-4dce-b243-e9a95929e458 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:32.335624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d99b4e-3f66-44e2-97b6-7adf9ff3fbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:32.336567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d99b4e-3f66-44e2-97b6-7adf9ff3fbef admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:32.336936 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d99b4e-3f66-44e2-97b6-7adf9ff3fbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:32.337997 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d99b4e-3f66-44e2-97b6-7adf9ff3fbef admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:32.338173 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d99b4e-3f66-44e2-97b6-7adf9ff3fbef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:32.339923 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d99b4e-3f66-44e2-97b6-7adf9ff3fbef admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:32.356352 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1120/2264] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:32.363168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30036fe0-22b0-4554-b45e-88ba646f7d21 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:32.382105 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30036fe0-22b0-4554-b45e-88ba646f7d21 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:32.413397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c64928-457e-4663-92f0-5e5df8d004f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:32.425901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c64928-457e-4663-92f0-5e5df8d004f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:32.426663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c64928-457e-4663-92f0-5e5df8d004f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:32.427159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c64928-457e-4663-92f0-5e5df8d004f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:32.428709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c64928-457e-4663-92f0-5e5df8d004f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:32.432849 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c64928-457e-4663-92f0-5e5df8d004f5 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:32.462147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1145/2265] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:32.467117 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d99b4e-3f66-44e2-97b6-7adf9ff3fbef admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:32.481242 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d99b4e-3f66-44e2-97b6-7adf9ff3fbef admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:32.488143 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d6dfa-23e0-4b41-9eef-bb0204febf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:32.489055 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d6dfa-23e0-4b41-9eef-bb0204febf22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:32.489378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d6dfa-23e0-4b41-9eef-bb0204febf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:32.489654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d6dfa-23e0-4b41-9eef-bb0204febf22 admin admin] PATH_INFO: `/v3/projects/de51986d35f74e929c46157e5f9683a8/users/2793417deeae4337a9c6b7c0d27f830c/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:32.513196 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d6dfa-23e0-4b41-9eef-bb0204febf22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de51986d35f74e929c46157e5f9683a8, user_id=2793417deeae4337a9c6b7c0d27f830c, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:32.516283 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d6dfa-23e0-4b41-9eef-bb0204febf22 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:32.654846 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1121/2266] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:32 2022] PUT /identity/v3/projects/de51986d35f74e929c46157e5f9683a8/users/2793417deeae4337a9c6b7c0d27f830c/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:32.668452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef54f9-a919-4c2c-b296-31c40e396bb3 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:32.669443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef54f9-a919-4c2c-b296-31c40e396bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:32.669749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef54f9-a919-4c2c-b296-31c40e396bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:32.721755 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-a3ef54f9-a919-4c2c-b296-31c40e396bb3 None None] MFA Rules not processed for user `2793417deeae4337a9c6b7c0d27f830c`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:32.723359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a3ef54f9-a919-4c2c-b296-31c40e396bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:32.820335 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1146/2267] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:32.833257 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d6dfa-23e0-4b41-9eef-bb0204febf22 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:32.836104 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-5c5d6dfa-23e0-4b41-9eef-bb0204febf22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:32.966537 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef54f9-a919-4c2c-b296-31c40e396bb3 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:32.969884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a3ef54f9-a919-4c2c-b296-31c40e396bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:32.970364 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d6dfa-23e0-4b41-9eef-bb0204febf22 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:32.977040 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25866538-86d2-4486-a1dc-f4c3e48f57a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:32.978662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25866538-86d2-4486-a1dc-f4c3e48f57a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:32.979460 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25866538-86d2-4486-a1dc-f4c3e48f57a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:32.981090 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25866538-86d2-4486-a1dc-f4c3e48f57a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:32.998007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25866538-86d2-4486-a1dc-f4c3e48f57a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:33.001453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25866538-86d2-4486-a1dc-f4c3e48f57a8 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:33.060900 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1122/2268] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:33.104140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef54f9-a919-4c2c-b296-31c40e396bb3 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:33.109949 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f3c02-5b00-4ad2-b80e-5144c8b0fc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:33.110980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f3c02-5b00-4ad2-b80e-5144c8b0fc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:33.111346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f3c02-5b00-4ad2-b80e-5144c8b0fc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:33.111705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f3c02-5b00-4ad2-b80e-5144c8b0fc94 admin admin] PATH_INFO: `/v3/projects/384ed0fd81164f13b0b926eddbcc4f5c` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:33.113127 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f3c02-5b00-4ad2-b80e-5144c8b0fc94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=384ed0fd81164f13b0b926eddbcc4f5c)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:33.115169 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f3c02-5b00-4ad2-b80e-5144c8b0fc94 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:33.301500 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-171f3c02-5b00-4ad2-b80e-5144c8b0fc94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384ed0fd81164f13b0b926eddbcc4f5c', 'request_id': 'req-171f3c02-5b00-4ad2-b80e-5144c8b0fc94'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:33.309899 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-171f3c02-5b00-4ad2-b80e-5144c8b0fc94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384ed0fd81164f13b0b926eddbcc4f5c', 'request_id': 'req-171f3c02-5b00-4ad2-b80e-5144c8b0fc94'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:33.316646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-171f3c02-5b00-4ad2-b80e-5144c8b0fc94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384ed0fd81164f13b0b926eddbcc4f5c', 'request_id': 'req-171f3c02-5b00-4ad2-b80e-5144c8b0fc94'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:33.431879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-171f3c02-5b00-4ad2-b80e-5144c8b0fc94 admin admin] The token cache is being invalidate because project 384ed0fd81164f13b0b926eddbcc4f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:33.432260 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-171f3c02-5b00-4ad2-b80e-5144c8b0fc94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:33.432841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-171f3c02-5b00-4ad2-b80e-5144c8b0fc94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:33.438050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1147/2269] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:32 2022] DELETE /identity/v3/projects/384ed0fd81164f13b0b926eddbcc4f5c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:05:33.439652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25866538-86d2-4486-a1dc-f4c3e48f57a8 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:33.459202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25866538-86d2-4486-a1dc-f4c3e48f57a8 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:33.536784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ba8f5-561f-40c3-9e65-d4ef331a255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:33.537742 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ba8f5-561f-40c3-9e65-d4ef331a255b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:33.538034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ba8f5-561f-40c3-9e65-d4ef331a255b admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:33.538364 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ba8f5-561f-40c3-9e65-d4ef331a255b admin admin] PATH_INFO: `/v3/users/40ff0aaa02b84fc2b146d2b9085d6719` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:33.539915 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ba8f5-561f-40c3-9e65-d4ef331a255b admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ff0aaa02b84fc2b146d2b9085d6719)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:33.541935 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ba8f5-561f-40c3-9e65-d4ef331a255b admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:33.905500 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02b1a5-7e67-4bac-8458-911f8b92c0dc None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:33.906537 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02b1a5-7e67-4bac-8458-911f8b92c0dc None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:33.907038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02b1a5-7e67-4bac-8458-911f8b92c0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:33.944715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-8e02b1a5-7e67-4bac-8458-911f8b92c0dc None None] MFA Rules not processed for user `97a476fcf8104eb698196d20ce9e2e30`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:33.946019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-8e02b1a5-7e67-4bac-8458-911f8b92c0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:34.044032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-9e7ba8f5-561f-40c3-9e65-d4ef331a255b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ff0aaa02b84fc2b146d2b9085d6719'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:34.045045 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-9e7ba8f5-561f-40c3-9e65-d4ef331a255b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ff0aaa02b84fc2b146d2b9085d6719'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:34.049584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1148/2270] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:34.059680 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-9e7ba8f5-561f-40c3-9e65-d4ef331a255b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ff0aaa02b84fc2b146d2b9085d6719'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:34.061710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-9e7ba8f5-561f-40c3-9e65-d4ef331a255b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ff0aaa02b84fc2b146d2b9085d6719'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:34.144600 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02b1a5-7e67-4bac-8458-911f8b92c0dc None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:34.146463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-8e02b1a5-7e67-4bac-8458-911f8b92c0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:34.164354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-9e7ba8f5-561f-40c3-9e65-d4ef331a255b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ff0aaa02b84fc2b146d2b9085d6719'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:34.194888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1123/2271] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:33 2022] DELETE /identity/v3/users/40ff0aaa02b84fc2b146d2b9085d6719 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:34.249406 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02b1a5-7e67-4bac-8458-911f8b92c0dc None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:34.356850 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9c984-b775-4d9a-80ba-2bfddf9fd97d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:34.360002 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9c984-b775-4d9a-80ba-2bfddf9fd97d service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:34.360395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9c984-b775-4d9a-80ba-2bfddf9fd97d service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:34.360810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9c984-b775-4d9a-80ba-2bfddf9fd97d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:34.363502 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-aac9c984-b775-4d9a-80ba-2bfddf9fd97d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:34.470882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9c984-b775-4d9a-80ba-2bfddf9fd97d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:34.472867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9c984-b775-4d9a-80ba-2bfddf9fd97d service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:34.488562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1149/2272] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:05:34.713492 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:35.027586 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ba8f5-561f-40c3-9e65-d4ef331a255b admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:35.029968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-9e7ba8f5-561f-40c3-9e65-d4ef331a255b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:35.122931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:35.127128 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ba8f5-561f-40c3-9e65-d4ef331a255b admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:35.133523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97b813-bb22-4671-8887-0271955e2381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:35.134591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97b813-bb22-4671-8887-0271955e2381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:35.134917 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97b813-bb22-4671-8887-0271955e2381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:35.135249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97b813-bb22-4671-8887-0271955e2381 admin admin] PATH_INFO: `/v3/projects/e460f9f6529846d2964d7206d492306b` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:35.137086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97b813-bb22-4671-8887-0271955e2381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e460f9f6529846d2964d7206d492306b)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:35.140196 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97b813-bb22-4671-8887-0271955e2381 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:35.346165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-7c97b813-bb22-4671-8887-0271955e2381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e460f9f6529846d2964d7206d492306b', 'request_id': 'req-7c97b813-bb22-4671-8887-0271955e2381'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:35.355702 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-7c97b813-bb22-4671-8887-0271955e2381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e460f9f6529846d2964d7206d492306b', 'request_id': 'req-7c97b813-bb22-4671-8887-0271955e2381'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:35.362487 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-7c97b813-bb22-4671-8887-0271955e2381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e460f9f6529846d2964d7206d492306b', 'request_id': 'req-7c97b813-bb22-4671-8887-0271955e2381'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:35.533096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-7c97b813-bb22-4671-8887-0271955e2381 admin admin] The token cache is being invalidate because project e460f9f6529846d2964d7206d492306b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:35.536209 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-7c97b813-bb22-4671-8887-0271955e2381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:35.540943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-7c97b813-bb22-4671-8887-0271955e2381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:35.542934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1124/2273] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:35 2022] DELETE /identity/v3/projects/e460f9f6529846d2964d7206d492306b => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:35.550964 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaf04b-3f3d-4f89-80c1-63543bcdbcb7 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:35.551728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaf04b-3f3d-4f89-80c1-63543bcdbcb7 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:35.551728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaf04b-3f3d-4f89-80c1-63543bcdbcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:35.572678 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-9daaf04b-3f3d-4f89-80c1-63543bcdbcb7 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:35.590467 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9daaf04b-3f3d-4f89-80c1-63543bcdbcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:35.678434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd92aa2-fed9-44bd-8d2d-5469bb763df6 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:35.678749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd92aa2-fed9-44bd-8d2d-5469bb763df6 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:35.679719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd92aa2-fed9-44bd-8d2d-5469bb763df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:35.710810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-abd92aa2-fed9-44bd-8d2d-5469bb763df6 None None] MFA Rules not processed for user `2793417deeae4337a9c6b7c0d27f830c`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:35.712711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-abd92aa2-fed9-44bd-8d2d-5469bb763df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:35.765294 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1150/2274] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:35.768415 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e3832-d681-4ce5-b9e4-98e4ce6fedce None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:35.768840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e3832-d681-4ce5-b9e4-98e4ce6fedce None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:35.769360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e3832-d681-4ce5-b9e4-98e4ce6fedce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:35.811240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-6f9e3832-d681-4ce5-b9e4-98e4ce6fedce None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:35.814235 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6f9e3832-d681-4ce5-b9e4-98e4ce6fedce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:35.841289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1151/2275] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:35.846523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e3832-d681-4ce5-b9e4-98e4ce6fedce None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:35.861173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e3832-d681-4ce5-b9e4-98e4ce6fedce None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:35.874609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1125/2276] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:35.878157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20b66b-9989-489d-ac66-b9f692633211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:35.878157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20b66b-9989-489d-ac66-b9f692633211 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:35.878157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20b66b-9989-489d-ac66-b9f692633211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:35.878157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20b66b-9989-489d-ac66-b9f692633211 admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:35.879023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20b66b-9989-489d-ac66-b9f692633211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:05:35.879655 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20b66b-9989-489d-ac66-b9f692633211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:35.881934 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20b66b-9989-489d-ac66-b9f692633211 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:35.896628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1152/2277] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:05:35.901041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd92aa2-fed9-44bd-8d2d-5469bb763df6 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:35.919221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd92aa2-fed9-44bd-8d2d-5469bb763df6 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:35.926115 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a5e73-e49b-44c9-9a4e-befa4b5ed383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:35.926681 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a5e73-e49b-44c9-9a4e-befa4b5ed383 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:35.927578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a5e73-e49b-44c9-9a4e-befa4b5ed383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:35.927578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a5e73-e49b-44c9-9a4e-befa4b5ed383 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:35.928479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a5e73-e49b-44c9-9a4e-befa4b5ed383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:35.931043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a5e73-e49b-44c9-9a4e-befa4b5ed383 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:36.178241 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1126/2278] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:35 2022] POST /identity/v3/projects => generated 387 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:36.183374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20b66b-9989-489d-ac66-b9f692633211 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:36.194120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20b66b-9989-489d-ac66-b9f692633211 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:36.268876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcf5a6-6906-4ed9-844e-958c42c68f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:36.269763 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcf5a6-6906-4ed9-844e-958c42c68f73 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:36.270052 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcf5a6-6906-4ed9-844e-958c42c68f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:36.270335 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcf5a6-6906-4ed9-844e-958c42c68f73 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:36.274987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcf5a6-6906-4ed9-844e-958c42c68f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:36.274987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcf5a6-6906-4ed9-844e-958c42c68f73 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:36.402707 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1153/2279] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:36 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:36.404605 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a5e73-e49b-44c9-9a4e-befa4b5ed383 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:36.424010 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a5e73-e49b-44c9-9a4e-befa4b5ed383 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:36.426489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc3f56-a354-4eab-b1a4-99f0e1a16f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:36.427195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc3f56-a354-4eab-b1a4-99f0e1a16f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:36.427481 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc3f56-a354-4eab-b1a4-99f0e1a16f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:36.427759 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc3f56-a354-4eab-b1a4-99f0e1a16f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:36.429585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc3f56-a354-4eab-b1a4-99f0e1a16f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:36.431587 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc3f56-a354-4eab-b1a4-99f0e1a16f16 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:36.447589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1127/2280] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:36.448427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcf5a6-6906-4ed9-844e-958c42c68f73 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:36.474591 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcf5a6-6906-4ed9-844e-958c42c68f73 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:36.478211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157fa61-00ff-4f0a-a709-81acc9437370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:36.479381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157fa61-00ff-4f0a-a709-81acc9437370 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:36.479780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157fa61-00ff-4f0a-a709-81acc9437370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:36.480167 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157fa61-00ff-4f0a-a709-81acc9437370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:36.481450 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157fa61-00ff-4f0a-a709-81acc9437370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:36.484237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157fa61-00ff-4f0a-a709-81acc9437370 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:36.500765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1154/2281] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:36.506533 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc3f56-a354-4eab-b1a4-99f0e1a16f16 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:36.523676 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc3f56-a354-4eab-b1a4-99f0e1a16f16 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:36.531847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29b357-1e18-4fe3-bfcd-e661da4dee70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:36.533180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29b357-1e18-4fe3-bfcd-e661da4dee70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:36.533533 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29b357-1e18-4fe3-bfcd-e661da4dee70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:36.533890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29b357-1e18-4fe3-bfcd-e661da4dee70 admin admin] PATH_INFO: `/v3/projects/4e73346be93149a98e70a4708651da37/users/b18927bd69e04ee397418e4c6c34e0fd/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:36.553551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29b357-1e18-4fe3-bfcd-e661da4dee70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e73346be93149a98e70a4708651da37, user_id=b18927bd69e04ee397418e4c6c34e0fd, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:36.556299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29b357-1e18-4fe3-bfcd-e661da4dee70 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:36.786925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1128/2282] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:36 2022] PUT /identity/v3/projects/4e73346be93149a98e70a4708651da37/users/b18927bd69e04ee397418e4c6c34e0fd/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:36.798116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d3044-2e4f-40d5-a64a-55a6735e218d None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:36.798803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d3044-2e4f-40d5-a64a-55a6735e218d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:36.798803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d3044-2e4f-40d5-a64a-55a6735e218d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:36.846532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-920d3044-2e4f-40d5-a64a-55a6735e218d None None] MFA Rules not processed for user `b18927bd69e04ee397418e4c6c34e0fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:36.846532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-920d3044-2e4f-40d5-a64a-55a6735e218d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:36.929286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1155/2283] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:36.933522 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29b357-1e18-4fe3-bfcd-e661da4dee70 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:37.035277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29b357-1e18-4fe3-bfcd-e661da4dee70 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:37.041353 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f8091-3480-4907-83f5-5cdeb23c2231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:37.042583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f8091-3480-4907-83f5-5cdeb23c2231 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:37.043104 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f8091-3480-4907-83f5-5cdeb23c2231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:37.043572 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f8091-3480-4907-83f5-5cdeb23c2231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:37.044902 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f8091-3480-4907-83f5-5cdeb23c2231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:37.047874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f8091-3480-4907-83f5-5cdeb23c2231 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:37.283415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1129/2284] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:36 2022] POST /identity/v3/projects => generated 383 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:37.287218 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d3044-2e4f-40d5-a64a-55a6735e218d None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:37.306071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d3044-2e4f-40d5-a64a-55a6735e218d None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:37.402534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb93dd-0616-4287-9a8f-cfd634bf7314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:37.404296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb93dd-0616-4287-9a8f-cfd634bf7314 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:37.404917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb93dd-0616-4287-9a8f-cfd634bf7314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:37.405657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb93dd-0616-4287-9a8f-cfd634bf7314 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:37.407607 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb93dd-0616-4287-9a8f-cfd634bf7314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:37.411376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb93dd-0616-4287-9a8f-cfd634bf7314 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:37.587700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1156/2285] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:37 2022] POST /identity/v3/users => generated 298 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:37.591759 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f8091-3480-4907-83f5-5cdeb23c2231 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:37.603033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f8091-3480-4907-83f5-5cdeb23c2231 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:37.607896 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2dc54-8031-4ed5-bb3a-cf157a8bc829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:37.608956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2dc54-8031-4ed5-bb3a-cf157a8bc829 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:37.609807 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2dc54-8031-4ed5-bb3a-cf157a8bc829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:37.610096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2dc54-8031-4ed5-bb3a-cf157a8bc829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:37.610834 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2dc54-8031-4ed5-bb3a-cf157a8bc829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:37.612442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2dc54-8031-4ed5-bb3a-cf157a8bc829 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:37.626335 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1130/2286] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:37.629618 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb93dd-0616-4287-9a8f-cfd634bf7314 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:37.639887 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb93dd-0616-4287-9a8f-cfd634bf7314 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:37.644527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf711522-6ee3-454d-b11b-ada73befde0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:37.645893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf711522-6ee3-454d-b11b-ada73befde0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:37.645893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf711522-6ee3-454d-b11b-ada73befde0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:37.646133 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf711522-6ee3-454d-b11b-ada73befde0e admin admin] PATH_INFO: `/v3/projects/7f28260cfe8f4169b1c72dae0fd64dba/users/19f832d0c8c249c9b20a6ca374d087e0/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:37.664197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf711522-6ee3-454d-b11b-ada73befde0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f28260cfe8f4169b1c72dae0fd64dba, user_id=19f832d0c8c249c9b20a6ca374d087e0, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:37.666989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf711522-6ee3-454d-b11b-ada73befde0e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:37.925296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1157/2287] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:37 2022] PUT /identity/v3/projects/7f28260cfe8f4169b1c72dae0fd64dba/users/19f832d0c8c249c9b20a6ca374d087e0/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:37.930645 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2dc54-8031-4ed5-bb3a-cf157a8bc829 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:37.941693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2dc54-8031-4ed5-bb3a-cf157a8bc829 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:38.047058 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32f49-d7cc-431b-8b27-e516866ce2eb None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:38.047467 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32f49-d7cc-431b-8b27-e516866ce2eb None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:38.047867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32f49-d7cc-431b-8b27-e516866ce2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:38.050284 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb12468-9cb7-4116-a3a0-e29e4aa38b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:38.052280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb12468-9cb7-4116-a3a0-e29e4aa38b13 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:38.052803 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb12468-9cb7-4116-a3a0-e29e4aa38b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:38.053739 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb12468-9cb7-4116-a3a0-e29e4aa38b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:38.054764 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb12468-9cb7-4116-a3a0-e29e4aa38b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:38.056743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb12468-9cb7-4116-a3a0-e29e4aa38b13 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:38.068646 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1131/2288] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:05:38.073160 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb12468-9cb7-4116-a3a0-e29e4aa38b13 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:38.095527 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb12468-9cb7-4116-a3a0-e29e4aa38b13 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:38.097789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-add32f49-d7cc-431b-8b27-e516866ce2eb None None] MFA Rules not processed for user `97a476fcf8104eb698196d20ce9e2e30`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:38.099524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-add32f49-d7cc-431b-8b27-e516866ce2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:38.107650 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87439ad7-4806-41a2-b6f8-9bf4c194fd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:38.111268 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87439ad7-4806-41a2-b6f8-9bf4c194fd51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:38.112282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87439ad7-4806-41a2-b6f8-9bf4c194fd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:38.113045 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87439ad7-4806-41a2-b6f8-9bf4c194fd51 admin admin] PATH_INFO: `/v3/projects/7f28260cfe8f4169b1c72dae0fd64dba/users/19f832d0c8c249c9b20a6ca374d087e0/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:38.118799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87439ad7-4806-41a2-b6f8-9bf4c194fd51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f28260cfe8f4169b1c72dae0fd64dba, user_id=19f832d0c8c249c9b20a6ca374d087e0, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:38.125858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87439ad7-4806-41a2-b6f8-9bf4c194fd51 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:38.147162 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1132/2289] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:38 2022] PUT /identity/v3/projects/7f28260cfe8f4169b1c72dae0fd64dba/users/19f832d0c8c249c9b20a6ca374d087e0/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:05:38.157672 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54c8fd-2007-4bf9-9c8f-87450a81ce41 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:38.158246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54c8fd-2007-4bf9-9c8f-87450a81ce41 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:38.158713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54c8fd-2007-4bf9-9c8f-87450a81ce41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:38.174097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1158/2290] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:38.198431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-4e54c8fd-2007-4bf9-9c8f-87450a81ce41 None None] MFA Rules not processed for user `19f832d0c8c249c9b20a6ca374d087e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:38.200449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4e54c8fd-2007-4bf9-9c8f-87450a81ce41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:38.301346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1133/2291] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:38.311046 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add32f49-d7cc-431b-8b27-e516866ce2eb None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:38.313564 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-add32f49-d7cc-431b-8b27-e516866ce2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:38.399426 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:38.405653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add32f49-d7cc-431b-8b27-e516866ce2eb None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:38.471092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba50b4-93e9-4582-aac9-1dcc499e89d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:38.471798 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba50b4-93e9-4582-aac9-1dcc499e89d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:38.472089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba50b4-93e9-4582-aac9-1dcc499e89d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:38.472546 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba50b4-93e9-4582-aac9-1dcc499e89d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:38.489589 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba50b4-93e9-4582-aac9-1dcc499e89d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:38.489589 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba50b4-93e9-4582-aac9-1dcc499e89d0 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:38.513212 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1159/2292] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:39.125971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54c8fd-2007-4bf9-9c8f-87450a81ce41 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:39.127450 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4e54c8fd-2007-4bf9-9c8f-87450a81ce41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:39.142515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54c8fd-2007-4bf9-9c8f-87450a81ce41 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:39.149550 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dddf1a-0af2-4752-a291-cb65f9a2360a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:39.150668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dddf1a-0af2-4752-a291-cb65f9a2360a service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:39.150955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dddf1a-0af2-4752-a291-cb65f9a2360a service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:39.151421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dddf1a-0af2-4752-a291-cb65f9a2360a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:39.156255 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-63dddf1a-0af2-4752-a291-cb65f9a2360a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:39.233381 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dddf1a-0af2-4752-a291-cb65f9a2360a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:39.236030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dddf1a-0af2-4752-a291-cb65f9a2360a service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:39.249296 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1134/2293] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:40.163444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=87,keystone:DELETE=5,keystone:INSERT=8 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:40.243628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ebc3f-75fd-489e-808b-6fe9fb45a653 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:40.244142 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ebc3f-75fd-489e-808b-6fe9fb45a653 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:40.244499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ebc3f-75fd-489e-808b-6fe9fb45a653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:40.263087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-ad0ebc3f-75fd-489e-808b-6fe9fb45a653 None None] MFA Rules not processed for user `538cc13998f14a3ba870184f18648526`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:40.264332 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ad0ebc3f-75fd-489e-808b-6fe9fb45a653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:40.320834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1160/2294] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:40.421644 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dddf1a-0af2-4752-a291-cb65f9a2360a service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:40.508116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dddf1a-0af2-4752-a291-cb65f9a2360a service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:40.515508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dced8d-6cd2-42c4-862a-6dec7bd6b39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:40.517345 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dced8d-6cd2-42c4-862a-6dec7bd6b39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:40.523829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dced8d-6cd2-42c4-862a-6dec7bd6b39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:40.523829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dced8d-6cd2-42c4-862a-6dec7bd6b39a admin admin] PATH_INFO: `/v3/users/b18927bd69e04ee397418e4c6c34e0fd` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:40.523829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dced8d-6cd2-42c4-862a-6dec7bd6b39a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18927bd69e04ee397418e4c6c34e0fd)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:40.523829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dced8d-6cd2-42c4-862a-6dec7bd6b39a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:41.014628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-71dced8d-6cd2-42c4-862a-6dec7bd6b39a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18927bd69e04ee397418e4c6c34e0fd'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:41.014628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-71dced8d-6cd2-42c4-862a-6dec7bd6b39a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18927bd69e04ee397418e4c6c34e0fd'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:41.021475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-71dced8d-6cd2-42c4-862a-6dec7bd6b39a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18927bd69e04ee397418e4c6c34e0fd'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:41.022221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-71dced8d-6cd2-42c4-862a-6dec7bd6b39a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18927bd69e04ee397418e4c6c34e0fd'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:41.257939 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-71dced8d-6cd2-42c4-862a-6dec7bd6b39a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18927bd69e04ee397418e4c6c34e0fd'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:41.310545 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1135/2295] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:40 2022] DELETE /identity/v3/users/b18927bd69e04ee397418e4c6c34e0fd => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:41.316994 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89ce57-8a36-4c60-951d-c41c621b5033 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:41.317486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89ce57-8a36-4c60-951d-c41c621b5033 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:41.317608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89ce57-8a36-4c60-951d-c41c621b5033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:41.345535 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-eb89ce57-8a36-4c60-951d-c41c621b5033 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:41.353484 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-eb89ce57-8a36-4c60-951d-c41c621b5033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:41.425680 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1161/2296] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:41.435551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dced8d-6cd2-42c4-862a-6dec7bd6b39a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:41.436976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-71dced8d-6cd2-42c4-862a-6dec7bd6b39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:41.546584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dced8d-6cd2-42c4-862a-6dec7bd6b39a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:41.551030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee4f07-ad3d-4d0d-83be-b5698cb10d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:41.552207 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee4f07-ad3d-4d0d-83be-b5698cb10d09 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:41.552601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee4f07-ad3d-4d0d-83be-b5698cb10d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:41.557265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee4f07-ad3d-4d0d-83be-b5698cb10d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:41.568745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee4f07-ad3d-4d0d-83be-b5698cb10d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:41.570319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee4f07-ad3d-4d0d-83be-b5698cb10d09 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:41.584798 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1136/2297] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:42.325360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89ce57-8a36-4c60-951d-c41c621b5033 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:42.327644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-eb89ce57-8a36-4c60-951d-c41c621b5033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:42.345251 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89ce57-8a36-4c60-951d-c41c621b5033 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:42.350223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e28403-a2cd-4cf8-84ab-328cc96d9040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:42.351108 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e28403-a2cd-4cf8-84ab-328cc96d9040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:42.351398 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e28403-a2cd-4cf8-84ab-328cc96d9040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:42.351681 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e28403-a2cd-4cf8-84ab-328cc96d9040 admin admin] PATH_INFO: `/v3/projects/4e73346be93149a98e70a4708651da37` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:42.357575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e28403-a2cd-4cf8-84ab-328cc96d9040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e73346be93149a98e70a4708651da37)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:42.360586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e28403-a2cd-4cf8-84ab-328cc96d9040 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:42.558339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-02e28403-a2cd-4cf8-84ab-328cc96d9040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e73346be93149a98e70a4708651da37', 'request_id': 'req-02e28403-a2cd-4cf8-84ab-328cc96d9040'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:42.564771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-02e28403-a2cd-4cf8-84ab-328cc96d9040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e73346be93149a98e70a4708651da37', 'request_id': 'req-02e28403-a2cd-4cf8-84ab-328cc96d9040'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:42.570793 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-02e28403-a2cd-4cf8-84ab-328cc96d9040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e73346be93149a98e70a4708651da37', 'request_id': 'req-02e28403-a2cd-4cf8-84ab-328cc96d9040'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:42.663928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-02e28403-a2cd-4cf8-84ab-328cc96d9040 admin admin] The token cache is being invalidate because project 4e73346be93149a98e70a4708651da37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:42.664226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-02e28403-a2cd-4cf8-84ab-328cc96d9040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:42.665038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-02e28403-a2cd-4cf8-84ab-328cc96d9040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:42.667178 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1162/2298] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:42 2022] DELETE /identity/v3/projects/4e73346be93149a98e70a4708651da37 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:42.675749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee4f07-ad3d-4d0d-83be-b5698cb10d09 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:42.686453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee4f07-ad3d-4d0d-83be-b5698cb10d09 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:42.694265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:42.764609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc83f6-b3c1-4331-8c2d-267d4995db7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:42.766106 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc83f6-b3c1-4331-8c2d-267d4995db7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:42.766396 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc83f6-b3c1-4331-8c2d-267d4995db7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:42.766678 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc83f6-b3c1-4331-8c2d-267d4995db7d admin admin] PATH_INFO: `/v3/users/19f832d0c8c249c9b20a6ca374d087e0` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:42.767941 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc83f6-b3c1-4331-8c2d-267d4995db7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f832d0c8c249c9b20a6ca374d087e0)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:42.769912 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc83f6-b3c1-4331-8c2d-267d4995db7d admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:43.078679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bcfc83f6-b3c1-4331-8c2d-267d4995db7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f832d0c8c249c9b20a6ca374d087e0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:43.079345 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bcfc83f6-b3c1-4331-8c2d-267d4995db7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f832d0c8c249c9b20a6ca374d087e0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:43.086459 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bcfc83f6-b3c1-4331-8c2d-267d4995db7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f832d0c8c249c9b20a6ca374d087e0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:43.087118 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bcfc83f6-b3c1-4331-8c2d-267d4995db7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f832d0c8c249c9b20a6ca374d087e0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:43.191211 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bcfc83f6-b3c1-4331-8c2d-267d4995db7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f832d0c8c249c9b20a6ca374d087e0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:43.210298 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1137/2299] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:42 2022] DELETE /identity/v3/users/19f832d0c8c249c9b20a6ca374d087e0 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:05:44.119756 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:45.350035 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e28403-a2cd-4cf8-84ab-328cc96d9040 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:45.352242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-02e28403-a2cd-4cf8-84ab-328cc96d9040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:45.373865 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e28403-a2cd-4cf8-84ab-328cc96d9040 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:45.474273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9647f-0779-4df3-828c-1462dc7cda3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:45.475276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9647f-0779-4df3-828c-1462dc7cda3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:45.475760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9647f-0779-4df3-828c-1462dc7cda3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:45.476114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9647f-0779-4df3-828c-1462dc7cda3a admin admin] PATH_INFO: `/v3/projects/7f28260cfe8f4169b1c72dae0fd64dba` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:45.477619 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9647f-0779-4df3-828c-1462dc7cda3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f28260cfe8f4169b1c72dae0fd64dba)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:45.479644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9647f-0779-4df3-828c-1462dc7cda3a admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:45.676821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b4f9647f-0779-4df3-828c-1462dc7cda3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f28260cfe8f4169b1c72dae0fd64dba', 'request_id': 'req-b4f9647f-0779-4df3-828c-1462dc7cda3a'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:45.688497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b4f9647f-0779-4df3-828c-1462dc7cda3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f28260cfe8f4169b1c72dae0fd64dba', 'request_id': 'req-b4f9647f-0779-4df3-828c-1462dc7cda3a'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:45.697883 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b4f9647f-0779-4df3-828c-1462dc7cda3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f28260cfe8f4169b1c72dae0fd64dba', 'request_id': 'req-b4f9647f-0779-4df3-828c-1462dc7cda3a'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:45.875056 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b4f9647f-0779-4df3-828c-1462dc7cda3a admin admin] The token cache is being invalidate because project 7f28260cfe8f4169b1c72dae0fd64dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:45.875056 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b4f9647f-0779-4df3-828c-1462dc7cda3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:45.875056 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b4f9647f-0779-4df3-828c-1462dc7cda3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:45.875056 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1163/2300] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:45 2022] DELETE /identity/v3/projects/7f28260cfe8f4169b1c72dae0fd64dba => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:05:45.880760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7acd0-22aa-49bf-80b7-fffcd7e2fef5 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:45.881395 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7acd0-22aa-49bf-80b7-fffcd7e2fef5 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:45.881395 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7acd0-22aa-49bf-80b7-fffcd7e2fef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:45.905176 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-21e7acd0-22aa-49bf-80b7-fffcd7e2fef5 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:45.908725 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-21e7acd0-22aa-49bf-80b7-fffcd7e2fef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:45.986480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1138/2301] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:05:45.996299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9502b62-0340-4654-8508-cbeae0a1e261 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:45.996299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9502b62-0340-4654-8508-cbeae0a1e261 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:45.996299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9502b62-0340-4654-8508-cbeae0a1e261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:46.019393 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-f9502b62-0340-4654-8508-cbeae0a1e261 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:46.021246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-f9502b62-0340-4654-8508-cbeae0a1e261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:46.034533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1164/2302] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:46.038099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7acd0-22aa-49bf-80b7-fffcd7e2fef5 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:46.050006 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7acd0-22aa-49bf-80b7-fffcd7e2fef5 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:46.056373 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd7fd9-45a8-4bc5-8d71-7e7123987ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:46.057310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd7fd9-45a8-4bc5-8d71-7e7123987ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:46.057606 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd7fd9-45a8-4bc5-8d71-7e7123987ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:46.057894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd7fd9-45a8-4bc5-8d71-7e7123987ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:46.058787 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd7fd9-45a8-4bc5-8d71-7e7123987ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:05:46.059219 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd7fd9-45a8-4bc5-8d71-7e7123987ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:46.064190 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd7fd9-45a8-4bc5-8d71-7e7123987ca6 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:46.085709 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1139/2303] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:05:46.090135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9502b62-0340-4654-8508-cbeae0a1e261 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:46.103599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9502b62-0340-4654-8508-cbeae0a1e261 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:46.111460 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dbe39-eb8b-4164-8a17-808322715d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:46.112245 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dbe39-eb8b-4164-8a17-808322715d72 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:46.112571 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dbe39-eb8b-4164-8a17-808322715d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:46.112862 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dbe39-eb8b-4164-8a17-808322715d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:46.113661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12dbe39-eb8b-4164-8a17-808322715d72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:46.116546 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12dbe39-eb8b-4164-8a17-808322715d72 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:46.333150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1165/2304] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:46 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:46.338531 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd7fd9-45a8-4bc5-8d71-7e7123987ca6 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:46.364848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd7fd9-45a8-4bc5-8d71-7e7123987ca6 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:46.482040 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49670850-3872-4730-8d8f-6b1566610454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:46.482598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49670850-3872-4730-8d8f-6b1566610454 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:46.482889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49670850-3872-4730-8d8f-6b1566610454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:46.484544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49670850-3872-4730-8d8f-6b1566610454 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:46.485399 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49670850-3872-4730-8d8f-6b1566610454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:46.487266 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49670850-3872-4730-8d8f-6b1566610454 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:46.715523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1140/2305] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:46 2022] POST /identity/v3/users => generated 293 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:46.716933 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dbe39-eb8b-4164-8a17-808322715d72 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:46.736222 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dbe39-eb8b-4164-8a17-808322715d72 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:46.746952 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86ca2c-1756-44b0-8a89-80ef7e573fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:46.747906 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86ca2c-1756-44b0-8a89-80ef7e573fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:46.748388 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86ca2c-1756-44b0-8a89-80ef7e573fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:46.748859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86ca2c-1756-44b0-8a89-80ef7e573fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:46.750521 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86ca2c-1756-44b0-8a89-80ef7e573fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:46.752381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86ca2c-1756-44b0-8a89-80ef7e573fa7 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:46.767254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1166/2306] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:05:46.771734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49670850-3872-4730-8d8f-6b1566610454 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:46.782844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49670850-3872-4730-8d8f-6b1566610454 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:46.796976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5c39d-5c71-4bce-bea5-02d4622ea1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:46.797813 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5c39d-5c71-4bce-bea5-02d4622ea1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:46.798250 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5c39d-5c71-4bce-bea5-02d4622ea1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:46.798535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5c39d-5c71-4bce-bea5-02d4622ea1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:46.799314 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5c39d-5c71-4bce-bea5-02d4622ea1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:46.801072 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5c39d-5c71-4bce-bea5-02d4622ea1a3 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:46.817745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1141/2307] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:05:46.823965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86ca2c-1756-44b0-8a89-80ef7e573fa7 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:46.835952 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86ca2c-1756-44b0-8a89-80ef7e573fa7 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:46.841434 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92f1b0-8b00-466e-865c-b90410fa81a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:46.843310 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92f1b0-8b00-466e-865c-b90410fa81a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:46.845354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92f1b0-8b00-466e-865c-b90410fa81a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:46.846008 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92f1b0-8b00-466e-865c-b90410fa81a6 admin admin] PATH_INFO: `/v3/projects/2d4fa721e7f142fbb77a07d1ddbdb5cf/users/f4a550e2e6c149aba5f3fed97613cf34/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:46.869451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92f1b0-8b00-466e-865c-b90410fa81a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d4fa721e7f142fbb77a07d1ddbdb5cf, user_id=f4a550e2e6c149aba5f3fed97613cf34, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:46.874834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92f1b0-8b00-466e-865c-b90410fa81a6 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:47.071270 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1167/2308] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:05:46 2022] PUT /identity/v3/projects/2d4fa721e7f142fbb77a07d1ddbdb5cf/users/f4a550e2e6c149aba5f3fed97613cf34/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:05:47.082337 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06232212-cf0f-4ec3-b722-f1722412c0cd None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:47.087581 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06232212-cf0f-4ec3-b722-f1722412c0cd None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:47.087581 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06232212-cf0f-4ec3-b722-f1722412c0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:47.112581 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-06232212-cf0f-4ec3-b722-f1722412c0cd None None] MFA Rules not processed for user `f4a550e2e6c149aba5f3fed97613cf34`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:47.113894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-06232212-cf0f-4ec3-b722-f1722412c0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:47.209180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1142/2309] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:47.225873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92f1b0-8b00-466e-865c-b90410fa81a6 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:47.228587 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ae92f1b0-8b00-466e-865c-b90410fa81a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:47.297984 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92f1b0-8b00-466e-865c-b90410fa81a6 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:47.303018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01aab6f-79df-4df5-af05-a98124556fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:47.304366 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aab6f-79df-4df5-af05-a98124556fca service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:47.304867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aab6f-79df-4df5-af05-a98124556fca service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:47.305235 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aab6f-79df-4df5-af05-a98124556fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:47.319563 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01aab6f-79df-4df5-af05-a98124556fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:47.321766 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01aab6f-79df-4df5-af05-a98124556fca service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:47.338466 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1168/2310] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:48.210348 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:48.359028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:52.259023 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06232212-cf0f-4ec3-b722-f1722412c0cd None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:52.336701 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06232212-cf0f-4ec3-b722-f1722412c0cd None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:52.341914 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51d1ca-5122-444f-b9f5-d5e7b8196610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:52.343655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51d1ca-5122-444f-b9f5-d5e7b8196610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:52.344670 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51d1ca-5122-444f-b9f5-d5e7b8196610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:52.345049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51d1ca-5122-444f-b9f5-d5e7b8196610 admin admin] PATH_INFO: `/v3/users/f4a550e2e6c149aba5f3fed97613cf34` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:52.346385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51d1ca-5122-444f-b9f5-d5e7b8196610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a550e2e6c149aba5f3fed97613cf34)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:52.351020 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51d1ca-5122-444f-b9f5-d5e7b8196610 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:52.615333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:52.778720 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4f51d1ca-5122-444f-b9f5-d5e7b8196610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a550e2e6c149aba5f3fed97613cf34'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:52.780094 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4f51d1ca-5122-444f-b9f5-d5e7b8196610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a550e2e6c149aba5f3fed97613cf34'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:52.791838 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4f51d1ca-5122-444f-b9f5-d5e7b8196610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a550e2e6c149aba5f3fed97613cf34'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:52.796507 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4f51d1ca-5122-444f-b9f5-d5e7b8196610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a550e2e6c149aba5f3fed97613cf34'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:52.945793 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-4f51d1ca-5122-444f-b9f5-d5e7b8196610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a550e2e6c149aba5f3fed97613cf34'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:52.981190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4e84b-50ee-41e7-ad46-9466bb3ca540 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:52.981619 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4e84b-50ee-41e7-ad46-9466bb3ca540 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:52.982158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4e84b-50ee-41e7-ad46-9466bb3ca540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:52.983748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1143/2311] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:52 2022] DELETE /identity/v3/users/f4a550e2e6c149aba5f3fed97613cf34 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:53.026569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-30e4e84b-50ee-41e7-ad46-9466bb3ca540 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:53.026569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-30e4e84b-50ee-41e7-ad46-9466bb3ca540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:53.132281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1169/2312] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:53.143259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51d1ca-5122-444f-b9f5-d5e7b8196610 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:53.144817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4f51d1ca-5122-444f-b9f5-d5e7b8196610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:53.279595 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51d1ca-5122-444f-b9f5-d5e7b8196610 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:53.283567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f70bf-2447-4fe1-8e7f-b9b6453da44c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:53.284237 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f70bf-2447-4fe1-8e7f-b9b6453da44c service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:53.284777 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f70bf-2447-4fe1-8e7f-b9b6453da44c service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:53.285270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f70bf-2447-4fe1-8e7f-b9b6453da44c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:53.295769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f70bf-2447-4fe1-8e7f-b9b6453da44c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:53.297810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f70bf-2447-4fe1-8e7f-b9b6453da44c service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:53.325822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1144/2313] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:54.028885 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4e84b-50ee-41e7-ad46-9466bb3ca540 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:54.030579 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-30e4e84b-50ee-41e7-ad46-9466bb3ca540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:54.055761 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4e84b-50ee-41e7-ad46-9466bb3ca540 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:54.069397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ad2bb-8c53-4bea-bbcb-3114fdbe8ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:54.074917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ad2bb-8c53-4bea-bbcb-3114fdbe8ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:54.075602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ad2bb-8c53-4bea-bbcb-3114fdbe8ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:54.076176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ad2bb-8c53-4bea-bbcb-3114fdbe8ace admin admin] PATH_INFO: `/v3/projects/2d4fa721e7f142fbb77a07d1ddbdb5cf` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:54.080687 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ad2bb-8c53-4bea-bbcb-3114fdbe8ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d4fa721e7f142fbb77a07d1ddbdb5cf)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:54.087848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ad2bb-8c53-4bea-bbcb-3114fdbe8ace admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:54.306738 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5f7ad2bb-8c53-4bea-bbcb-3114fdbe8ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d4fa721e7f142fbb77a07d1ddbdb5cf', 'request_id': 'req-5f7ad2bb-8c53-4bea-bbcb-3114fdbe8ace'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:54.313958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5f7ad2bb-8c53-4bea-bbcb-3114fdbe8ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d4fa721e7f142fbb77a07d1ddbdb5cf', 'request_id': 'req-5f7ad2bb-8c53-4bea-bbcb-3114fdbe8ace'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:54.331313 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5f7ad2bb-8c53-4bea-bbcb-3114fdbe8ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d4fa721e7f142fbb77a07d1ddbdb5cf', 'request_id': 'req-5f7ad2bb-8c53-4bea-bbcb-3114fdbe8ace'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:54.467374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5f7ad2bb-8c53-4bea-bbcb-3114fdbe8ace admin admin] The token cache is being invalidate because project 2d4fa721e7f142fbb77a07d1ddbdb5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:54.467998 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5f7ad2bb-8c53-4bea-bbcb-3114fdbe8ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:54.474958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5f7ad2bb-8c53-4bea-bbcb-3114fdbe8ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:54.474958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1170/2314] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:54 2022] DELETE /identity/v3/projects/2d4fa721e7f142fbb77a07d1ddbdb5cf => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:55.209951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:57.513412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f70bf-2447-4fe1-8e7f-b9b6453da44c service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:57.515555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-bc7f70bf-2447-4fe1-8e7f-b9b6453da44c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:57.533829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f70bf-2447-4fe1-8e7f-b9b6453da44c service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:57.610137 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094e6c7-fff5-47ed-b964-125429e27bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:57.611041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094e6c7-fff5-47ed-b964-125429e27bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:57.611331 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094e6c7-fff5-47ed-b964-125429e27bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:57.611617 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094e6c7-fff5-47ed-b964-125429e27bcb admin admin] PATH_INFO: `/v3/users/e44aeac5ec084a64be4af38c2c938bba` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:57.612889 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094e6c7-fff5-47ed-b964-125429e27bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44aeac5ec084a64be4af38c2c938bba)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:57.621067 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094e6c7-fff5-47ed-b964-125429e27bcb admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:57.752054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:57.936993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e094e6c7-fff5-47ed-b964-125429e27bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44aeac5ec084a64be4af38c2c938bba'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:57.938191 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e094e6c7-fff5-47ed-b964-125429e27bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44aeac5ec084a64be4af38c2c938bba'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:57.948026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e094e6c7-fff5-47ed-b964-125429e27bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44aeac5ec084a64be4af38c2c938bba'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:57.949255 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e094e6c7-fff5-47ed-b964-125429e27bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44aeac5ec084a64be4af38c2c938bba'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:58.123479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e094e6c7-fff5-47ed-b964-125429e27bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44aeac5ec084a64be4af38c2c938bba'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:58.161325 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1145/2315] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:05:57 2022] DELETE /identity/v3/users/e44aeac5ec084a64be4af38c2c938bba => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:58.171240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175589e3-8304-4695-aa2e-5369de25009f None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:58.171541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175589e3-8304-4695-aa2e-5369de25009f None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:58.172354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175589e3-8304-4695-aa2e-5369de25009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:58.201907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-175589e3-8304-4695-aa2e-5369de25009f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:58.204256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-175589e3-8304-4695-aa2e-5369de25009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:58.281812 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1171/2316] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:58.295001 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094e6c7-fff5-47ed-b964-125429e27bcb admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:58.296559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e094e6c7-fff5-47ed-b964-125429e27bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:58.370678 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094e6c7-fff5-47ed-b964-125429e27bcb admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:58.375591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a75a49-f165-44cd-a825-b4595180dbf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:58.381594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a75a49-f165-44cd-a825-b4595180dbf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:58.381594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a75a49-f165-44cd-a825-b4595180dbf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:58.381594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a75a49-f165-44cd-a825-b4595180dbf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:58.387559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a75a49-f165-44cd-a825-b4595180dbf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:58.389367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a75a49-f165-44cd-a825-b4595180dbf1 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:58.408599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1146/2317] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:05:59.210486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175589e3-8304-4695-aa2e-5369de25009f None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:59.212551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-175589e3-8304-4695-aa2e-5369de25009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:59.230122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175589e3-8304-4695-aa2e-5369de25009f None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:59.236003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b9f29-1cd9-4c2d-ba1d-9eb3944fc398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:59.237365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b9f29-1cd9-4c2d-ba1d-9eb3944fc398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:59.237801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b9f29-1cd9-4c2d-ba1d-9eb3944fc398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:59.238219 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b9f29-1cd9-4c2d-ba1d-9eb3944fc398 admin admin] PATH_INFO: `/v3/projects/ea4e970e5614488882d6bf04fae8a177` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:59.240233 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b9f29-1cd9-4c2d-ba1d-9eb3944fc398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea4e970e5614488882d6bf04fae8a177)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:59.243339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b9f29-1cd9-4c2d-ba1d-9eb3944fc398 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:59.376924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-0c7b9f29-1cd9-4c2d-ba1d-9eb3944fc398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea4e970e5614488882d6bf04fae8a177', 'request_id': 'req-0c7b9f29-1cd9-4c2d-ba1d-9eb3944fc398'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:59.383177 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-0c7b9f29-1cd9-4c2d-ba1d-9eb3944fc398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea4e970e5614488882d6bf04fae8a177', 'request_id': 'req-0c7b9f29-1cd9-4c2d-ba1d-9eb3944fc398'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:59.388798 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-0c7b9f29-1cd9-4c2d-ba1d-9eb3944fc398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea4e970e5614488882d6bf04fae8a177', 'request_id': 'req-0c7b9f29-1cd9-4c2d-ba1d-9eb3944fc398'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:59.483505 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-0c7b9f29-1cd9-4c2d-ba1d-9eb3944fc398 admin admin] The token cache is being invalidate because project ea4e970e5614488882d6bf04fae8a177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:05:59.483813 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-0c7b9f29-1cd9-4c2d-ba1d-9eb3944fc398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:59.484695 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-0c7b9f29-1cd9-4c2d-ba1d-9eb3944fc398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:05:59.486295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1172/2318] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:05:59 2022] DELETE /identity/v3/projects/ea4e970e5614488882d6bf04fae8a177 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:05:59.491529 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db46e4c-866e-416c-8653-ef1f55de8fd2 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:59.492049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db46e4c-866e-416c-8653-ef1f55de8fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:59.492146 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db46e4c-866e-416c-8653-ef1f55de8fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:59.510576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-6db46e4c-866e-416c-8653-ef1f55de8fd2 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:59.511803 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-6db46e4c-866e-416c-8653-ef1f55de8fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:59.577383 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1147/2319] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:59.587125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0853b10-3c73-4c54-b7ad-e40c78e27a70 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:59.587421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0853b10-3c73-4c54-b7ad-e40c78e27a70 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:59.587706 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0853b10-3c73-4c54-b7ad-e40c78e27a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:59.606058 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-e0853b10-3c73-4c54-b7ad-e40c78e27a70 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:05:59.607305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e0853b10-3c73-4c54-b7ad-e40c78e27a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:05:59.616577 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1173/2320] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:05:59.621827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db46e4c-866e-416c-8653-ef1f55de8fd2 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:59.631931 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db46e4c-866e-416c-8653-ef1f55de8fd2 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:59.636642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db22df-f896-4f78-ac8e-d75176627a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:59.637412 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db22df-f896-4f78-ac8e-d75176627a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:59.637697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db22df-f896-4f78-ac8e-d75176627a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:59.637976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db22df-f896-4f78-ac8e-d75176627a64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:59.638717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db22df-f896-4f78-ac8e-d75176627a64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:05:59.639028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db22df-f896-4f78-ac8e-d75176627a64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:59.640630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db22df-f896-4f78-ac8e-d75176627a64 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:59.652175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1148/2321] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:05:59.656571 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0853b10-3c73-4c54-b7ad-e40c78e27a70 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:59.665711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0853b10-3c73-4c54-b7ad-e40c78e27a70 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:59.670344 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2da6e-a49e-480b-92fc-15aced4ea19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:59.670998 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2da6e-a49e-480b-92fc-15aced4ea19f admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:59.671305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2da6e-a49e-480b-92fc-15aced4ea19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:59.671586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2da6e-a49e-480b-92fc-15aced4ea19f admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:59.672793 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2da6e-a49e-480b-92fc-15aced4ea19f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:59.674743 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2da6e-a49e-480b-92fc-15aced4ea19f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:05:59.844928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1174/2322] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:05:59 2022] POST /identity/v3/projects => generated 397 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:05:59.849203 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db22df-f896-4f78-ac8e-d75176627a64 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:05:59.860784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db22df-f896-4f78-ac8e-d75176627a64 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:05:59.934145 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f1687-211d-4cab-acf9-a5fcafeef88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:05:59.934948 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f1687-211d-4cab-acf9-a5fcafeef88e admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:05:59.935268 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f1687-211d-4cab-acf9-a5fcafeef88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:05:59.935628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f1687-211d-4cab-acf9-a5fcafeef88e admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:05:59.936423 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f1687-211d-4cab-acf9-a5fcafeef88e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:05:59.939141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f1687-211d-4cab-acf9-a5fcafeef88e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:00.087695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1149/2323] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:05:59 2022] POST /identity/v3/users => generated 299 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:06:00.092529 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2da6e-a49e-480b-92fc-15aced4ea19f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:00.127494 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2da6e-a49e-480b-92fc-15aced4ea19f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:00.142188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff53b5-92dd-45ac-b6fe-9c1ea57d648a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:00.143089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff53b5-92dd-45ac-b6fe-9c1ea57d648a admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:00.143535 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff53b5-92dd-45ac-b6fe-9c1ea57d648a admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:00.144039 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff53b5-92dd-45ac-b6fe-9c1ea57d648a admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:00.144951 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff53b5-92dd-45ac-b6fe-9c1ea57d648a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:00.147133 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff53b5-92dd-45ac-b6fe-9c1ea57d648a admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:00.177388 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1175/2324] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:06:00.178646 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f1687-211d-4cab-acf9-a5fcafeef88e admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:00.196391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f1687-211d-4cab-acf9-a5fcafeef88e admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:00.201523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a8789-fac3-4318-9afa-acb93f8fc5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:00.202617 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a8789-fac3-4318-9afa-acb93f8fc5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:00.202617 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a8789-fac3-4318-9afa-acb93f8fc5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:00.202799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a8789-fac3-4318-9afa-acb93f8fc5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:00.207234 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a8789-fac3-4318-9afa-acb93f8fc5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:00.209095 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a8789-fac3-4318-9afa-acb93f8fc5d6 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:00.224066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1150/2325] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:06:00.224967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff53b5-92dd-45ac-b6fe-9c1ea57d648a admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:00.239977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff53b5-92dd-45ac-b6fe-9c1ea57d648a admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:00.244799 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80ff8d-dfd0-46a7-85d4-ddb673ede37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:00.246256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80ff8d-dfd0-46a7-85d4-ddb673ede37f admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:00.248665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80ff8d-dfd0-46a7-85d4-ddb673ede37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:00.248665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80ff8d-dfd0-46a7-85d4-ddb673ede37f admin admin] PATH_INFO: `/v3/projects/437f0f0cac924a13bd9b90ed0420468d/users/871e6e947e514ec1a15013e8a815fb88/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:00.271667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80ff8d-dfd0-46a7-85d4-ddb673ede37f admin admin] RBAC: Authorizing `identity:create_grant(project_id=437f0f0cac924a13bd9b90ed0420468d, user_id=871e6e947e514ec1a15013e8a815fb88, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:00.278963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80ff8d-dfd0-46a7-85d4-ddb673ede37f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:00.463236 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1176/2326] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:06:00 2022] PUT /identity/v3/projects/437f0f0cac924a13bd9b90ed0420468d/users/871e6e947e514ec1a15013e8a815fb88/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:00.474702 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56918ba5-23a7-4933-b2d0-e934166016a4 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:00.474932 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56918ba5-23a7-4933-b2d0-e934166016a4 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:00.475210 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56918ba5-23a7-4933-b2d0-e934166016a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:00.506570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-56918ba5-23a7-4933-b2d0-e934166016a4 None None] MFA Rules not processed for user `871e6e947e514ec1a15013e8a815fb88`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:00.507830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-56918ba5-23a7-4933-b2d0-e934166016a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:00.605727 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1151/2327] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:06:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:00.623176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80ff8d-dfd0-46a7-85d4-ddb673ede37f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:00.625082 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-1b80ff8d-dfd0-46a7-85d4-ddb673ede37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:00.690954 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80ff8d-dfd0-46a7-85d4-ddb673ede37f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:00.694892 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7406d3d-1056-487f-a56b-c69ab82fd3d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:00.695730 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7406d3d-1056-487f-a56b-c69ab82fd3d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:00.695985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7406d3d-1056-487f-a56b-c69ab82fd3d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:00.696264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7406d3d-1056-487f-a56b-c69ab82fd3d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:00.708259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7406d3d-1056-487f-a56b-c69ab82fd3d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:00.709769 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7406d3d-1056-487f-a56b-c69ab82fd3d0 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:00.721197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1177/2328] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:01.381994 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:DELETE=5,keystone:SELECT=87,keystone:INSERT=8 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:01.581428 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:04.404303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:05.568704 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:08.215564 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56918ba5-23a7-4933-b2d0-e934166016a4 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:08.287145 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56918ba5-23a7-4933-b2d0-e934166016a4 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:08.292713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0789a96-36e8-48b7-802d-ba8febf94b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:08.293702 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0789a96-36e8-48b7-802d-ba8febf94b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:08.293985 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0789a96-36e8-48b7-802d-ba8febf94b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:08.294261 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0789a96-36e8-48b7-802d-ba8febf94b14 admin admin] PATH_INFO: `/v3/users/871e6e947e514ec1a15013e8a815fb88` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:08.295636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0789a96-36e8-48b7-802d-ba8febf94b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=871e6e947e514ec1a15013e8a815fb88)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:08.297641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0789a96-36e8-48b7-802d-ba8febf94b14 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:08.549661 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:08.566179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-f0789a96-36e8-48b7-802d-ba8febf94b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '871e6e947e514ec1a15013e8a815fb88'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:08.566881 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-f0789a96-36e8-48b7-802d-ba8febf94b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '871e6e947e514ec1a15013e8a815fb88'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:08.577553 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-f0789a96-36e8-48b7-802d-ba8febf94b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '871e6e947e514ec1a15013e8a815fb88'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:08.579818 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-f0789a96-36e8-48b7-802d-ba8febf94b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '871e6e947e514ec1a15013e8a815fb88'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:08.712472 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-f0789a96-36e8-48b7-802d-ba8febf94b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '871e6e947e514ec1a15013e8a815fb88'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:08.724779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:08.731631 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1152/2329] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:06:08 2022] DELETE /identity/v3/users/871e6e947e514ec1a15013e8a815fb88 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:08.737792 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e49295-d84b-4c57-9586-6a1b88e34fa8 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:08.737792 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e49295-d84b-4c57-9586-6a1b88e34fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:08.738164 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e49295-d84b-4c57-9586-6a1b88e34fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:08.756783 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-f0e49295-d84b-4c57-9586-6a1b88e34fa8 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:08.758045 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-f0e49295-d84b-4c57-9586-6a1b88e34fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:08.818865 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1178/2330] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:06:08.828596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0789a96-36e8-48b7-802d-ba8febf94b14 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:08.830092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f0789a96-36e8-48b7-802d-ba8febf94b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:08.900951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0789a96-36e8-48b7-802d-ba8febf94b14 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:08.905207 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ceeb-86ec-4686-be93-f114e58146ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:08.905911 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ceeb-86ec-4686-be93-f114e58146ac service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:08.906204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ceeb-86ec-4686-be93-f114e58146ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:08.906619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ceeb-86ec-4686-be93-f114e58146ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:08.917178 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426ceeb-86ec-4686-be93-f114e58146ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:08.918664 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426ceeb-86ec-4686-be93-f114e58146ac service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:08.929301 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1153/2331] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:09.345562 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8afa-dcfd-4078-9fa2-ba4be8b6d7d3 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:09.345867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8afa-dcfd-4078-9fa2-ba4be8b6d7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:09.346370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8afa-dcfd-4078-9fa2-ba4be8b6d7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:09.415007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-072c8afa-dcfd-4078-9fa2-ba4be8b6d7d3 None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:09.416293 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-072c8afa-dcfd-4078-9fa2-ba4be8b6d7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:09.504927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1179/2332] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 16 15:06:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:09.557834 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ceeb-86ec-4686-be93-f114e58146ac service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:09.559588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a426ceeb-86ec-4686-be93-f114e58146ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:09.565709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c8afa-dcfd-4078-9fa2-ba4be8b6d7d3 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:09.567149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-072c8afa-dcfd-4078-9fa2-ba4be8b6d7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:09.588711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ceeb-86ec-4686-be93-f114e58146ac service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:09.597846 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763af7a-a154-47ef-b73f-7b4e94194139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:09.600780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763af7a-a154-47ef-b73f-7b4e94194139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:09.601706 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763af7a-a154-47ef-b73f-7b4e94194139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:09.602554 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763af7a-a154-47ef-b73f-7b4e94194139 admin admin] PATH_INFO: `/v3/projects/437f0f0cac924a13bd9b90ed0420468d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:09.604496 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763af7a-a154-47ef-b73f-7b4e94194139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=437f0f0cac924a13bd9b90ed0420468d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:09.607402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763af7a-a154-47ef-b73f-7b4e94194139 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:09.633473 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:09.669373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c8afa-dcfd-4078-9fa2-ba4be8b6d7d3 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:09.675173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58745bef-84cc-4f39-8d7f-cf77e6787729 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:09.675874 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58745bef-84cc-4f39-8d7f-cf77e6787729 service swift] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:09.676161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58745bef-84cc-4f39-8d7f-cf77e6787729 service swift] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:09.676476 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58745bef-84cc-4f39-8d7f-cf77e6787729 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:09.686578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58745bef-84cc-4f39-8d7f-cf77e6787729 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:09.688229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58745bef-84cc-4f39-8d7f-cf77e6787729 service swift] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:09.697371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1180/2333] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 15:06:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 15:06:09.787138 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2763af7a-a154-47ef-b73f-7b4e94194139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '437f0f0cac924a13bd9b90ed0420468d', 'request_id': 'req-2763af7a-a154-47ef-b73f-7b4e94194139'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:09.794829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2763af7a-a154-47ef-b73f-7b4e94194139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '437f0f0cac924a13bd9b90ed0420468d', 'request_id': 'req-2763af7a-a154-47ef-b73f-7b4e94194139'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:09.800376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2763af7a-a154-47ef-b73f-7b4e94194139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '437f0f0cac924a13bd9b90ed0420468d', 'request_id': 'req-2763af7a-a154-47ef-b73f-7b4e94194139'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:09.986975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2763af7a-a154-47ef-b73f-7b4e94194139 admin admin] The token cache is being invalidate because project 437f0f0cac924a13bd9b90ed0420468d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:06:09.987278 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2763af7a-a154-47ef-b73f-7b4e94194139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:09.987944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2763af7a-a154-47ef-b73f-7b4e94194139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:09.989875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1154/2334] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:06:09 2022] DELETE /identity/v3/projects/437f0f0cac924a13bd9b90ed0420468d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:06:10.827832 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0f4af-24a3-4ed6-8f7b-2b29c9ffa6a7 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:10.828290 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0f4af-24a3-4ed6-8f7b-2b29c9ffa6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:10.829118 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0f4af-24a3-4ed6-8f7b-2b29c9ffa6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:10.850968 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-e1f0f4af-24a3-4ed6-8f7b-2b29c9ffa6a7 None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:10.852207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e1f0f4af-24a3-4ed6-8f7b-2b29c9ffa6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:10.907379 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1181/2335] 10.222.0.23 () {58 vars in 967 bytes} [Thu Jun 16 15:06:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:10.920464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763af7a-a154-47ef-b73f-7b4e94194139 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:10.921958 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2763af7a-a154-47ef-b73f-7b4e94194139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:10.995232 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763af7a-a154-47ef-b73f-7b4e94194139 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:11.001045 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf7288-a610-483c-bb6d-2dd89196bc14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:11.001811 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf7288-a610-483c-bb6d-2dd89196bc14 service swift] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:11.002101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf7288-a610-483c-bb6d-2dd89196bc14 service swift] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:11.002438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf7288-a610-483c-bb6d-2dd89196bc14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:11.011443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf7288-a610-483c-bb6d-2dd89196bc14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:11.013027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf7288-a610-483c-bb6d-2dd89196bc14 service swift] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:11.021656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1155/2336] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 15:06:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:06:11.071732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:11.885426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd8144-7dcb-488e-bf9b-f8f6f89bca1a None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:11.889290 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd8144-7dcb-488e-bf9b-f8f6f89bca1a None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:11.889290 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd8144-7dcb-488e-bf9b-f8f6f89bca1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:11.904800 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-2efd8144-7dcb-488e-bf9b-f8f6f89bca1a None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:11.906168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2efd8144-7dcb-488e-bf9b-f8f6f89bca1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:11.913809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1182/2337] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 16 15:06:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:11.926924 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf7288-a610-483c-bb6d-2dd89196bc14 service swift] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:11.939265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf7288-a610-483c-bb6d-2dd89196bc14 service swift] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:11.944452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d8b52-aaf3-4167-adfc-f6b58d8090a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:11.945183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d8b52-aaf3-4167-adfc-f6b58d8090a3 service swift] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:11.945483 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d8b52-aaf3-4167-adfc-f6b58d8090a3 service swift] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:11.945760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d8b52-aaf3-4167-adfc-f6b58d8090a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:11.954717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d8b52-aaf3-4167-adfc-f6b58d8090a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:11.956454 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d8b52-aaf3-4167-adfc-f6b58d8090a3 service swift] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:11.965347 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1156/2338] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 15:06:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:06:12.444468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:12.701124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b3959-4e8e-4558-b0c8-31620ef7ff34 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:12.701124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b3959-4e8e-4558-b0c8-31620ef7ff34 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:12.701124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b3959-4e8e-4558-b0c8-31620ef7ff34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:12.715564 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-ac0b3959-4e8e-4558-b0c8-31620ef7ff34 None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:12.716997 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ac0b3959-4e8e-4558-b0c8-31620ef7ff34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:12.725188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1183/2339] 10.222.0.23 () {58 vars in 967 bytes} [Thu Jun 16 15:06:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:12.738092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d8b52-aaf3-4167-adfc-f6b58d8090a3 service swift] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:12.748736 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d8b52-aaf3-4167-adfc-f6b58d8090a3 service swift] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:12.754338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a6412-341f-4e96-bfa4-ff3b13e52355 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:12.755173 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6412-341f-4e96-bfa4-ff3b13e52355 service swift] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:12.755461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6412-341f-4e96-bfa4-ff3b13e52355 service swift] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:12.755738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6412-341f-4e96-bfa4-ff3b13e52355 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:12.764387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a6412-341f-4e96-bfa4-ff3b13e52355 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:12.766636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a6412-341f-4e96-bfa4-ff3b13e52355 service swift] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:12.775173 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1157/2340] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 15:06:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:06:13.759289 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:13.838496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6e8f4-5628-49cb-a216-5ca7626edcda None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:13.839067 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6e8f4-5628-49cb-a216-5ca7626edcda None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:13.839197 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6e8f4-5628-49cb-a216-5ca7626edcda None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:13.841075 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1184/2341] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 16 15:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:06:13.886569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b83dd-a998-4dac-800c-54c6cbae0504 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:13.886861 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b83dd-a998-4dac-800c-54c6cbae0504 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:13.887143 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b83dd-a998-4dac-800c-54c6cbae0504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:13.943080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-f30b83dd-a998-4dac-800c-54c6cbae0504 None None] MFA Rules not processed for user `534035b2e8cf4f769e3dbbaabc0f6ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:13.944202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f30b83dd-a998-4dac-800c-54c6cbae0504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:14.024939 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1158/2342] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 16 15:06:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:14.036211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6e8f4-5628-49cb-a216-5ca7626edcda None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:14.037959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fad6e8f4-5628-49cb-a216-5ca7626edcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:14.055131 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6e8f4-5628-49cb-a216-5ca7626edcda None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:14.061103 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b56bbf-31cd-4f6e-960c-cfb44f7da165 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534035b2e8cf4f769e3dbbaabc0f6ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:14.061974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b56bbf-31cd-4f6e-960c-cfb44f7da165 service placement] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:14.061974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b56bbf-31cd-4f6e-960c-cfb44f7da165 service placement] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:14.062115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b56bbf-31cd-4f6e-960c-cfb44f7da165 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:14.074759 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b56bbf-31cd-4f6e-960c-cfb44f7da165 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:14.077209 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b56bbf-31cd-4f6e-960c-cfb44f7da165 service placement] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:14.087354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1185/2343] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:14.827097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:14.915573 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b83dd-a998-4dac-800c-54c6cbae0504 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:14.917422 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f30b83dd-a998-4dac-800c-54c6cbae0504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:15.003970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b83dd-a998-4dac-800c-54c6cbae0504 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:15.009071 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e216f96-9fde-47ed-94a7-377487cbf7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:15.010034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e216f96-9fde-47ed-94a7-377487cbf7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:15.010324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e216f96-9fde-47ed-94a7-377487cbf7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:15.010610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e216f96-9fde-47ed-94a7-377487cbf7b6 admin admin] PATH_INFO: `/v3/users/0a3775f4f5174656bb2640cf04634100` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:15.011948 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e216f96-9fde-47ed-94a7-377487cbf7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a3775f4f5174656bb2640cf04634100)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:15.014865 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e216f96-9fde-47ed-94a7-377487cbf7b6 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:15.306170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2e216f96-9fde-47ed-94a7-377487cbf7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a3775f4f5174656bb2640cf04634100'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:15.307047 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2e216f96-9fde-47ed-94a7-377487cbf7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a3775f4f5174656bb2640cf04634100'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:15.316457 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2e216f96-9fde-47ed-94a7-377487cbf7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a3775f4f5174656bb2640cf04634100'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:15.317085 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2e216f96-9fde-47ed-94a7-377487cbf7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a3775f4f5174656bb2640cf04634100'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:15.545949 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-2e216f96-9fde-47ed-94a7-377487cbf7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a3775f4f5174656bb2640cf04634100'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:15.565694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1159/2344] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:06:14 2022] DELETE /identity/v3/users/0a3775f4f5174656bb2640cf04634100 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:16.009423 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b56bbf-31cd-4f6e-960c-cfb44f7da165 service placement] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:16.021899 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b56bbf-31cd-4f6e-960c-cfb44f7da165 service placement] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:16.061792 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e216f96-9fde-47ed-94a7-377487cbf7b6 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:16.063291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2e216f96-9fde-47ed-94a7-377487cbf7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:16.087831 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39911d03-76c1-4cd4-bc13-339280e33964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:16.088767 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39911d03-76c1-4cd4-bc13-339280e33964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:16.089060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39911d03-76c1-4cd4-bc13-339280e33964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:16.089485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39911d03-76c1-4cd4-bc13-339280e33964 admin admin] PATH_INFO: `/v3/projects/0bb542b2876c45068095f2fbca08ee48` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:16.090713 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39911d03-76c1-4cd4-bc13-339280e33964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bb542b2876c45068095f2fbca08ee48)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:16.092701 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39911d03-76c1-4cd4-bc13-339280e33964 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:16.132573 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e216f96-9fde-47ed-94a7-377487cbf7b6 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:16.137216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8f1d8-60b3-4c8a-95f1-cf7d84c0ebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:16.138093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8f1d8-60b3-4c8a-95f1-cf7d84c0ebe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:16.138382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8f1d8-60b3-4c8a-95f1-cf7d84c0ebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:16.138665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8f1d8-60b3-4c8a-95f1-cf7d84c0ebe2 admin admin] PATH_INFO: `/v3/users/2793417deeae4337a9c6b7c0d27f830c` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:16.139856 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8f1d8-60b3-4c8a-95f1-cf7d84c0ebe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2793417deeae4337a9c6b7c0d27f830c)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:16.141834 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8f1d8-60b3-4c8a-95f1-cf7d84c0ebe2 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:16.313164 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-39911d03-76c1-4cd4-bc13-339280e33964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bb542b2876c45068095f2fbca08ee48', 'request_id': 'req-39911d03-76c1-4cd4-bc13-339280e33964'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:16.321492 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-39911d03-76c1-4cd4-bc13-339280e33964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bb542b2876c45068095f2fbca08ee48', 'request_id': 'req-39911d03-76c1-4cd4-bc13-339280e33964'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:16.327283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-39911d03-76c1-4cd4-bc13-339280e33964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bb542b2876c45068095f2fbca08ee48', 'request_id': 'req-39911d03-76c1-4cd4-bc13-339280e33964'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:16.501371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-39911d03-76c1-4cd4-bc13-339280e33964 admin admin] The token cache is being invalidate because project 0bb542b2876c45068095f2fbca08ee48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:06:16.501708 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-39911d03-76c1-4cd4-bc13-339280e33964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:16.502287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-39911d03-76c1-4cd4-bc13-339280e33964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:16.504709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1186/2345] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:06:16 2022] DELETE /identity/v3/projects/0bb542b2876c45068095f2fbca08ee48 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:16.508780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39911d03-76c1-4cd4-bc13-339280e33964 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:16.510426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-39911d03-76c1-4cd4-bc13-339280e33964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:16.510616 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-78f8f1d8-60b3-4c8a-95f1-cf7d84c0ebe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2793417deeae4337a9c6b7c0d27f830c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:16.511280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-78f8f1d8-60b3-4c8a-95f1-cf7d84c0ebe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2793417deeae4337a9c6b7c0d27f830c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:16.518612 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-78f8f1d8-60b3-4c8a-95f1-cf7d84c0ebe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2793417deeae4337a9c6b7c0d27f830c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:16.519332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-78f8f1d8-60b3-4c8a-95f1-cf7d84c0ebe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2793417deeae4337a9c6b7c0d27f830c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:16.586983 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39911d03-76c1-4cd4-bc13-339280e33964 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:16.586983 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea692c-4f29-4082-bd85-09b10676d01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:16.586983 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea692c-4f29-4082-bd85-09b10676d01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:16.586983 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea692c-4f29-4082-bd85-09b10676d01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:16.587541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea692c-4f29-4082-bd85-09b10676d01d admin admin] PATH_INFO: `/v3/users/98ba7b6718f440129efb215621e53b1c` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:16.587541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea692c-4f29-4082-bd85-09b10676d01d admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ba7b6718f440129efb215621e53b1c)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:16.587541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea692c-4f29-4082-bd85-09b10676d01d admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:16.707850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-78f8f1d8-60b3-4c8a-95f1-cf7d84c0ebe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2793417deeae4337a9c6b7c0d27f830c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:16.726593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1160/2346] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:06:16 2022] DELETE /identity/v3/users/2793417deeae4337a9c6b7c0d27f830c => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:06:16.730963 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda3d6-c385-4620-b8f0-0c21778ff5fc None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:16.731260 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda3d6-c385-4620-b8f0-0c21778ff5fc None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:16.731547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eda3d6-c385-4620-b8f0-0c21778ff5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:16.748784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-40eda3d6-c385-4620-b8f0-0c21778ff5fc None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:16.750747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-40eda3d6-c385-4620-b8f0-0c21778ff5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:16.804879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a6ea692c-4f29-4082-bd85-09b10676d01d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ba7b6718f440129efb215621e53b1c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:16.812281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a6ea692c-4f29-4082-bd85-09b10676d01d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ba7b6718f440129efb215621e53b1c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:16.815601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1161/2347] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:06:16.816090 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a6ea692c-4f29-4082-bd85-09b10676d01d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ba7b6718f440129efb215621e53b1c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:16.824053 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda3d6-c385-4620-b8f0-0c21778ff5fc None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:16.825462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-40eda3d6-c385-4620-b8f0-0c21778ff5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:16.829465 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a6ea692c-4f29-4082-bd85-09b10676d01d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ba7b6718f440129efb215621e53b1c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:16.833402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a6ea692c-4f29-4082-bd85-09b10676d01d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ba7b6718f440129efb215621e53b1c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:16.887885 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eda3d6-c385-4620-b8f0-0c21778ff5fc None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:16.891817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66348165-d802-4128-818c-d1d368d6ecc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:16.892479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66348165-d802-4128-818c-d1d368d6ecc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:16.892765 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66348165-d802-4128-818c-d1d368d6ecc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:16.893042 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66348165-d802-4128-818c-d1d368d6ecc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:16.895163 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-66348165-d802-4128-818c-d1d368d6ecc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:16.908449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66348165-d802-4128-818c-d1d368d6ecc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:16.910597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66348165-d802-4128-818c-d1d368d6ecc6 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:16.920375 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1162/2348] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:16.977961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1187/2349] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:06:16 2022] DELETE /identity/v3/users/98ba7b6718f440129efb215621e53b1c => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:06:17.039222 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:17.229379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66348165-d802-4128-818c-d1d368d6ecc6 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:17.233777 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-66348165-d802-4128-818c-d1d368d6ecc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:17.243339 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66348165-d802-4128-818c-d1d368d6ecc6 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:17.277888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea692c-4f29-4082-bd85-09b10676d01d admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:17.279697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a6ea692c-4f29-4082-bd85-09b10676d01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:17.313966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c56e53-b36a-4de7-90e0-61a1547f602d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:17.315034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c56e53-b36a-4de7-90e0-61a1547f602d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:17.315483 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c56e53-b36a-4de7-90e0-61a1547f602d admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:17.315832 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c56e53-b36a-4de7-90e0-61a1547f602d admin admin] PATH_INFO: `/v3/projects/de51986d35f74e929c46157e5f9683a8` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:17.317255 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c56e53-b36a-4de7-90e0-61a1547f602d admin admin] RBAC: Authorizing `identity:delete_project(project_id=de51986d35f74e929c46157e5f9683a8)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:17.319166 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c56e53-b36a-4de7-90e0-61a1547f602d admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:17.354825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea692c-4f29-4082-bd85-09b10676d01d admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:17.359956 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59b8c2-35bf-4bbc-be0f-c515f94c1c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:17.360809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59b8c2-35bf-4bbc-be0f-c515f94c1c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:17.361113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59b8c2-35bf-4bbc-be0f-c515f94c1c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:17.361435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59b8c2-35bf-4bbc-be0f-c515f94c1c7b admin admin] PATH_INFO: `/v3/projects/8abc66c85058453b96aef20075ff5e3d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:17.362627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59b8c2-35bf-4bbc-be0f-c515f94c1c7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8abc66c85058453b96aef20075ff5e3d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:17.364672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59b8c2-35bf-4bbc-be0f-c515f94c1c7b admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:17.507345 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-55c56e53-b36a-4de7-90e0-61a1547f602d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de51986d35f74e929c46157e5f9683a8', 'request_id': 'req-55c56e53-b36a-4de7-90e0-61a1547f602d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:17.513452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-55c56e53-b36a-4de7-90e0-61a1547f602d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de51986d35f74e929c46157e5f9683a8', 'request_id': 'req-55c56e53-b36a-4de7-90e0-61a1547f602d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:17.519144 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-55c56e53-b36a-4de7-90e0-61a1547f602d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de51986d35f74e929c46157e5f9683a8', 'request_id': 'req-55c56e53-b36a-4de7-90e0-61a1547f602d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:17.547783 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-3b59b8c2-35bf-4bbc-be0f-c515f94c1c7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8abc66c85058453b96aef20075ff5e3d', 'request_id': 'req-3b59b8c2-35bf-4bbc-be0f-c515f94c1c7b'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:17.553880 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-3b59b8c2-35bf-4bbc-be0f-c515f94c1c7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8abc66c85058453b96aef20075ff5e3d', 'request_id': 'req-3b59b8c2-35bf-4bbc-be0f-c515f94c1c7b'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:17.559607 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-3b59b8c2-35bf-4bbc-be0f-c515f94c1c7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8abc66c85058453b96aef20075ff5e3d', 'request_id': 'req-3b59b8c2-35bf-4bbc-be0f-c515f94c1c7b'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:17.610766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-55c56e53-b36a-4de7-90e0-61a1547f602d admin admin] The token cache is being invalidate because project de51986d35f74e929c46157e5f9683a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:06:17.611068 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-55c56e53-b36a-4de7-90e0-61a1547f602d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:17.611704 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-55c56e53-b36a-4de7-90e0-61a1547f602d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:17.613396 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1163/2350] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:06:17 2022] DELETE /identity/v3/projects/de51986d35f74e929c46157e5f9683a8 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:17.618299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2a16e-6340-4d7c-b835-a476b273d57c None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:17.618590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2a16e-6340-4d7c-b835-a476b273d57c None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:17.618874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2a16e-6340-4d7c-b835-a476b273d57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:17.636986 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-4db2a16e-6340-4d7c-b835-a476b273d57c None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:17.638224 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4db2a16e-6340-4d7c-b835-a476b273d57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:17.700304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1164/2351] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:06:17.708332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c17ac-7a5a-444c-af5f-3b0bfc48654a None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:17.708628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c17ac-7a5a-444c-af5f-3b0bfc48654a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:17.708910 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c17ac-7a5a-444c-af5f-3b0bfc48654a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:17.726643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-be9c17ac-7a5a-444c-af5f-3b0bfc48654a None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:17.727848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-be9c17ac-7a5a-444c-af5f-3b0bfc48654a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:17.735194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-3b59b8c2-35bf-4bbc-be0f-c515f94c1c7b admin admin] The token cache is being invalidate because project 8abc66c85058453b96aef20075ff5e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:06:17.741175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-3b59b8c2-35bf-4bbc-be0f-c515f94c1c7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:17.741353 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1165/2352] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:06:17.741479 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-3b59b8c2-35bf-4bbc-be0f-c515f94c1c7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:17.741479 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1188/2353] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:06:17 2022] DELETE /identity/v3/projects/8abc66c85058453b96aef20075ff5e3d => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:06:17.744110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c17ac-7a5a-444c-af5f-3b0bfc48654a None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:17.745375 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359eeb1-26c7-4ef4-836c-1e3b3848e4dc None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:17.745678 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359eeb1-26c7-4ef4-836c-1e3b3848e4dc None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:17.745962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359eeb1-26c7-4ef4-836c-1e3b3848e4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:17.753593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c17ac-7a5a-444c-af5f-3b0bfc48654a None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:17.759215 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cb1fe-e70e-4937-a6f0-b5440ba40208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:17.759966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cb1fe-e70e-4937-a6f0-b5440ba40208 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:17.760201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cb1fe-e70e-4937-a6f0-b5440ba40208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:17.760466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cb1fe-e70e-4937-a6f0-b5440ba40208 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:17.761245 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cb1fe-e70e-4937-a6f0-b5440ba40208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:06:17.761574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cb1fe-e70e-4937-a6f0-b5440ba40208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:17.763303 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cb1fe-e70e-4937-a6f0-b5440ba40208 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:17.764794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-2359eeb1-26c7-4ef4-836c-1e3b3848e4dc None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:17.766006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2359eeb1-26c7-4ef4-836c-1e3b3848e4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:17.775385 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1189/2354] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:06:17.779172 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1166/2355] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:06:17.782514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359eeb1-26c7-4ef4-836c-1e3b3848e4dc None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:17.783874 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2359eeb1-26c7-4ef4-836c-1e3b3848e4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:17.785700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924bafd-d4de-40ee-926a-751070d2e0df None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:17.785995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924bafd-d4de-40ee-926a-751070d2e0df None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:17.786284 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924bafd-d4de-40ee-926a-751070d2e0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:17.796244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359eeb1-26c7-4ef4-836c-1e3b3848e4dc None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:17.801033 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4440d-1f81-402b-9807-2ad41059d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:17.801971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4440d-1f81-402b-9807-2ad41059d17e admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:17.802253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4440d-1f81-402b-9807-2ad41059d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:17.802533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4440d-1f81-402b-9807-2ad41059d17e admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:17.803246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4440d-1f81-402b-9807-2ad41059d17e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:17.804648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-a924bafd-d4de-40ee-926a-751070d2e0df None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:17.805190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4440d-1f81-402b-9807-2ad41059d17e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:17.805939 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a924bafd-d4de-40ee-926a-751070d2e0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:17.816770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1167/2356] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:06:17.821104 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924bafd-d4de-40ee-926a-751070d2e0df None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:17.833403 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924bafd-d4de-40ee-926a-751070d2e0df None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:17.838421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcd658-8ddd-4751-887a-fbe8bc97b607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:17.839108 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcd658-8ddd-4751-887a-fbe8bc97b607 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:17.839402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcd658-8ddd-4751-887a-fbe8bc97b607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:17.839804 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcd658-8ddd-4751-887a-fbe8bc97b607 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:17.840435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcd658-8ddd-4751-887a-fbe8bc97b607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:06:17.840750 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcd658-8ddd-4751-887a-fbe8bc97b607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:17.842551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcd658-8ddd-4751-887a-fbe8bc97b607 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:17.854944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1168/2357] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:06:17.859329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcd658-8ddd-4751-887a-fbe8bc97b607 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:17.870890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcd658-8ddd-4751-887a-fbe8bc97b607 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:17.875783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d17488-19bc-43be-bc2c-097d81be9bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:17.876427 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d17488-19bc-43be-bc2c-097d81be9bef admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:17.876702 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d17488-19bc-43be-bc2c-097d81be9bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:17.876983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d17488-19bc-43be-bc2c-097d81be9bef admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:17.877704 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d17488-19bc-43be-bc2c-097d81be9bef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:17.880162 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d17488-19bc-43be-bc2c-097d81be9bef admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:17.930588 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1190/2358] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:06:17 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:06:17.936182 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4440d-1f81-402b-9807-2ad41059d17e admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:18.001474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4440d-1f81-402b-9807-2ad41059d17e admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:18.007087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9880b9-c5ea-4946-8f88-8f7dea15a94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:18.007765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9880b9-c5ea-4946-8f88-8f7dea15a94d admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:18.008079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9880b9-c5ea-4946-8f88-8f7dea15a94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:18.008332 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9880b9-c5ea-4946-8f88-8f7dea15a94d admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:18.009117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9880b9-c5ea-4946-8f88-8f7dea15a94d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:18.011017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9880b9-c5ea-4946-8f88-8f7dea15a94d admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:18.086583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1169/2359] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:06:17 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:06:18.090735 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d17488-19bc-43be-bc2c-097d81be9bef admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:18.155762 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d17488-19bc-43be-bc2c-097d81be9bef admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:18.160634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e25eeb-3992-454a-8cc1-13f1eb4e927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:18.161341 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e25eeb-3992-454a-8cc1-13f1eb4e927c admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:18.161635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e25eeb-3992-454a-8cc1-13f1eb4e927c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:18.161930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e25eeb-3992-454a-8cc1-13f1eb4e927c admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:18.162736 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e25eeb-3992-454a-8cc1-13f1eb4e927c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:18.164665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e25eeb-3992-454a-8cc1-13f1eb4e927c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:18.189059 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:18.196058 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1191/2360] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:06:17 2022] POST /identity/v3/users => generated 286 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:06:18.200095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9880b9-c5ea-4946-8f88-8f7dea15a94d admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:18.210547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9880b9-c5ea-4946-8f88-8f7dea15a94d admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:18.215280 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc12621-8b30-4819-9c90-0b4bd28e1c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:18.215943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc12621-8b30-4819-9c90-0b4bd28e1c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:18.216237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc12621-8b30-4819-9c90-0b4bd28e1c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:18.216514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc12621-8b30-4819-9c90-0b4bd28e1c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:18.217285 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc12621-8b30-4819-9c90-0b4bd28e1c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:18.218896 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc12621-8b30-4819-9c90-0b4bd28e1c45 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:18.228963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1192/2361] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:06:18.232744 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc12621-8b30-4819-9c90-0b4bd28e1c45 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:18.243596 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc12621-8b30-4819-9c90-0b4bd28e1c45 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:18.248647 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20577b5-88a4-4a12-89fe-fbaf5d4e318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:18.249368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20577b5-88a4-4a12-89fe-fbaf5d4e318b admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:18.249661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20577b5-88a4-4a12-89fe-fbaf5d4e318b admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:18.249974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20577b5-88a4-4a12-89fe-fbaf5d4e318b admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:18.250768 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20577b5-88a4-4a12-89fe-fbaf5d4e318b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:18.252606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20577b5-88a4-4a12-89fe-fbaf5d4e318b admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:18.265478 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1193/2362] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:06:18.269647 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20577b5-88a4-4a12-89fe-fbaf5d4e318b admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:18.279631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20577b5-88a4-4a12-89fe-fbaf5d4e318b admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:18.284378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d79ce1-4e7a-4c0f-934b-98c271b2e0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:18.285415 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d79ce1-4e7a-4c0f-934b-98c271b2e0ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:18.285701 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d79ce1-4e7a-4c0f-934b-98c271b2e0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:18.285980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d79ce1-4e7a-4c0f-934b-98c271b2e0ef admin admin] PATH_INFO: `/v3/projects/4ff6280dd30948d7bbe20b324aea2220/users/6b06ec61408148a5980c70241965ea29/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:18.301947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1170/2363] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:06:18 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:06:18.308315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d79ce1-4e7a-4c0f-934b-98c271b2e0ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff6280dd30948d7bbe20b324aea2220, user_id=6b06ec61408148a5980c70241965ea29, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:18.308315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d79ce1-4e7a-4c0f-934b-98c271b2e0ef admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:18.309398 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e25eeb-3992-454a-8cc1-13f1eb4e927c admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:18.320049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e25eeb-3992-454a-8cc1-13f1eb4e927c admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:18.324759 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cae13-64ee-4282-862e-28b8d5b7ac38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:18.325457 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cae13-64ee-4282-862e-28b8d5b7ac38 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:18.325748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cae13-64ee-4282-862e-28b8d5b7ac38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:18.326056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cae13-64ee-4282-862e-28b8d5b7ac38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:18.326781 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cae13-64ee-4282-862e-28b8d5b7ac38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:18.328384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cae13-64ee-4282-862e-28b8d5b7ac38 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:18.338677 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1171/2364] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:06:18.343252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cae13-64ee-4282-862e-28b8d5b7ac38 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:18.353580 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cae13-64ee-4282-862e-28b8d5b7ac38 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:18.358861 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c115d0-e9c4-49f3-804a-2e1665c08022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:18.359849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c115d0-e9c4-49f3-804a-2e1665c08022 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:18.360152 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c115d0-e9c4-49f3-804a-2e1665c08022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:18.360463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c115d0-e9c4-49f3-804a-2e1665c08022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:18.361229 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c115d0-e9c4-49f3-804a-2e1665c08022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:18.362959 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c115d0-e9c4-49f3-804a-2e1665c08022 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:18.377364 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1172/2365] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:06:18.381710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c115d0-e9c4-49f3-804a-2e1665c08022 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:18.391593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c115d0-e9c4-49f3-804a-2e1665c08022 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:18.397090 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50bb98-a6c6-4065-8fd4-97e050af98d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:18.398032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50bb98-a6c6-4065-8fd4-97e050af98d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:18.398285 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50bb98-a6c6-4065-8fd4-97e050af98d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:18.398564 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50bb98-a6c6-4065-8fd4-97e050af98d9 admin admin] PATH_INFO: `/v3/projects/6b74442ed8154a0a82018680e60093b4/users/5fb8116d94f640b28d28c6a3430a215b/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:18.411113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1194/2366] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:06:18 2022] PUT /identity/v3/projects/4ff6280dd30948d7bbe20b324aea2220/users/6b06ec61408148a5980c70241965ea29/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:06:18.413842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50bb98-a6c6-4065-8fd4-97e050af98d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b74442ed8154a0a82018680e60093b4, user_id=5fb8116d94f640b28d28c6a3430a215b, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:18.416939 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50bb98-a6c6-4065-8fd4-97e050af98d9 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:18.420746 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88102498-fed1-4275-9177-09e209c4175d None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:18.421043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88102498-fed1-4275-9177-09e209c4175d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:18.421373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88102498-fed1-4275-9177-09e209c4175d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:18.439140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-88102498-fed1-4275-9177-09e209c4175d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:18.442452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-88102498-fed1-4275-9177-09e209c4175d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:18.500679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1195/2367] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:06:18.502502 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1173/2368] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:06:18 2022] PUT /identity/v3/projects/6b74442ed8154a0a82018680e60093b4/users/5fb8116d94f640b28d28c6a3430a215b/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:06:18.513895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf94bfc-95d1-4c0b-84f1-eefbb106d761 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:18.514100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50bb98-a6c6-4065-8fd4-97e050af98d9 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:18.514230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf94bfc-95d1-4c0b-84f1-eefbb106d761 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:18.514457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf94bfc-95d1-4c0b-84f1-eefbb106d761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:18.515914 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-6b50bb98-a6c6-4065-8fd4-97e050af98d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:18.541276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-0cf94bfc-95d1-4c0b-84f1-eefbb106d761 None None] MFA Rules not processed for user `5fb8116d94f640b28d28c6a3430a215b`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:18.542509 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0cf94bfc-95d1-4c0b-84f1-eefbb106d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:18.574476 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50bb98-a6c6-4065-8fd4-97e050af98d9 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:18.578242 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8087ad4-d403-41f7-9c57-125c9e297091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:18.578897 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8087ad4-d403-41f7-9c57-125c9e297091 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:18.579179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8087ad4-d403-41f7-9c57-125c9e297091 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:18.579461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8087ad4-d403-41f7-9c57-125c9e297091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:18.610507 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1196/2369] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:06:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:18.624043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf94bfc-95d1-4c0b-84f1-eefbb106d761 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:18.629428 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0cf94bfc-95d1-4c0b-84f1-eefbb106d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:18.650638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8087ad4-d403-41f7-9c57-125c9e297091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:18.652159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8087ad4-d403-41f7-9c57-125c9e297091 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:18.662773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1174/2370] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:06:18.683270 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf94bfc-95d1-4c0b-84f1-eefbb106d761 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:18.685045 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:18.690800 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101c382-1d49-42eb-8504-5d1207a57a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:18.694918 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101c382-1d49-42eb-8504-5d1207a57a02 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:18.694918 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101c382-1d49-42eb-8504-5d1207a57a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:18.694918 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101c382-1d49-42eb-8504-5d1207a57a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:18.700948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101c382-1d49-42eb-8504-5d1207a57a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:18.702412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101c382-1d49-42eb-8504-5d1207a57a02 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:18.711569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1197/2371] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:06:20.427688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:21.232574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:22.372805 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:22.873141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:24.296144 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:25.530974 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f40b4e-08ad-4381-b483-5cdf39671a8f None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:25.531458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f40b4e-08ad-4381-b483-5cdf39671a8f None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:25.531547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f40b4e-08ad-4381-b483-5cdf39671a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:25.559491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-53f40b4e-08ad-4381-b483-5cdf39671a8f None None] MFA Rules not processed for user `6b06ec61408148a5980c70241965ea29`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:25.560714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-53f40b4e-08ad-4381-b483-5cdf39671a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:25.633286 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1175/2372] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:06:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:25.637791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101c382-1d49-42eb-8504-5d1207a57a02 service cinder] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:25.649333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101c382-1d49-42eb-8504-5d1207a57a02 service cinder] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:25.654004 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f5877-fc43-4c37-9c2a-a623241a878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:25.654652 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f5877-fc43-4c37-9c2a-a623241a878e admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:25.654970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f5877-fc43-4c37-9c2a-a623241a878e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:25.655217 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f5877-fc43-4c37-9c2a-a623241a878e admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:25.656035 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f5877-fc43-4c37-9c2a-a623241a878e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:25.657986 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f5877-fc43-4c37-9c2a-a623241a878e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:25.768344 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1198/2373] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:06:25 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:06:25.772390 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f40b4e-08ad-4381-b483-5cdf39671a8f None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:25.780867 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:25.786070 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f40b4e-08ad-4381-b483-5cdf39671a8f None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:25.847414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d7f32-1b6b-4f34-9884-a9cc27b03a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:25.849646 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d7f32-1b6b-4f34-9884-a9cc27b03a45 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:25.850051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d7f32-1b6b-4f34-9884-a9cc27b03a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:25.850458 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d7f32-1b6b-4f34-9884-a9cc27b03a45 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:25.851201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d7f32-1b6b-4f34-9884-a9cc27b03a45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:25.853107 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d7f32-1b6b-4f34-9884-a9cc27b03a45 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:26.023483 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1176/2374] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:06:25 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:06:26.023606 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f5877-fc43-4c37-9c2a-a623241a878e admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:26.041724 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f5877-fc43-4c37-9c2a-a623241a878e admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:26.048836 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb1f7f-c64d-4802-a4ed-95f08d35fbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:26.050220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb1f7f-c64d-4802-a4ed-95f08d35fbab admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:26.050891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb1f7f-c64d-4802-a4ed-95f08d35fbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:26.051535 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb1f7f-c64d-4802-a4ed-95f08d35fbab admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:26.053207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb1f7f-c64d-4802-a4ed-95f08d35fbab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:26.059528 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb1f7f-c64d-4802-a4ed-95f08d35fbab admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:26.066962 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1199/2375] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:06:26.071694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d7f32-1b6b-4f34-9884-a9cc27b03a45 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:26.084436 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d7f32-1b6b-4f34-9884-a9cc27b03a45 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:26.091236 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ea98e-e4ec-44fd-afde-15be5f440853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:26.091236 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ea98e-e4ec-44fd-afde-15be5f440853 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:26.091935 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ea98e-e4ec-44fd-afde-15be5f440853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:26.091935 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ea98e-e4ec-44fd-afde-15be5f440853 admin admin] PATH_INFO: `/v3/projects/6117241ac90e41989bcd261bdb33f078/users/528abb9df2cb401abbd9fa372a1d3d2c/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:26.112093 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ea98e-e4ec-44fd-afde-15be5f440853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6117241ac90e41989bcd261bdb33f078, user_id=528abb9df2cb401abbd9fa372a1d3d2c, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:26.115049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ea98e-e4ec-44fd-afde-15be5f440853 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:26.147541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:26.208619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1177/2376] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:06:26 2022] PUT /identity/v3/projects/6117241ac90e41989bcd261bdb33f078/users/528abb9df2cb401abbd9fa372a1d3d2c/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:26.214070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb1f7f-c64d-4802-a4ed-95f08d35fbab admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:26.225448 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb1f7f-c64d-4802-a4ed-95f08d35fbab admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:26.297376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90588e-3d30-4c9f-a70c-97ea02c2f8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:26.297376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90588e-3d30-4c9f-a70c-97ea02c2f8ed admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:26.297376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90588e-3d30-4c9f-a70c-97ea02c2f8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:26.297376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90588e-3d30-4c9f-a70c-97ea02c2f8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:26.297758 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90588e-3d30-4c9f-a70c-97ea02c2f8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:26.299245 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90588e-3d30-4c9f-a70c-97ea02c2f8ed admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:26.313980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1200/2377] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:06:26.315180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ea98e-e4ec-44fd-afde-15be5f440853 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:26.333975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ea98e-e4ec-44fd-afde-15be5f440853 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:26.339512 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180d007-742a-494a-8f5c-095a6b53e4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:26.340920 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180d007-742a-494a-8f5c-095a6b53e4c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:26.341471 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180d007-742a-494a-8f5c-095a6b53e4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:26.341941 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180d007-742a-494a-8f5c-095a6b53e4c2 admin admin] PATH_INFO: `/v3/projects/6117241ac90e41989bcd261bdb33f078/users/528abb9df2cb401abbd9fa372a1d3d2c/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:26.344656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180d007-742a-494a-8f5c-095a6b53e4c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6117241ac90e41989bcd261bdb33f078, user_id=528abb9df2cb401abbd9fa372a1d3d2c, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:26.347808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180d007-742a-494a-8f5c-095a6b53e4c2 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:26.362107 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1178/2378] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:06:26 2022] PUT /identity/v3/projects/6117241ac90e41989bcd261bdb33f078/users/528abb9df2cb401abbd9fa372a1d3d2c/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:28.467627 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:28.940336 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:31.096420 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:31.798078 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:33.241908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ed27e-6244-4609-9ed6-b4c68e4f7427 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:33.242495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ed27e-6244-4609-9ed6-b4c68e4f7427 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:33.242495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ed27e-6244-4609-9ed6-b4c68e4f7427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:33.271851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-426ed27e-6244-4609-9ed6-b4c68e4f7427 None None] MFA Rules not processed for user `528abb9df2cb401abbd9fa372a1d3d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:33.273160 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-426ed27e-6244-4609-9ed6-b4c68e4f7427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:33.365085 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1201/2379] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:06:33.384941 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180d007-742a-494a-8f5c-095a6b53e4c2 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:33.385655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-8180d007-742a-494a-8f5c-095a6b53e4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:33.498561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180d007-742a-494a-8f5c-095a6b53e4c2 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:33.504976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf25aa1-aef2-48ef-980f-09047b5fbe2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:33.507323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf25aa1-aef2-48ef-980f-09047b5fbe2a service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:33.507323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf25aa1-aef2-48ef-980f-09047b5fbe2a service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:33.507323 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf25aa1-aef2-48ef-980f-09047b5fbe2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:33.570068 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ed27e-6244-4609-9ed6-b4c68e4f7427 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:33.581701 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf25aa1-aef2-48ef-980f-09047b5fbe2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:33.584648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf25aa1-aef2-48ef-980f-09047b5fbe2a service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:33.596559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1179/2380] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:33.641906 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ed27e-6244-4609-9ed6-b4c68e4f7427 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:33.647341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27480425-403a-4348-947e-97b58b22825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:33.648239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27480425-403a-4348-947e-97b58b22825c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:33.648528 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27480425-403a-4348-947e-97b58b22825c admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:33.648872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27480425-403a-4348-947e-97b58b22825c admin admin] PATH_INFO: `/v3/users/5fb8116d94f640b28d28c6a3430a215b` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:33.650168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27480425-403a-4348-947e-97b58b22825c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb8116d94f640b28d28c6a3430a215b)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:33.652124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27480425-403a-4348-947e-97b58b22825c admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:33.849052 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d255427-a617-47fa-a4b1-eb3f79fee4ef None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:33.849475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d255427-a617-47fa-a4b1-eb3f79fee4ef None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:33.849836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d255427-a617-47fa-a4b1-eb3f79fee4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:33.868803 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-4d255427-a617-47fa-a4b1-eb3f79fee4ef None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:33.870067 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4d255427-a617-47fa-a4b1-eb3f79fee4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:33.878100 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1180/2381] 10.222.0.79 () {58 vars in 1016 bytes} [Thu Jun 16 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:06:33.907316 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d255427-a617-47fa-a4b1-eb3f79fee4ef None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:33.908691 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4d255427-a617-47fa-a4b1-eb3f79fee4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:33.926592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d255427-a617-47fa-a4b1-eb3f79fee4ef None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:33.933018 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6117d-472d-44d3-9bc3-1e5ab6581aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:33.933698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6117d-472d-44d3-9bc3-1e5ab6581aa4 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:33.933982 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6117d-472d-44d3-9bc3-1e5ab6581aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:33.936737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6117d-472d-44d3-9bc3-1e5ab6581aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:33.939439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-27480425-403a-4348-947e-97b58b22825c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb8116d94f640b28d28c6a3430a215b'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:33.946649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-27480425-403a-4348-947e-97b58b22825c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb8116d94f640b28d28c6a3430a215b'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:33.947355 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-27480425-403a-4348-947e-97b58b22825c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb8116d94f640b28d28c6a3430a215b'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:33.947604 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6117d-472d-44d3-9bc3-1e5ab6581aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:33.950252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6117d-472d-44d3-9bc3-1e5ab6581aa4 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:33.960286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-27480425-403a-4348-947e-97b58b22825c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb8116d94f640b28d28c6a3430a215b'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:33.961340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-27480425-403a-4348-947e-97b58b22825c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb8116d94f640b28d28c6a3430a215b'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:33.964713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1181/2382] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:06:34.057767 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1202/2383] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:06:33 2022] DELETE /identity/v3/users/5fb8116d94f640b28d28c6a3430a215b => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:34.063121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa5af5-62ec-43bf-bf54-9df0141e8dc6 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:34.063121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa5af5-62ec-43bf-bf54-9df0141e8dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:34.063121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa5af5-62ec-43bf-bf54-9df0141e8dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:34.082711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-abaa5af5-62ec-43bf-bf54-9df0141e8dc6 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:34.084259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-abaa5af5-62ec-43bf-bf54-9df0141e8dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:34.161692 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1182/2384] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:34.171325 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27480425-403a-4348-947e-97b58b22825c admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:34.172769 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-27480425-403a-4348-947e-97b58b22825c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:34.232552 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27480425-403a-4348-947e-97b58b22825c admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:34.236680 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac26b7-d217-4c23-ba5f-6b65775a7a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:34.237453 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac26b7-d217-4c23-ba5f-6b65775a7a4d service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:34.237764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac26b7-d217-4c23-ba5f-6b65775a7a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:34.238043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac26b7-d217-4c23-ba5f-6b65775a7a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:34.248218 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac26b7-d217-4c23-ba5f-6b65775a7a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:34.249771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac26b7-d217-4c23-ba5f-6b65775a7a4d service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:34.260219 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1203/2385] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:34.662087 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:34.781015 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa5af5-62ec-43bf-bf54-9df0141e8dc6 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:34.784302 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-abaa5af5-62ec-43bf-bf54-9df0141e8dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:34.796734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa5af5-62ec-43bf-bf54-9df0141e8dc6 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:34.804234 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1623b-0322-41e7-b77f-f1cb01186fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:34.805179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1623b-0322-41e7-b77f-f1cb01186fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:34.805469 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1623b-0322-41e7-b77f-f1cb01186fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:34.805756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1623b-0322-41e7-b77f-f1cb01186fae admin admin] PATH_INFO: `/v3/projects/6b74442ed8154a0a82018680e60093b4` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:34.807097 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1623b-0322-41e7-b77f-f1cb01186fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b74442ed8154a0a82018680e60093b4)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:34.813973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1623b-0322-41e7-b77f-f1cb01186fae admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:34.954522 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-98a1623b-0322-41e7-b77f-f1cb01186fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b74442ed8154a0a82018680e60093b4', 'request_id': 'req-98a1623b-0322-41e7-b77f-f1cb01186fae'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:34.964758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-98a1623b-0322-41e7-b77f-f1cb01186fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b74442ed8154a0a82018680e60093b4', 'request_id': 'req-98a1623b-0322-41e7-b77f-f1cb01186fae'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:34.971269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:34.977249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-98a1623b-0322-41e7-b77f-f1cb01186fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b74442ed8154a0a82018680e60093b4', 'request_id': 'req-98a1623b-0322-41e7-b77f-f1cb01186fae'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:35.058513 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-98a1623b-0322-41e7-b77f-f1cb01186fae admin admin] The token cache is being invalidate because project 6b74442ed8154a0a82018680e60093b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:06:35.058816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-98a1623b-0322-41e7-b77f-f1cb01186fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:35.059525 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-98a1623b-0322-41e7-b77f-f1cb01186fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:06:35.061400 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1183/2386] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:06:34 2022] DELETE /identity/v3/projects/6b74442ed8154a0a82018680e60093b4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:06:37.039684 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:38.050432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325165af-009c-4e09-ba20-17ceb04c9834 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:38.050963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325165af-009c-4e09-ba20-17ceb04c9834 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:38.050963 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325165af-009c-4e09-ba20-17ceb04c9834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:38.068900 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-325165af-009c-4e09-ba20-17ceb04c9834 None None] MFA Rules not processed for user `6b06ec61408148a5980c70241965ea29`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:38.070168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-325165af-009c-4e09-ba20-17ceb04c9834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:38.128578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1204/2387] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:38.388455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:39.231688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9441fa7-fa9e-4147-bc9c-a37e0a8ba660 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:39.232358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9441fa7-fa9e-4147-bc9c-a37e0a8ba660 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:39.232358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9441fa7-fa9e-4147-bc9c-a37e0a8ba660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:39.252833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-b9441fa7-fa9e-4147-bc9c-a37e0a8ba660 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:39.254888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b9441fa7-fa9e-4147-bc9c-a37e0a8ba660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:39.319077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1184/2388] 10.222.0.79 () {58 vars in 1016 bytes} [Thu Jun 16 15:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:39.345705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325165af-009c-4e09-ba20-17ceb04c9834 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:39.348117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-325165af-009c-4e09-ba20-17ceb04c9834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:39.453338 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325165af-009c-4e09-ba20-17ceb04c9834 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:39.459341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88c76c-a138-4e8d-8630-ed3301219e93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:39.460003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88c76c-a138-4e8d-8630-ed3301219e93 service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:39.460318 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88c76c-a138-4e8d-8630-ed3301219e93 service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:39.460601 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88c76c-a138-4e8d-8630-ed3301219e93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:39.469688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88c76c-a138-4e8d-8630-ed3301219e93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:39.471292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88c76c-a138-4e8d-8630-ed3301219e93 service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:39.493445 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1205/2389] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:40.325195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:40.986945 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:41.536791 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:42.323435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:42.548007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:43.100945 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:43.679675 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:44.324257 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:44.856164 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359b62d-311f-4b41-bc28-bbc882b993a2 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:44.856689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359b62d-311f-4b41-bc28-bbc882b993a2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:44.856689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359b62d-311f-4b41-bc28-bbc882b993a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:44.876113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-d359b62d-311f-4b41-bc28-bbc882b993a2 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:44.877376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d359b62d-311f-4b41-bc28-bbc882b993a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:44.886696 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1185/2390] 10.222.0.79 () {58 vars in 1016 bytes} [Thu Jun 16 15:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:44.916182 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88c76c-a138-4e8d-8630-ed3301219e93 service nova] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:44.917662 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ed88c76c-a138-4e8d-8630-ed3301219e93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:44.932514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88c76c-a138-4e8d-8630-ed3301219e93 service nova] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:44.938219 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865467a-9b01-4ebe-afbf-c8e52c2ad0f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:44.938865 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865467a-9b01-4ebe-afbf-c8e52c2ad0f4 service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:44.939188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865467a-9b01-4ebe-afbf-c8e52c2ad0f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:44.939444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865467a-9b01-4ebe-afbf-c8e52c2ad0f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:44.951373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865467a-9b01-4ebe-afbf-c8e52c2ad0f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:44.953405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865467a-9b01-4ebe-afbf-c8e52c2ad0f4 service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:44.970011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1206/2391] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:45.462264 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:45.496791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:45.965260 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:46.302615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:INSERT=7,keystone:SELECT=86,keystone:DELETE=7 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:47.102299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:47.443762 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:48.009567 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:48.100371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:48.752321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:49.084411 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:49.348740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:49.393702 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:49.491248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:49.512723 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:49.591863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:49.634135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:49.778011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bad852-4be2-47a1-a93b-177395042cb4 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:49.778956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bad852-4be2-47a1-a93b-177395042cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:49.778956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bad852-4be2-47a1-a93b-177395042cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:49.812176 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-69bad852-4be2-47a1-a93b-177395042cb4 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:49.812176 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-69bad852-4be2-47a1-a93b-177395042cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:49.818643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1186/2392] 10.222.0.79 () {58 vars in 1016 bytes} [Thu Jun 16 15:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:49.846912 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865467a-9b01-4ebe-afbf-c8e52c2ad0f4 service nova] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:49.859809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865467a-9b01-4ebe-afbf-c8e52c2ad0f4 service nova] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:49.867058 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbaee9f-f650-4290-b167-1eefe423069e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:49.867712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbaee9f-f650-4290-b167-1eefe423069e service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:49.867998 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbaee9f-f650-4290-b167-1eefe423069e service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:49.868275 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbaee9f-f650-4290-b167-1eefe423069e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:49.877474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbaee9f-f650-4290-b167-1eefe423069e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:49.886591 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbaee9f-f650-4290-b167-1eefe423069e service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:49.891240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1207/2393] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:49.947960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:50.011132 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:50.074133 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:50.171463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:50.263332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:50.732034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:50.771153 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:50.912417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:51.003429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:51.045497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:51.182242 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:51.211297 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:DELETE=12,keystone:SELECT=84,keystone:INSERT=4 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:51.696841 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:51.856979 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:52.077880 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:52.220895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:52.255561 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:52.359779 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:52.685683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:53.003446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:53.075497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:53.399986 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:53.432336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:53.458347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:53.823280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:53.851680 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:54.296928 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:54.325522 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:54.575155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:54.603544 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:54.718081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:54.741056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:54.769623 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:54.994115 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:55.046600 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:55.084849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027156fe-b564-4a38-8b96-ea8c89dfc8dd None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:55.085278 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027156fe-b564-4a38-8b96-ea8c89dfc8dd None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:55.085927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027156fe-b564-4a38-8b96-ea8c89dfc8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:55.104795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-027156fe-b564-4a38-8b96-ea8c89dfc8dd None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:55.106550 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-027156fe-b564-4a38-8b96-ea8c89dfc8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:55.116299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1187/2394] 10.222.0.79 () {58 vars in 1016 bytes} [Thu Jun 16 15:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:55.152917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbaee9f-f650-4290-b167-1eefe423069e service nova] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:55.168869 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbaee9f-f650-4290-b167-1eefe423069e service nova] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:55.174439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114da982-6d29-4d2f-91de-5ea1ceaf95b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:55.175096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114da982-6d29-4d2f-91de-5ea1ceaf95b7 service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:55.175412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114da982-6d29-4d2f-91de-5ea1ceaf95b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:55.175670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114da982-6d29-4d2f-91de-5ea1ceaf95b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:55.184442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114da982-6d29-4d2f-91de-5ea1ceaf95b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:55.186217 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114da982-6d29-4d2f-91de-5ea1ceaf95b7 service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:55.196129 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1208/2395] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:06:55.216441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:55.342574 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:55.502358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:55.529227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:55.662733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:55.708624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:55.868746 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:56.032463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:56.131506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:56.222172 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:56.386441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=100 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:56.435859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:56.570353 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:56.656843 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:56.754535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:56.845350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:57.068735 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:59.430651 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad79a16-5c76-43f7-9ca2-c3c6754efc36 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:59.432121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad79a16-5c76-43f7-9ca2-c3c6754efc36 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:59.432712 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad79a16-5c76-43f7-9ca2-c3c6754efc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:59.465006 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-3ad79a16-5c76-43f7-9ca2-c3c6754efc36 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:06:59.466407 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3ad79a16-5c76-43f7-9ca2-c3c6754efc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:06:59.474682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1188/2396] 10.222.0.79 () {58 vars in 1016 bytes} [Thu Jun 16 15:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:06:59.501985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114da982-6d29-4d2f-91de-5ea1ceaf95b7 service nova] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:06:59.515273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114da982-6d29-4d2f-91de-5ea1ceaf95b7 service nova] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:06:59.521057 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218504ed-201e-40b4-9c16-c25c1605bbe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:06:59.521872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218504ed-201e-40b4-9c16-c25c1605bbe8 service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:06:59.522166 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218504ed-201e-40b4-9c16-c25c1605bbe8 service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:06:59.522455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218504ed-201e-40b4-9c16-c25c1605bbe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:06:59.531808 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218504ed-201e-40b4-9c16-c25c1605bbe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:06:59.533540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218504ed-201e-40b4-9c16-c25c1605bbe8 service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:06:59.543901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1209/2397] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:02.346704 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad79a16-5c76-43f7-9ca2-c3c6754efc36 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:02.348089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3ad79a16-5c76-43f7-9ca2-c3c6754efc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:02.418123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad79a16-5c76-43f7-9ca2-c3c6754efc36 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:02.423434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ae156-e0a8-485a-ad75-1de3150914b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534035b2e8cf4f769e3dbbaabc0f6ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:02.424197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ae156-e0a8-485a-ad75-1de3150914b1 service placement] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:02.424528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ae156-e0a8-485a-ad75-1de3150914b1 service placement] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:02.424854 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ae156-e0a8-485a-ad75-1de3150914b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:02.427092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-da5ae156-e0a8-485a-ad75-1de3150914b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:02.440142 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ae156-e0a8-485a-ad75-1de3150914b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:02.441916 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ae156-e0a8-485a-ad75-1de3150914b1 service placement] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:02.453150 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1189/2398] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:09.539399 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=75 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:12.453086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=62 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:17.578149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42be48-2fda-4353-a0ef-559231d439db None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:17.578674 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42be48-2fda-4353-a0ef-559231d439db None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:17.578805 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42be48-2fda-4353-a0ef-559231d439db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:17.598392 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-5b42be48-2fda-4353-a0ef-559231d439db None None] MFA Rules not processed for user `0d3510e93cba44078ede0016f88d1032`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:17.599612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5b42be48-2fda-4353-a0ef-559231d439db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:17.691833 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1210/2399] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:07:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:23.022387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dffc63-e37b-4cb5-9ab0-b7e82530f600 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:23.023007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dffc63-e37b-4cb5-9ab0-b7e82530f600 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:23.023007 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dffc63-e37b-4cb5-9ab0-b7e82530f600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:23.043819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-43dffc63-e37b-4cb5-9ab0-b7e82530f600 None None] MFA Rules not processed for user `97a476fcf8104eb698196d20ce9e2e30`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:23.045171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-43dffc63-e37b-4cb5-9ab0-b7e82530f600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:23.106737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1190/2400] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:07:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:27.680405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=25 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:28.157316 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42be48-2fda-4353-a0ef-559231d439db None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:28.160253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5b42be48-2fda-4353-a0ef-559231d439db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:28.230104 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42be48-2fda-4353-a0ef-559231d439db None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:28.234736 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea7964-2e76-4bc6-b6a2-348b495a1f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:28.235747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea7964-2e76-4bc6-b6a2-348b495a1f18 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:28.236238 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea7964-2e76-4bc6-b6a2-348b495a1f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:28.236968 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea7964-2e76-4bc6-b6a2-348b495a1f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:28.239108 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-8bea7964-2e76-4bc6-b6a2-348b495a1f18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:28.336208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea7964-2e76-4bc6-b6a2-348b495a1f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:28.338399 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea7964-2e76-4bc6-b6a2-348b495a1f18 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:28.353498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1211/2401] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:33.098823 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=25 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:34.880006 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0d18e-3b20-4e47-8426-d6b7bfa26c01 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:34.880851 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0d18e-3b20-4e47-8426-d6b7bfa26c01 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:34.880851 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0d18e-3b20-4e47-8426-d6b7bfa26c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:34.898831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-99f0d18e-3b20-4e47-8426-d6b7bfa26c01 None None] MFA Rules not processed for user `538cc13998f14a3ba870184f18648526`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:34.900493 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-99f0d18e-3b20-4e47-8426-d6b7bfa26c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:34.958339 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1191/2402] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:38.347010 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=50 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:44.951502 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=25 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:48.444685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875c74f-e50c-4131-a037-ee21daaf3ba9 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:48.445376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875c74f-e50c-4131-a037-ee21daaf3ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:48.445376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875c74f-e50c-4131-a037-ee21daaf3ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:48.463343 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-2875c74f-e50c-4131-a037-ee21daaf3ba9 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:48.464548 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2875c74f-e50c-4131-a037-ee21daaf3ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:48.472360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1212/2403] 10.222.0.79 () {58 vars in 1016 bytes} [Thu Jun 16 15:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:48.513900 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0d18e-3b20-4e47-8426-d6b7bfa26c01 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:48.526791 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0d18e-3b20-4e47-8426-d6b7bfa26c01 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:48.532975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadda5d5-d0dc-43fb-b591-6b233d5c6653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:48.533680 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadda5d5-d0dc-43fb-b591-6b233d5c6653 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:48.533969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadda5d5-d0dc-43fb-b591-6b233d5c6653 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:48.534253 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadda5d5-d0dc-43fb-b591-6b233d5c6653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:48.543584 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadda5d5-d0dc-43fb-b591-6b233d5c6653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:48.546657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadda5d5-d0dc-43fb-b591-6b233d5c6653 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:48.555086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1192/2404] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:53.874187 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67b341-7fe1-4512-88b5-84eef254cf43 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:53.874778 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67b341-7fe1-4512-88b5-84eef254cf43 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:53.874778 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67b341-7fe1-4512-88b5-84eef254cf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:53.893522 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-5e67b341-7fe1-4512-88b5-84eef254cf43 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:53.897019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5e67b341-7fe1-4512-88b5-84eef254cf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:53.903460 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1213/2405] 10.222.0.79 () {58 vars in 1016 bytes} [Thu Jun 16 15:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:53.924622 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadda5d5-d0dc-43fb-b591-6b233d5c6653 service nova] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:53.936030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadda5d5-d0dc-43fb-b591-6b233d5c6653 service nova] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:53.941849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2a6dd-1e94-4d6d-8eba-84963cd3d7db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:53.942505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2a6dd-1e94-4d6d-8eba-84963cd3d7db service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:53.942795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2a6dd-1e94-4d6d-8eba-84963cd3d7db service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:53.943076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2a6dd-1e94-4d6d-8eba-84963cd3d7db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:53.952501 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2a6dd-1e94-4d6d-8eba-84963cd3d7db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:53.954188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2a6dd-1e94-4d6d-8eba-84963cd3d7db service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:53.966010 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1193/2406] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:07:57.741349 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446a6b6-14ef-4599-868c-49e3343e0152 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:57.741900 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446a6b6-14ef-4599-868c-49e3343e0152 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:57.741900 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446a6b6-14ef-4599-868c-49e3343e0152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:57.761477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-9446a6b6-14ef-4599-868c-49e3343e0152 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:07:57.763038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9446a6b6-14ef-4599-868c-49e3343e0152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:07:57.771848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1214/2407] 10.222.0.79 () {58 vars in 1016 bytes} [Thu Jun 16 15:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:07:57.813166 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2a6dd-1e94-4d6d-8eba-84963cd3d7db service nova] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:07:57.825609 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2a6dd-1e94-4d6d-8eba-84963cd3d7db service nova] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:07:57.831555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb0fff-35da-4f5d-be37-34a0d84c97f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:07:57.833413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb0fff-35da-4f5d-be37-34a0d84c97f8 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:07:57.833413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb0fff-35da-4f5d-be37-34a0d84c97f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:07:57.833413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb0fff-35da-4f5d-be37-34a0d84c97f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:07:57.842739 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb0fff-35da-4f5d-be37-34a0d84c97f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:07:57.844337 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb0fff-35da-4f5d-be37-34a0d84c97f8 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:07:57.854421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1194/2408] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:02.062408 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410e241-63a2-48c3-865e-dd1b179fb79c None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:02.063139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410e241-63a2-48c3-865e-dd1b179fb79c None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:02.063139 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410e241-63a2-48c3-865e-dd1b179fb79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:02.083726 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-c410e241-63a2-48c3-865e-dd1b179fb79c None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:02.085347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c410e241-63a2-48c3-865e-dd1b179fb79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:02.094233 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1215/2409] 10.222.0.79 () {58 vars in 1016 bytes} [Thu Jun 16 15:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:02.128380 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb0fff-35da-4f5d-be37-34a0d84c97f8 service nova] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:02.141350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb0fff-35da-4f5d-be37-34a0d84c97f8 service nova] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:02.147283 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97086de-1082-4b2f-8ce8-6df6dcb58bff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:02.147986 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97086de-1082-4b2f-8ce8-6df6dcb58bff service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:02.148282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97086de-1082-4b2f-8ce8-6df6dcb58bff service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:02.148575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97086de-1082-4b2f-8ce8-6df6dcb58bff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:02.162079 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97086de-1082-4b2f-8ce8-6df6dcb58bff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:02.164240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97086de-1082-4b2f-8ce8-6df6dcb58bff service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:02.177359 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1195/2410] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:09.551777 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c48d5a-5893-4c65-9ebf-c4f2ee55b743 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:09.552367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c48d5a-5893-4c65-9ebf-c4f2ee55b743 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:09.552367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c48d5a-5893-4c65-9ebf-c4f2ee55b743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:09.559480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=13 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:09.571572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-05c48d5a-5893-4c65-9ebf-c4f2ee55b743 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:09.572851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-05c48d5a-5893-4c65-9ebf-c4f2ee55b743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:09.580786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1216/2411] 10.222.0.79 () {58 vars in 1016 bytes} [Thu Jun 16 15:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:09.602733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97086de-1082-4b2f-8ce8-6df6dcb58bff service nova] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:09.615208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97086de-1082-4b2f-8ce8-6df6dcb58bff service nova] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:09.621151 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33b884-65aa-46a9-ad07-fcabcd9f0ea8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:09.621836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33b884-65aa-46a9-ad07-fcabcd9f0ea8 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:09.622153 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33b884-65aa-46a9-ad07-fcabcd9f0ea8 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:09.622462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33b884-65aa-46a9-ad07-fcabcd9f0ea8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:09.631647 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33b884-65aa-46a9-ad07-fcabcd9f0ea8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:09.633299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33b884-65aa-46a9-ad07-fcabcd9f0ea8 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:09.643699 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1196/2412] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:12.969439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacbb48-3866-4924-bd99-f5cb3756b155 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:12.970163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacbb48-3866-4924-bd99-f5cb3756b155 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:12.970163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacbb48-3866-4924-bd99-f5cb3756b155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:12.990860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-8bacbb48-3866-4924-bd99-f5cb3756b155 None None] MFA Rules not processed for user `f6683ab715b3452a8a79b89be6b3bfce`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:12.992146 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-8bacbb48-3866-4924-bd99-f5cb3756b155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:13.050569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1217/2413] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:08:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:08:19.638916 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=30 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:21.022003 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33b884-65aa-46a9-ad07-fcabcd9f0ea8 service nova] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:21.024442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-bf33b884-65aa-46a9-ad07-fcabcd9f0ea8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:21.047776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33b884-65aa-46a9-ad07-fcabcd9f0ea8 service nova] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:21.059621 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e70cac-2ac0-4a82-ac87-621a9447ed2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:21.060380 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e70cac-2ac0-4a82-ac87-621a9447ed2d service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:21.060741 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e70cac-2ac0-4a82-ac87-621a9447ed2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:21.061097 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e70cac-2ac0-4a82-ac87-621a9447ed2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:21.063183 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-25e70cac-2ac0-4a82-ac87-621a9447ed2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:21.079132 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e70cac-2ac0-4a82-ac87-621a9447ed2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:21.080831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e70cac-2ac0-4a82-ac87-621a9447ed2d service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:21.094180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1197/2414] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:23.043633 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=27 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:23.263056 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacbb48-3866-4924-bd99-f5cb3756b155 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:23.272683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacbb48-3866-4924-bd99-f5cb3756b155 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:23.276551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34b9ee-ad33-4adb-a398-e8e3b2c092f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:23.277242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34b9ee-ad33-4adb-a398-e8e3b2c092f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:23.277534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34b9ee-ad33-4adb-a398-e8e3b2c092f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:23.277818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34b9ee-ad33-4adb-a398-e8e3b2c092f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:23.279798 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-cc34b9ee-ad33-4adb-a398-e8e3b2c092f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:23.293974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34b9ee-ad33-4adb-a398-e8e3b2c092f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:23.295559 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34b9ee-ad33-4adb-a398-e8e3b2c092f1 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:23.309346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1218/2415] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:31.088144 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=6 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:32.204551 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e70cac-2ac0-4a82-ac87-621a9447ed2d service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:32.216472 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e70cac-2ac0-4a82-ac87-621a9447ed2d service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:32.222037 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299e0aa-e85a-4c33-84e6-421da4cd02b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:32.222690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299e0aa-e85a-4c33-84e6-421da4cd02b8 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:32.222977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299e0aa-e85a-4c33-84e6-421da4cd02b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:32.223258 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299e0aa-e85a-4c33-84e6-421da4cd02b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:32.225051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-8299e0aa-e85a-4c33-84e6-421da4cd02b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:32.236200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299e0aa-e85a-4c33-84e6-421da4cd02b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:32.242678 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299e0aa-e85a-4c33-84e6-421da4cd02b8 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:32.248328 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1198/2416] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:33.302141 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=6 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:40.535848 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34b9ee-ad33-4adb-a398-e8e3b2c092f1 service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:40.548838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34b9ee-ad33-4adb-a398-e8e3b2c092f1 service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:40.554854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520d905-75b4-4f26-8446-3fa1010a4fe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:40.555524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520d905-75b4-4f26-8446-3fa1010a4fe2 service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:40.555812 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520d905-75b4-4f26-8446-3fa1010a4fe2 service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:40.556097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520d905-75b4-4f26-8446-3fa1010a4fe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:40.557938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9520d905-75b4-4f26-8446-3fa1010a4fe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:40.568890 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520d905-75b4-4f26-8446-3fa1010a4fe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:40.570587 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520d905-75b4-4f26-8446-3fa1010a4fe2 service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:40.581039 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1219/2417] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:40.625588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299e0aa-e85a-4c33-84e6-421da4cd02b8 service nova] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:40.639356 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299e0aa-e85a-4c33-84e6-421da4cd02b8 service nova] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:40.644290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c15baf-a22b-438d-9949-522f0bbd74e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:40.644958 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c15baf-a22b-438d-9949-522f0bbd74e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:40.645282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c15baf-a22b-438d-9949-522f0bbd74e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:40.645573 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c15baf-a22b-438d-9949-522f0bbd74e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:40.647529 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-31c15baf-a22b-438d-9949-522f0bbd74e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:40.661600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c15baf-a22b-438d-9949-522f0bbd74e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:40.663362 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c15baf-a22b-438d-9949-522f0bbd74e1 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:40.674784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1199/2418] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:40.694062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520d905-75b4-4f26-8446-3fa1010a4fe2 service nova] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:40.695684 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9520d905-75b4-4f26-8446-3fa1010a4fe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:40.781681 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520d905-75b4-4f26-8446-3fa1010a4fe2 service nova] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:40.785788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4971082-6e0a-4de0-9ce3-a0f2ca4d34e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:40.786465 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4971082-6e0a-4de0-9ce3-a0f2ca4d34e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:40.786937 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4971082-6e0a-4de0-9ce3-a0f2ca4d34e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:40.787226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4971082-6e0a-4de0-9ce3-a0f2ca4d34e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:40.789115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-f4971082-6e0a-4de0-9ce3-a0f2ca4d34e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:40.803546 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4971082-6e0a-4de0-9ce3-a0f2ca4d34e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:40.805543 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4971082-6e0a-4de0-9ce3-a0f2ca4d34e6 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:40.819891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1220/2419] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:45.065489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c15baf-a22b-438d-9949-522f0bbd74e1 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:45.067032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-31c15baf-a22b-438d-9949-522f0bbd74e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:45.081865 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c15baf-a22b-438d-9949-522f0bbd74e1 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:45.086695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2072bf-f162-464f-9fea-d8756434100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:45.087713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2072bf-f162-464f-9fea-d8756434100e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:45.088003 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2072bf-f162-464f-9fea-d8756434100e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:45.088317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2072bf-f162-464f-9fea-d8756434100e admin admin] PATH_INFO: `/v3/users/0d3510e93cba44078ede0016f88d1032` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:45.089580 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2072bf-f162-464f-9fea-d8756434100e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3510e93cba44078ede0016f88d1032)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:45.092170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2072bf-f162-464f-9fea-d8756434100e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:45.424188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-8e2072bf-f162-464f-9fea-d8756434100e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3510e93cba44078ede0016f88d1032'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:45.424888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-8e2072bf-f162-464f-9fea-d8756434100e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3510e93cba44078ede0016f88d1032'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:45.432683 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-8e2072bf-f162-464f-9fea-d8756434100e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3510e93cba44078ede0016f88d1032'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:45.433453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-8e2072bf-f162-464f-9fea-d8756434100e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3510e93cba44078ede0016f88d1032'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:45.571562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-8e2072bf-f162-464f-9fea-d8756434100e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3510e93cba44078ede0016f88d1032'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:45.591681 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1200/2420] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:45 2022] DELETE /identity/v3/users/0d3510e93cba44078ede0016f88d1032 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:45.906419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4971082-6e0a-4de0-9ce3-a0f2ca4d34e6 service cinder] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:45.917930 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4971082-6e0a-4de0-9ce3-a0f2ca4d34e6 service cinder] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:45.982988 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbf5d5-6ab1-4dbb-a5b6-1fcade7b6ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:45.983903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbf5d5-6ab1-4dbb-a5b6-1fcade7b6ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:45.984192 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbf5d5-6ab1-4dbb-a5b6-1fcade7b6ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:45.984476 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbf5d5-6ab1-4dbb-a5b6-1fcade7b6ce5 admin admin] PATH_INFO: `/v3/projects/dcb5e5133cbb44c197ed2c06a578029f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:45.985725 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbf5d5-6ab1-4dbb-a5b6-1fcade7b6ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb5e5133cbb44c197ed2c06a578029f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:45.987663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbf5d5-6ab1-4dbb-a5b6-1fcade7b6ce5 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:46.179120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-8fdbf5d5-6ab1-4dbb-a5b6-1fcade7b6ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb5e5133cbb44c197ed2c06a578029f', 'request_id': 'req-8fdbf5d5-6ab1-4dbb-a5b6-1fcade7b6ce5'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:46.186193 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-8fdbf5d5-6ab1-4dbb-a5b6-1fcade7b6ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb5e5133cbb44c197ed2c06a578029f', 'request_id': 'req-8fdbf5d5-6ab1-4dbb-a5b6-1fcade7b6ce5'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:46.192011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-8fdbf5d5-6ab1-4dbb-a5b6-1fcade7b6ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb5e5133cbb44c197ed2c06a578029f', 'request_id': 'req-8fdbf5d5-6ab1-4dbb-a5b6-1fcade7b6ce5'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:46.291342 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-8fdbf5d5-6ab1-4dbb-a5b6-1fcade7b6ce5 admin admin] The token cache is being invalidate because project dcb5e5133cbb44c197ed2c06a578029f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:46.292307 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-8fdbf5d5-6ab1-4dbb-a5b6-1fcade7b6ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:46.295508 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-8fdbf5d5-6ab1-4dbb-a5b6-1fcade7b6ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:46.295508 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1221/2421] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:45 2022] DELETE /identity/v3/projects/dcb5e5133cbb44c197ed2c06a578029f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:46.300290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb2d7f-b41d-4aeb-bed7-72a74f710678 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:46.300775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb2d7f-b41d-4aeb-bed7-72a74f710678 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:46.300901 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb2d7f-b41d-4aeb-bed7-72a74f710678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:46.319588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-0deb2d7f-b41d-4aeb-bed7-72a74f710678 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:46.321452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-0deb2d7f-b41d-4aeb-bed7-72a74f710678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:46.383253 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1201/2422] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:46.391732 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d85de8-bac1-47be-b1f5-622ef076c54a None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:46.392058 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d85de8-bac1-47be-b1f5-622ef076c54a None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:46.392347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d85de8-bac1-47be-b1f5-622ef076c54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:46.411991 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-84d85de8-bac1-47be-b1f5-622ef076c54a None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:46.413258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-84d85de8-bac1-47be-b1f5-622ef076c54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:46.421311 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1222/2423] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:46.431555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb2d7f-b41d-4aeb-bed7-72a74f710678 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:46.442948 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb2d7f-b41d-4aeb-bed7-72a74f710678 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:46.450701 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e2250-177e-4644-ac74-a66d1e2abba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:46.451933 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e2250-177e-4644-ac74-a66d1e2abba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:46.452470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e2250-177e-4644-ac74-a66d1e2abba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:46.452958 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e2250-177e-4644-ac74-a66d1e2abba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:46.453907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e2250-177e-4644-ac74-a66d1e2abba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:08:46.454217 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e2250-177e-4644-ac74-a66d1e2abba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:46.455893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e2250-177e-4644-ac74-a66d1e2abba8 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:46.472435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1202/2424] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:08:46.475680 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d85de8-bac1-47be-b1f5-622ef076c54a None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:46.499424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d85de8-bac1-47be-b1f5-622ef076c54a None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:46.499424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cc95b-b6bf-4a82-ba57-e07815bcd2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:46.499424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cc95b-b6bf-4a82-ba57-e07815bcd2cd admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:46.499424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cc95b-b6bf-4a82-ba57-e07815bcd2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:46.500001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cc95b-b6bf-4a82-ba57-e07815bcd2cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:46.500001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cc95b-b6bf-4a82-ba57-e07815bcd2cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:46.500001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cc95b-b6bf-4a82-ba57-e07815bcd2cd admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:46.507617 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:46.614640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1223/2425] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:46 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:08:46.616136 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e2250-177e-4644-ac74-a66d1e2abba8 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:46.627509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e2250-177e-4644-ac74-a66d1e2abba8 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:46.660705 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:46.688297 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b950ce8-e319-4b3a-b692-c3cbcdbc60a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:46.688985 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b950ce8-e319-4b3a-b692-c3cbcdbc60a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:46.689311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b950ce8-e319-4b3a-b692-c3cbcdbc60a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:46.689594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b950ce8-e319-4b3a-b692-c3cbcdbc60a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:46.690294 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b950ce8-e319-4b3a-b692-c3cbcdbc60a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:46.692231 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b950ce8-e319-4b3a-b692-c3cbcdbc60a4 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:46.854451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1203/2426] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:46 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:46.861062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cc95b-b6bf-4a82-ba57-e07815bcd2cd admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:46.872495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cc95b-b6bf-4a82-ba57-e07815bcd2cd admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:46.877110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954627f-8107-4fec-b2d4-b6cd701a5902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:46.877802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954627f-8107-4fec-b2d4-b6cd701a5902 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:46.878100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954627f-8107-4fec-b2d4-b6cd701a5902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:46.878380 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954627f-8107-4fec-b2d4-b6cd701a5902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:46.879116 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954627f-8107-4fec-b2d4-b6cd701a5902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:46.880844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954627f-8107-4fec-b2d4-b6cd701a5902 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:46.894499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1224/2427] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:46.900781 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b950ce8-e319-4b3a-b692-c3cbcdbc60a4 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:46.911125 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b950ce8-e319-4b3a-b692-c3cbcdbc60a4 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:46.917525 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80489dc0-528a-46c4-89f4-5ce2bc55c547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:46.919205 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80489dc0-528a-46c4-89f4-5ce2bc55c547 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:46.919641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80489dc0-528a-46c4-89f4-5ce2bc55c547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:46.920054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80489dc0-528a-46c4-89f4-5ce2bc55c547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:46.921360 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80489dc0-528a-46c4-89f4-5ce2bc55c547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:46.924224 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80489dc0-528a-46c4-89f4-5ce2bc55c547 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:46.938555 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1204/2428] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:46.942989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954627f-8107-4fec-b2d4-b6cd701a5902 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:46.954989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954627f-8107-4fec-b2d4-b6cd701a5902 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:46.960505 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebca3b-7e50-495e-bfce-3e7c151638f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:46.961464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebca3b-7e50-495e-bfce-3e7c151638f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:46.961752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebca3b-7e50-495e-bfce-3e7c151638f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:46.962035 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebca3b-7e50-495e-bfce-3e7c151638f1 admin admin] PATH_INFO: `/v3/projects/0acc0b546a5e47fd9c072c46cdce690e/users/5de52e11ee064c20bf56071dbf84f03e/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:46.978200 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebca3b-7e50-495e-bfce-3e7c151638f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acc0b546a5e47fd9c072c46cdce690e, user_id=5de52e11ee064c20bf56071dbf84f03e, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:46.981477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebca3b-7e50-495e-bfce-3e7c151638f1 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:47.151528 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1225/2429] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:46 2022] PUT /identity/v3/projects/0acc0b546a5e47fd9c072c46cdce690e/users/5de52e11ee064c20bf56071dbf84f03e/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:47.156813 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6edcb-9683-48ea-8791-2468ce9e3746 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:47.157111 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6edcb-9683-48ea-8791-2468ce9e3746 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:47.171753 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6edcb-9683-48ea-8791-2468ce9e3746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:47.175335 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-d5e6edcb-9683-48ea-8791-2468ce9e3746 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:47.176553 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d5e6edcb-9683-48ea-8791-2468ce9e3746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:47.237741 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1205/2430] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:47.247867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebca3b-7e50-495e-bfce-3e7c151638f1 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:47.249633 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-37ebca3b-7e50-495e-bfce-3e7c151638f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:47.309713 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebca3b-7e50-495e-bfce-3e7c151638f1 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:47.313423 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7af9fc-a6fe-4f00-b5d8-c8297fdbfff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:47.314078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7af9fc-a6fe-4f00-b5d8-c8297fdbfff4 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:47.314370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7af9fc-a6fe-4f00-b5d8-c8297fdbfff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:47.314642 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7af9fc-a6fe-4f00-b5d8-c8297fdbfff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:47.324752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7af9fc-a6fe-4f00-b5d8-c8297fdbfff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:47.326244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7af9fc-a6fe-4f00-b5d8-c8297fdbfff4 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:47.338297 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1226/2431] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:54.764506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e27571-0c04-4b89-88ba-6d6cd2d32fd5 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:54.765086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e27571-0c04-4b89-88ba-6d6cd2d32fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:54.765086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e27571-0c04-4b89-88ba-6d6cd2d32fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:54.801084 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-a5e27571-0c04-4b89-88ba-6d6cd2d32fd5 None None] MFA Rules not processed for user `5de52e11ee064c20bf56071dbf84f03e`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:54.802643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a5e27571-0c04-4b89-88ba-6d6cd2d32fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:54.920806 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1206/2432] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:08:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:54.940828 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7af9fc-a6fe-4f00-b5d8-c8297fdbfff4 service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:54.943703 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2d7af9fc-a6fe-4f00-b5d8-c8297fdbfff4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:55.080100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7af9fc-a6fe-4f00-b5d8-c8297fdbfff4 service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:55.091664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb94d6-df1f-4689-9d93-4d48d2e55871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:55.091664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb94d6-df1f-4689-9d93-4d48d2e55871 service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:55.091664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb94d6-df1f-4689-9d93-4d48d2e55871 service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:55.091664 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb94d6-df1f-4689-9d93-4d48d2e55871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:55.100788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb94d6-df1f-4689-9d93-4d48d2e55871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:55.102837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb94d6-df1f-4689-9d93-4d48d2e55871 service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:55.113739 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1227/2433] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:55.798523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e27571-0c04-4b89-88ba-6d6cd2d32fd5 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:55.800117 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a5e27571-0c04-4b89-88ba-6d6cd2d32fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:55.815653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e27571-0c04-4b89-88ba-6d6cd2d32fd5 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:55.820882 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f23b17-d292-4635-87eb-1f14d3b9ec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:55.821880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f23b17-d292-4635-87eb-1f14d3b9ec4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:55.822163 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f23b17-d292-4635-87eb-1f14d3b9ec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:55.822626 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f23b17-d292-4635-87eb-1f14d3b9ec4a admin admin] PATH_INFO: `/v3/users/97a476fcf8104eb698196d20ce9e2e30` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:55.824129 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f23b17-d292-4635-87eb-1f14d3b9ec4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a476fcf8104eb698196d20ce9e2e30)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:55.826751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f23b17-d292-4635-87eb-1f14d3b9ec4a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:56.070510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:56.081105 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e3f23b17-d292-4635-87eb-1f14d3b9ec4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a476fcf8104eb698196d20ce9e2e30'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:56.082091 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e3f23b17-d292-4635-87eb-1f14d3b9ec4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a476fcf8104eb698196d20ce9e2e30'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:56.090606 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e3f23b17-d292-4635-87eb-1f14d3b9ec4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a476fcf8104eb698196d20ce9e2e30'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:56.091330 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e3f23b17-d292-4635-87eb-1f14d3b9ec4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a476fcf8104eb698196d20ce9e2e30'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:56.219659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e3f23b17-d292-4635-87eb-1f14d3b9ec4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a476fcf8104eb698196d20ce9e2e30'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:56.244032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1207/2434] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:08:55 2022] DELETE /identity/v3/users/97a476fcf8104eb698196d20ce9e2e30 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:56.503625 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779f271-a03d-4c8a-9f94-ea67c9594da4 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:56.504252 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779f271-a03d-4c8a-9f94-ea67c9594da4 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:56.504553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779f271-a03d-4c8a-9f94-ea67c9594da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:56.528586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-1779f271-a03d-4c8a-9f94-ea67c9594da4 None None] MFA Rules not processed for user `538cc13998f14a3ba870184f18648526`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:56.533154 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-1779f271-a03d-4c8a-9f94-ea67c9594da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:56.577102 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:56.595785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1228/2435] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:08:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:56.599206 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f23b17-d292-4635-87eb-1f14d3b9ec4a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:56.600716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e3f23b17-d292-4635-87eb-1f14d3b9ec4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:56.730894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f23b17-d292-4635-87eb-1f14d3b9ec4a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:56.736679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f69ab-55f2-46e1-a5c6-4d5987b431c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:56.737611 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f69ab-55f2-46e1-a5c6-4d5987b431c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:56.737943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f69ab-55f2-46e1-a5c6-4d5987b431c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:56.738348 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f69ab-55f2-46e1-a5c6-4d5987b431c6 admin admin] PATH_INFO: `/v3/projects/0ca953ddf1d649e5b124c86bdb1ab869` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:56.739968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f69ab-55f2-46e1-a5c6-4d5987b431c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca953ddf1d649e5b124c86bdb1ab869)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:56.742173 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f69ab-55f2-46e1-a5c6-4d5987b431c6 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:56.997554 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6b3f69ab-55f2-46e1-a5c6-4d5987b431c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca953ddf1d649e5b124c86bdb1ab869', 'request_id': 'req-6b3f69ab-55f2-46e1-a5c6-4d5987b431c6'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:57.007047 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6b3f69ab-55f2-46e1-a5c6-4d5987b431c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca953ddf1d649e5b124c86bdb1ab869', 'request_id': 'req-6b3f69ab-55f2-46e1-a5c6-4d5987b431c6'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:57.026599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6b3f69ab-55f2-46e1-a5c6-4d5987b431c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca953ddf1d649e5b124c86bdb1ab869', 'request_id': 'req-6b3f69ab-55f2-46e1-a5c6-4d5987b431c6'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:57.044080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779f271-a03d-4c8a-9f94-ea67c9594da4 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:57.047793 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-1779f271-a03d-4c8a-9f94-ea67c9594da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:57.113296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779f271-a03d-4c8a-9f94-ea67c9594da4 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:57.169832 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a89ed2-3b8b-466e-84c6-a02512744d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:57.170499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a89ed2-3b8b-466e-84c6-a02512744d6a service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:57.170784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a89ed2-3b8b-466e-84c6-a02512744d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:57.171062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a89ed2-3b8b-466e-84c6-a02512744d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:57.172908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e0a89ed2-3b8b-466e-84c6-a02512744d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:57.194728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a89ed2-3b8b-466e-84c6-a02512744d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:57.195419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6b3f69ab-55f2-46e1-a5c6-4d5987b431c6 admin admin] The token cache is being invalidate because project 0ca953ddf1d649e5b124c86bdb1ab869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:08:57.195419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6b3f69ab-55f2-46e1-a5c6-4d5987b431c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:57.195419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6b3f69ab-55f2-46e1-a5c6-4d5987b431c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:08:57.195928 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a89ed2-3b8b-466e-84c6-a02512744d6a service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:57.200281 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1208/2436] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:08:56 2022] DELETE /identity/v3/projects/0ca953ddf1d649e5b124c86bdb1ab869 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:57.206725 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0df51e-e4cc-442d-8bb5-f1357b535c09 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:57.207004 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0df51e-e4cc-442d-8bb5-f1357b535c09 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:57.208607 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0df51e-e4cc-442d-8bb5-f1357b535c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:57.218383 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1229/2437] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:08:57.259643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-bb0df51e-e4cc-442d-8bb5-f1357b535c09 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:57.263493 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-bb0df51e-e4cc-442d-8bb5-f1357b535c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:57.370394 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1209/2438] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:57.372264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8f358-c402-4bb5-9ec4-90fad706556f None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:57.372594 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8f358-c402-4bb5-9ec4-90fad706556f None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:57.372885 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8f358-c402-4bb5-9ec4-90fad706556f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:57.394032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-eee8f358-c402-4bb5-9ec4-90fad706556f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:57.397209 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-eee8f358-c402-4bb5-9ec4-90fad706556f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:57.406965 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1230/2439] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:57.411085 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0df51e-e4cc-442d-8bb5-f1357b535c09 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:57.423283 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0df51e-e4cc-442d-8bb5-f1357b535c09 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:57.428969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddc340-7161-4f4a-bca5-0d3bf048a32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:57.431026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddc340-7161-4f4a-bca5-0d3bf048a32a admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:57.431515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddc340-7161-4f4a-bca5-0d3bf048a32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:57.432132 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddc340-7161-4f4a-bca5-0d3bf048a32a admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:57.433986 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddc340-7161-4f4a-bca5-0d3bf048a32a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:08:57.439846 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddc340-7161-4f4a-bca5-0d3bf048a32a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:57.439846 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddc340-7161-4f4a-bca5-0d3bf048a32a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:57.460502 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8f358-c402-4bb5-9ec4-90fad706556f None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:57.460839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1210/2440] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:08:57.471106 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8f358-c402-4bb5-9ec4-90fad706556f None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:57.486370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0209b3-ba82-4a49-9630-4ac88f1e8519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:57.486648 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0209b3-ba82-4a49-9630-4ac88f1e8519 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:57.486985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0209b3-ba82-4a49-9630-4ac88f1e8519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:57.487401 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0209b3-ba82-4a49-9630-4ac88f1e8519 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:57.490160 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0209b3-ba82-4a49-9630-4ac88f1e8519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:57.492023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0209b3-ba82-4a49-9630-4ac88f1e8519 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:57.549947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:57.657104 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1231/2441] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:08:57 2022] POST /identity/v3/projects => generated 389 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:08:57.661511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddc340-7161-4f4a-bca5-0d3bf048a32a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:57.673350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddc340-7161-4f4a-bca5-0d3bf048a32a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:57.755701 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12dbad-3b4f-4be6-97cd-2faa96a6feeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:57.761698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12dbad-3b4f-4be6-97cd-2faa96a6feeb admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:57.761698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12dbad-3b4f-4be6-97cd-2faa96a6feeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:57.761698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12dbad-3b4f-4be6-97cd-2faa96a6feeb admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:57.761698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12dbad-3b4f-4be6-97cd-2faa96a6feeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:57.761698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12dbad-3b4f-4be6-97cd-2faa96a6feeb admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:57.805720 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0209b3-ba82-4a49-9630-4ac88f1e8519 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:57.809723 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-cb0209b3-ba82-4a49-9630-4ac88f1e8519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:57.851376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1211/2442] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:08:57 2022] POST /identity/v3/users => generated 295 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:08:57.856898 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12dbad-3b4f-4be6-97cd-2faa96a6feeb admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:57.881073 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12dbad-3b4f-4be6-97cd-2faa96a6feeb admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:57.896017 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2dbbe-8929-45f7-b2da-fd8ae8f2945a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:57.896717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2dbbe-8929-45f7-b2da-fd8ae8f2945a admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:57.897002 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2dbbe-8929-45f7-b2da-fd8ae8f2945a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:57.897310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2dbbe-8929-45f7-b2da-fd8ae8f2945a admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:57.898065 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2dbbe-8929-45f7-b2da-fd8ae8f2945a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:57.903061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2dbbe-8929-45f7-b2da-fd8ae8f2945a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:57.930907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1212/2443] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:57.937451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2dbbe-8929-45f7-b2da-fd8ae8f2945a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:57.960791 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2dbbe-8929-45f7-b2da-fd8ae8f2945a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:57.975447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb9b99-e2b3-4d2f-9f70-2fc0f09f6046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:57.976153 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb9b99-e2b3-4d2f-9f70-2fc0f09f6046 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:57.976436 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb9b99-e2b3-4d2f-9f70-2fc0f09f6046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:57.976716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb9b99-e2b3-4d2f-9f70-2fc0f09f6046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:57.977548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb9b99-e2b3-4d2f-9f70-2fc0f09f6046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:57.979649 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb9b99-e2b3-4d2f-9f70-2fc0f09f6046 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:58.011513 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0209b3-ba82-4a49-9630-4ac88f1e8519 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:58.015829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1213/2444] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:08:58.020717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb9b99-e2b3-4d2f-9f70-2fc0f09f6046 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:58.025228 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceef50-7af3-4def-87cb-3df47096fdf5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534035b2e8cf4f769e3dbbaabc0f6ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:58.025975 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceef50-7af3-4def-87cb-3df47096fdf5 service placement] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:58.026273 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceef50-7af3-4def-87cb-3df47096fdf5 service placement] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:58.026622 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceef50-7af3-4def-87cb-3df47096fdf5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:58.029377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5bceef50-7af3-4def-87cb-3df47096fdf5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:58.042931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceef50-7af3-4def-87cb-3df47096fdf5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:58.045102 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceef50-7af3-4def-87cb-3df47096fdf5 service placement] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:58.048135 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb9b99-e2b3-4d2f-9f70-2fc0f09f6046 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:58.061197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af3091-afb1-4e2c-91ce-c97da94a9bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:58.062421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af3091-afb1-4e2c-91ce-c97da94a9bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:58.062868 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af3091-afb1-4e2c-91ce-c97da94a9bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:58.063293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af3091-afb1-4e2c-91ce-c97da94a9bc6 admin admin] PATH_INFO: `/v3/projects/bd3d6a05da1a4aaf9ec3a47c186bfe47/users/2a5f78ea40834ff7bbee576f95393d6f/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:58.064341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1232/2445] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:08:58.089185 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af3091-afb1-4e2c-91ce-c97da94a9bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3d6a05da1a4aaf9ec3a47c186bfe47, user_id=2a5f78ea40834ff7bbee576f95393d6f, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:58.098175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af3091-afb1-4e2c-91ce-c97da94a9bc6 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:58.326610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1214/2446] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:08:58 2022] PUT /identity/v3/projects/bd3d6a05da1a4aaf9ec3a47c186bfe47/users/2a5f78ea40834ff7bbee576f95393d6f/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:08:58.328072 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e78f95-34d7-4292-9849-94ab494ec721 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:58.328377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e78f95-34d7-4292-9849-94ab494ec721 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:58.328693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e78f95-34d7-4292-9849-94ab494ec721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:58.352300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:58.362643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-b5e78f95-34d7-4292-9849-94ab494ec721 None None] MFA Rules not processed for user `2a5f78ea40834ff7bbee576f95393d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:58.378294 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b5e78f95-34d7-4292-9849-94ab494ec721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:58.452443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1233/2447] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:08:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:08:58.463445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af3091-afb1-4e2c-91ce-c97da94a9bc6 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:58.465904 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-82af3091-afb1-4e2c-91ce-c97da94a9bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:58.543914 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af3091-afb1-4e2c-91ce-c97da94a9bc6 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:58.547844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3dc886-c197-4c08-991f-89a95955fee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:58.548542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dc886-c197-4c08-991f-89a95955fee6 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:58.548938 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dc886-c197-4c08-991f-89a95955fee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:58.549274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3dc886-c197-4c08-991f-89a95955fee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:58.558799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3dc886-c197-4c08-991f-89a95955fee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:58.560559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3dc886-c197-4c08-991f-89a95955fee6 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:58.588158 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1215/2448] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:08:58.828835 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba168d0-d81b-4431-b63d-854940e34409 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:58.829439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba168d0-d81b-4431-b63d-854940e34409 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:58.829750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba168d0-d81b-4431-b63d-854940e34409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:58.861705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-bba168d0-d81b-4431-b63d-854940e34409 None None] MFA Rules not processed for user `5de52e11ee064c20bf56071dbf84f03e`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:08:58.862629 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-bba168d0-d81b-4431-b63d-854940e34409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:58.934417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1234/2449] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:08:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:08:59.377381 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3dc886-c197-4c08-991f-89a95955fee6 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:08:59.378870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-fa3dc886-c197-4c08-991f-89a95955fee6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:59.439883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3dc886-c197-4c08-991f-89a95955fee6 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:08:59.443727 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456c14f-4287-46ef-bf2b-773bfae68818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:08:59.444601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456c14f-4287-46ef-bf2b-773bfae68818 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:08:59.444816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456c14f-4287-46ef-bf2b-773bfae68818 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:08:59.445116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456c14f-4287-46ef-bf2b-773bfae68818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:08:59.447166 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3456c14f-4287-46ef-bf2b-773bfae68818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:08:59.458961 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456c14f-4287-46ef-bf2b-773bfae68818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:08:59.461355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456c14f-4287-46ef-bf2b-773bfae68818 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:08:59.477686 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1216/2450] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:08:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:00.406476 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:02.104608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba168d0-d81b-4431-b63d-854940e34409 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:02.125379 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba168d0-d81b-4431-b63d-854940e34409 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:02.129165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bc867-f4c9-4651-a21c-0d5236ed2661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:02.136038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bc867-f4c9-4651-a21c-0d5236ed2661 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:02.136038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bc867-f4c9-4651-a21c-0d5236ed2661 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:02.136038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bc867-f4c9-4651-a21c-0d5236ed2661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:02.136038 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-bc7bc867-f4c9-4651-a21c-0d5236ed2661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:02.145783 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bc867-f4c9-4651-a21c-0d5236ed2661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:02.147153 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bc867-f4c9-4651-a21c-0d5236ed2661 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:02.157941 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1235/2451] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:06.485182 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456c14f-4287-46ef-bf2b-773bfae68818 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:06.487390 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3456c14f-4287-46ef-bf2b-773bfae68818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:06.619840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456c14f-4287-46ef-bf2b-773bfae68818 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:06.631972 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed38d4-0f33-4ca5-af1a-0cd888501a81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:06.633032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed38d4-0f33-4ca5-af1a-0cd888501a81 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:06.633985 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed38d4-0f33-4ca5-af1a-0cd888501a81 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:06.633985 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed38d4-0f33-4ca5-af1a-0cd888501a81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:06.638751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-40ed38d4-0f33-4ca5-af1a-0cd888501a81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:06.655761 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed38d4-0f33-4ca5-af1a-0cd888501a81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:06.657188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed38d4-0f33-4ca5-af1a-0cd888501a81 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:06.670604 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1217/2452] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:11.275751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bc867-f4c9-4651-a21c-0d5236ed2661 service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:11.347332 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bc867-f4c9-4651-a21c-0d5236ed2661 service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:11.351931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496074b-5267-41b2-8ac5-61d3686da0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:11.352809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496074b-5267-41b2-8ac5-61d3686da0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:11.353124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496074b-5267-41b2-8ac5-61d3686da0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:11.353439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496074b-5267-41b2-8ac5-61d3686da0a7 admin admin] PATH_INFO: `/v3/users/2a5f78ea40834ff7bbee576f95393d6f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:11.354768 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496074b-5267-41b2-8ac5-61d3686da0a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a5f78ea40834ff7bbee576f95393d6f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:11.356833 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496074b-5267-41b2-8ac5-61d3686da0a7 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:11.643901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:11.657231 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-0496074b-5267-41b2-8ac5-61d3686da0a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a5f78ea40834ff7bbee576f95393d6f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:11.666160 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-0496074b-5267-41b2-8ac5-61d3686da0a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a5f78ea40834ff7bbee576f95393d6f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:11.667388 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-0496074b-5267-41b2-8ac5-61d3686da0a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a5f78ea40834ff7bbee576f95393d6f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:11.681159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-0496074b-5267-41b2-8ac5-61d3686da0a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a5f78ea40834ff7bbee576f95393d6f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:11.682335 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-0496074b-5267-41b2-8ac5-61d3686da0a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a5f78ea40834ff7bbee576f95393d6f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:11.858427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1236/2453] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:09:11 2022] DELETE /identity/v3/users/2a5f78ea40834ff7bbee576f95393d6f => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:11.863135 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a604286-938a-4b86-b5ed-7101c6c7307a None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:11.863621 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a604286-938a-4b86-b5ed-7101c6c7307a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:11.864256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a604286-938a-4b86-b5ed-7101c6c7307a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:11.881878 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-2a604286-938a-4b86-b5ed-7101c6c7307a None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:11.883116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2a604286-938a-4b86-b5ed-7101c6c7307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:11.948283 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1218/2454] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:11.958763 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496074b-5267-41b2-8ac5-61d3686da0a7 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:11.960278 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0496074b-5267-41b2-8ac5-61d3686da0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:12.020938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496074b-5267-41b2-8ac5-61d3686da0a7 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:12.024669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdca9f2-a35a-4766-a59c-34db5563a4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:12.025364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdca9f2-a35a-4766-a59c-34db5563a4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:12.025656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdca9f2-a35a-4766-a59c-34db5563a4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:12.025937 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdca9f2-a35a-4766-a59c-34db5563a4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:12.036006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdca9f2-a35a-4766-a59c-34db5563a4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:12.037500 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdca9f2-a35a-4766-a59c-34db5563a4f8 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:12.048506 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1237/2455] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:12.553511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a604286-938a-4b86-b5ed-7101c6c7307a None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:12.555082 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2a604286-938a-4b86-b5ed-7101c6c7307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:12.574310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a604286-938a-4b86-b5ed-7101c6c7307a None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:12.580966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04028b8d-bd48-4af7-8f4b-c27a41fafd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:12.581936 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04028b8d-bd48-4af7-8f4b-c27a41fafd48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:12.582484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04028b8d-bd48-4af7-8f4b-c27a41fafd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:12.582803 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04028b8d-bd48-4af7-8f4b-c27a41fafd48 admin admin] PATH_INFO: `/v3/projects/bd3d6a05da1a4aaf9ec3a47c186bfe47` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:12.584216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04028b8d-bd48-4af7-8f4b-c27a41fafd48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd3d6a05da1a4aaf9ec3a47c186bfe47)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:12.586427 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04028b8d-bd48-4af7-8f4b-c27a41fafd48 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:12.695559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:12.705253 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-04028b8d-bd48-4af7-8f4b-c27a41fafd48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd3d6a05da1a4aaf9ec3a47c186bfe47', 'request_id': 'req-04028b8d-bd48-4af7-8f4b-c27a41fafd48'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:12.713849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-04028b8d-bd48-4af7-8f4b-c27a41fafd48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd3d6a05da1a4aaf9ec3a47c186bfe47', 'request_id': 'req-04028b8d-bd48-4af7-8f4b-c27a41fafd48'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:12.721309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-04028b8d-bd48-4af7-8f4b-c27a41fafd48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd3d6a05da1a4aaf9ec3a47c186bfe47', 'request_id': 'req-04028b8d-bd48-4af7-8f4b-c27a41fafd48'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:12.812873 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-04028b8d-bd48-4af7-8f4b-c27a41fafd48 admin admin] The token cache is being invalidate because project bd3d6a05da1a4aaf9ec3a47c186bfe47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:09:12.813398 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-04028b8d-bd48-4af7-8f4b-c27a41fafd48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:12.814421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-04028b8d-bd48-4af7-8f4b-c27a41fafd48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:12.820033 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1219/2456] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:09:12 2022] DELETE /identity/v3/projects/bd3d6a05da1a4aaf9ec3a47c186bfe47 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:09:12.822551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76e4f3-cfaa-482c-8784-b6dfc73876b1 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:12.823105 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76e4f3-cfaa-482c-8784-b6dfc73876b1 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:12.823105 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76e4f3-cfaa-482c-8784-b6dfc73876b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:12.843757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-fd76e4f3-cfaa-482c-8784-b6dfc73876b1 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:12.845448 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fd76e4f3-cfaa-482c-8784-b6dfc73876b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:12.915621 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1238/2457] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:12.923275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990685e2-a4c6-49fc-a600-c61dd13bebf5 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:12.923773 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990685e2-a4c6-49fc-a600-c61dd13bebf5 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:12.923870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990685e2-a4c6-49fc-a600-c61dd13bebf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:12.943507 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-990685e2-a4c6-49fc-a600-c61dd13bebf5 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:12.944753 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-990685e2-a4c6-49fc-a600-c61dd13bebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:12.953504 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1220/2458] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:12.958010 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76e4f3-cfaa-482c-8784-b6dfc73876b1 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:12.970957 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76e4f3-cfaa-482c-8784-b6dfc73876b1 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:12.978485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dd9c3-041d-4728-b21a-643bfcbea152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:12.979284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dd9c3-041d-4728-b21a-643bfcbea152 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:12.985495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dd9c3-041d-4728-b21a-643bfcbea152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:12.985495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dd9c3-041d-4728-b21a-643bfcbea152 admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:12.985495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dd9c3-041d-4728-b21a-643bfcbea152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:09:12.985495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dd9c3-041d-4728-b21a-643bfcbea152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:12.985495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dd9c3-041d-4728-b21a-643bfcbea152 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:12.999367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1239/2459] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:09:13.003873 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990685e2-a4c6-49fc-a600-c61dd13bebf5 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:13.016788 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990685e2-a4c6-49fc-a600-c61dd13bebf5 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:13.019015 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bed25b-60e8-4b48-ad7f-57f015d5d9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:13.019689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bed25b-60e8-4b48-ad7f-57f015d5d9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:13.020003 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bed25b-60e8-4b48-ad7f-57f015d5d9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:13.020282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bed25b-60e8-4b48-ad7f-57f015d5d9e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:13.021005 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bed25b-60e8-4b48-ad7f-57f015d5d9e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:13.022976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bed25b-60e8-4b48-ad7f-57f015d5d9e4 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:13.141519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1221/2460] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:09:13 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:13.145540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dd9c3-041d-4728-b21a-643bfcbea152 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:13.155821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dd9c3-041d-4728-b21a-643bfcbea152 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:13.199054 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:13.215937 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17465b-2fc0-44f1-b6e0-d6cbb85a5ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:13.216622 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17465b-2fc0-44f1-b6e0-d6cbb85a5ade admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:13.216918 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17465b-2fc0-44f1-b6e0-d6cbb85a5ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:13.217231 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17465b-2fc0-44f1-b6e0-d6cbb85a5ade admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:13.217939 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17465b-2fc0-44f1-b6e0-d6cbb85a5ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:13.219884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17465b-2fc0-44f1-b6e0-d6cbb85a5ade admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:13.336346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1240/2461] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:09:13 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:13.337711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bed25b-60e8-4b48-ad7f-57f015d5d9e4 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:13.348311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bed25b-60e8-4b48-ad7f-57f015d5d9e4 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:13.353305 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44821f-03e1-4172-a451-a98d4b3f9b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:13.353957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44821f-03e1-4172-a451-a98d4b3f9b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:13.354250 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44821f-03e1-4172-a451-a98d4b3f9b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:13.354532 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44821f-03e1-4172-a451-a98d4b3f9b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:13.355273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44821f-03e1-4172-a451-a98d4b3f9b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:13.356940 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44821f-03e1-4172-a451-a98d4b3f9b45 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:13.372748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1222/2462] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:13.374177 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17465b-2fc0-44f1-b6e0-d6cbb85a5ade admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:13.385798 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17465b-2fc0-44f1-b6e0-d6cbb85a5ade admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:13.393571 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd53a0a-5134-454a-955f-5f89f1778e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:13.394354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd53a0a-5134-454a-955f-5f89f1778e2a admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:13.394636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd53a0a-5134-454a-955f-5f89f1778e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:13.394923 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd53a0a-5134-454a-955f-5f89f1778e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:13.395738 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd53a0a-5134-454a-955f-5f89f1778e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:13.397447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd53a0a-5134-454a-955f-5f89f1778e2a admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:13.416005 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1241/2463] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:13.420618 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44821f-03e1-4172-a451-a98d4b3f9b45 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:13.438198 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44821f-03e1-4172-a451-a98d4b3f9b45 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:13.443178 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bbe06-f49a-426d-b1ab-34bdf2732d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:13.444925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bbe06-f49a-426d-b1ab-34bdf2732d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:13.445260 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bbe06-f49a-426d-b1ab-34bdf2732d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:13.445830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bbe06-f49a-426d-b1ab-34bdf2732d2e admin admin] PATH_INFO: `/v3/projects/1ca6d692ea7d4829ba46086df5911f51/users/2aeab8c9fcff4c628b22faac07686d27/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:13.471578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bbe06-f49a-426d-b1ab-34bdf2732d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca6d692ea7d4829ba46086df5911f51, user_id=2aeab8c9fcff4c628b22faac07686d27, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:13.475091 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bbe06-f49a-426d-b1ab-34bdf2732d2e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:13.560694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1223/2464] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:13 2022] PUT /identity/v3/projects/1ca6d692ea7d4829ba46086df5911f51/users/2aeab8c9fcff4c628b22faac07686d27/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:09:13.565626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48727d33-d301-4297-aee4-00ef9aadbda2 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:13.566062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48727d33-d301-4297-aee4-00ef9aadbda2 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:13.566496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48727d33-d301-4297-aee4-00ef9aadbda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:13.588012 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-48727d33-d301-4297-aee4-00ef9aadbda2 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:13.589465 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-48727d33-d301-4297-aee4-00ef9aadbda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:13.682750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1242/2465] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:13.690453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bbe06-f49a-426d-b1ab-34bdf2732d2e admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:13.692274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f59bbe06-f49a-426d-b1ab-34bdf2732d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:13.768825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bbe06-f49a-426d-b1ab-34bdf2732d2e admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:13.774413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9650a-84c7-4cfa-a012-08c60eb8c5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:13.775238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9650a-84c7-4cfa-a012-08c60eb8c5af service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:13.775667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9650a-84c7-4cfa-a012-08c60eb8c5af service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:13.776043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9650a-84c7-4cfa-a012-08c60eb8c5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:13.787677 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9650a-84c7-4cfa-a012-08c60eb8c5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:13.789481 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9650a-84c7-4cfa-a012-08c60eb8c5af service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:13.801744 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1224/2466] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:20.745830 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb6dc0-bc51-4da8-9b09-6c271694f8df None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:20.746400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb6dc0-bc51-4da8-9b09-6c271694f8df None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:20.746400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb6dc0-bc51-4da8-9b09-6c271694f8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:20.776779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-3ffb6dc0-bc51-4da8-9b09-6c271694f8df None None] MFA Rules not processed for user `2aeab8c9fcff4c628b22faac07686d27`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:20.782323 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-3ffb6dc0-bc51-4da8-9b09-6c271694f8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:20.861471 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1243/2467] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:09:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:20.866099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9650a-84c7-4cfa-a012-08c60eb8c5af service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:20.882485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9650a-84c7-4cfa-a012-08c60eb8c5af service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:20.883053 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d724c45-c403-4355-80b5-68ad3c5fb631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:20.884645 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d724c45-c403-4355-80b5-68ad3c5fb631 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:20.885195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d724c45-c403-4355-80b5-68ad3c5fb631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:20.885599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d724c45-c403-4355-80b5-68ad3c5fb631 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:20.891225 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d724c45-c403-4355-80b5-68ad3c5fb631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:20.893400 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d724c45-c403-4355-80b5-68ad3c5fb631 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:21.055836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1225/2468] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:09:20 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:21.061119 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb6dc0-bc51-4da8-9b09-6c271694f8df None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:21.075430 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb6dc0-bc51-4da8-9b09-6c271694f8df None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:21.125269 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:21.136741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4074f8-3b93-459a-91be-b0fa297aba4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:21.137468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4074f8-3b93-459a-91be-b0fa297aba4d admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:21.137789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4074f8-3b93-459a-91be-b0fa297aba4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:21.145840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4074f8-3b93-459a-91be-b0fa297aba4d admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:21.145840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4074f8-3b93-459a-91be-b0fa297aba4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:21.145840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4074f8-3b93-459a-91be-b0fa297aba4d admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:21.304716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1244/2469] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:09:21 2022] POST /identity/v3/users => generated 299 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:21.309013 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d724c45-c403-4355-80b5-68ad3c5fb631 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:21.320620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d724c45-c403-4355-80b5-68ad3c5fb631 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:21.325508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73a61b-f484-444a-b2fa-6ea8cba393b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:21.326189 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73a61b-f484-444a-b2fa-6ea8cba393b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:21.326478 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73a61b-f484-444a-b2fa-6ea8cba393b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:21.326759 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73a61b-f484-444a-b2fa-6ea8cba393b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:21.327499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73a61b-f484-444a-b2fa-6ea8cba393b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:21.329114 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73a61b-f484-444a-b2fa-6ea8cba393b6 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:21.344962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1226/2470] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:21.346327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4074f8-3b93-459a-91be-b0fa297aba4d admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:21.357708 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4074f8-3b93-459a-91be-b0fa297aba4d admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:21.362510 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed39d22-25fe-40e5-953d-aa59b7137ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:21.363520 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed39d22-25fe-40e5-953d-aa59b7137ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:21.363809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed39d22-25fe-40e5-953d-aa59b7137ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:21.364085 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed39d22-25fe-40e5-953d-aa59b7137ac2 admin admin] PATH_INFO: `/v3/projects/247699d49f264936ac196ebddb679099/users/1d42e9d282ca416b8ac3d79dafe1948d/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:21.383215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed39d22-25fe-40e5-953d-aa59b7137ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247699d49f264936ac196ebddb679099, user_id=1d42e9d282ca416b8ac3d79dafe1948d, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:21.387640 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed39d22-25fe-40e5-953d-aa59b7137ac2 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:21.510189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1245/2471] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:21 2022] PUT /identity/v3/projects/247699d49f264936ac196ebddb679099/users/1d42e9d282ca416b8ac3d79dafe1948d/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:21.514653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73a61b-f484-444a-b2fa-6ea8cba393b6 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:21.522433 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73a61b-f484-444a-b2fa-6ea8cba393b6 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:21.550270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:21.586411 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d7db4-b74a-4ac7-a911-7969aedb15f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:21.589027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d7db4-b74a-4ac7-a911-7969aedb15f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:21.589027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d7db4-b74a-4ac7-a911-7969aedb15f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:21.589027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d7db4-b74a-4ac7-a911-7969aedb15f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:21.589027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d7db4-b74a-4ac7-a911-7969aedb15f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:21.590260 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d7db4-b74a-4ac7-a911-7969aedb15f1 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:21.601936 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1227/2472] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:09:21.607207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed39d22-25fe-40e5-953d-aa59b7137ac2 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:21.621800 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed39d22-25fe-40e5-953d-aa59b7137ac2 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:21.627021 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296371cd-6768-408d-aef9-52089de022e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:21.627932 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296371cd-6768-408d-aef9-52089de022e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:21.628223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296371cd-6768-408d-aef9-52089de022e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:21.628570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296371cd-6768-408d-aef9-52089de022e9 admin admin] PATH_INFO: `/v3/projects/247699d49f264936ac196ebddb679099/users/1d42e9d282ca416b8ac3d79dafe1948d/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:21.630693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296371cd-6768-408d-aef9-52089de022e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247699d49f264936ac196ebddb679099, user_id=1d42e9d282ca416b8ac3d79dafe1948d, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:21.633477 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296371cd-6768-408d-aef9-52089de022e9 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:21.645285 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1246/2473] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:21 2022] PUT /identity/v3/projects/247699d49f264936ac196ebddb679099/users/1d42e9d282ca416b8ac3d79dafe1948d/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:09:28.084842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f436b2-bb2c-45db-baf9-c9e8b3b16065 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:28.084842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f436b2-bb2c-45db-baf9-c9e8b3b16065 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:28.084842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f436b2-bb2c-45db-baf9-c9e8b3b16065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:28.113746 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-81f436b2-bb2c-45db-baf9-c9e8b3b16065 None None] MFA Rules not processed for user `1d42e9d282ca416b8ac3d79dafe1948d`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:28.115116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-81f436b2-bb2c-45db-baf9-c9e8b3b16065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:28.230320 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1228/2474] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:09:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:28.246366 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296371cd-6768-408d-aef9-52089de022e9 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:28.248478 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-296371cd-6768-408d-aef9-52089de022e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:28.348381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296371cd-6768-408d-aef9-52089de022e9 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:28.352125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278c731-08ae-4128-ae9a-d2dcd747256d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8f268ca2cb34c06b188908495cdcd53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:28.352783 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278c731-08ae-4128-ae9a-d2dcd747256d service glance] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:28.353071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278c731-08ae-4128-ae9a-d2dcd747256d service glance] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:28.353387 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278c731-08ae-4128-ae9a-d2dcd747256d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:28.419927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278c731-08ae-4128-ae9a-d2dcd747256d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:28.421418 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278c731-08ae-4128-ae9a-d2dcd747256d service glance] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:28.432839 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1247/2475] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:28.777975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b022ac3-0615-4b3b-ae40-4ba64a44358e None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:28.779101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b022ac3-0615-4b3b-ae40-4ba64a44358e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:28.779557 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b022ac3-0615-4b3b-ae40-4ba64a44358e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:28.807984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-2b022ac3-0615-4b3b-ae40-4ba64a44358e None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:28.809308 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2b022ac3-0615-4b3b-ae40-4ba64a44358e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:28.888801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1229/2476] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 16 15:09:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:09:29.099715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278c731-08ae-4128-ae9a-d2dcd747256d service glance] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:29.101333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-8278c731-08ae-4128-ae9a-d2dcd747256d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:29.155776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:29.191258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278c731-08ae-4128-ae9a-d2dcd747256d service glance] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:29.199386 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67a5ac-5e8b-4983-b17b-2cfa0ac153d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:29.200127 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67a5ac-5e8b-4983-b17b-2cfa0ac153d5 service swift] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:29.201087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67a5ac-5e8b-4983-b17b-2cfa0ac153d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:29.201425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67a5ac-5e8b-4983-b17b-2cfa0ac153d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:29.212435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67a5ac-5e8b-4983-b17b-2cfa0ac153d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:29.214096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67a5ac-5e8b-4983-b17b-2cfa0ac153d5 service swift] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:29.224134 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1248/2477] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 15:09:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 15:09:38.878179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=76 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:39.269202 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=16 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:41.183054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071c812-535f-49b8-8765-7a1a92c28cfa None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:41.183656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071c812-535f-49b8-8765-7a1a92c28cfa None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:41.183656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071c812-535f-49b8-8765-7a1a92c28cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:41.202332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-c071c812-535f-49b8-8765-7a1a92c28cfa None None] MFA Rules not processed for user `2aeab8c9fcff4c628b22faac07686d27`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:41.203581 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c071c812-535f-49b8-8765-7a1a92c28cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:41.210615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1230/2478] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:45.780826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40516937-8d73-401d-a381-86fe73bdf92a None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:45.781452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40516937-8d73-401d-a381-86fe73bdf92a None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:45.781560 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40516937-8d73-401d-a381-86fe73bdf92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:45.800513 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-40516937-8d73-401d-a381-86fe73bdf92a None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:45.801847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-40516937-8d73-401d-a381-86fe73bdf92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:45.811349 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1249/2479] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 16 15:09:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:45.823763 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071c812-535f-49b8-8765-7a1a92c28cfa None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:45.841605 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071c812-535f-49b8-8765-7a1a92c28cfa None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:45.841851 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a676bc-ef49-47fd-bda3-5a2ef493aa77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:45.842520 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a676bc-ef49-47fd-bda3-5a2ef493aa77 service swift] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:45.842811 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a676bc-ef49-47fd-bda3-5a2ef493aa77 service swift] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:45.843094 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a676bc-ef49-47fd-bda3-5a2ef493aa77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:45.852139 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a676bc-ef49-47fd-bda3-5a2ef493aa77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:45.854040 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a676bc-ef49-47fd-bda3-5a2ef493aa77 service swift] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:45.864112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1231/2480] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 15:09:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:09:46.488532 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40516937-8d73-401d-a381-86fe73bdf92a None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:46.490211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-40516937-8d73-401d-a381-86fe73bdf92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:46.601854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40516937-8d73-401d-a381-86fe73bdf92a None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:46.609379 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505aff2-ee08-4da1-a40e-008303bfe784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:46.610259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505aff2-ee08-4da1-a40e-008303bfe784 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:46.610645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505aff2-ee08-4da1-a40e-008303bfe784 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:46.611026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505aff2-ee08-4da1-a40e-008303bfe784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:46.613045 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a505aff2-ee08-4da1-a40e-008303bfe784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:46.708150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505aff2-ee08-4da1-a40e-008303bfe784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:46.709981 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505aff2-ee08-4da1-a40e-008303bfe784 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:46.724794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1250/2481] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:52.085757 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a676bc-ef49-47fd-bda3-5a2ef493aa77 service swift] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:52.087328 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b1a676bc-ef49-47fd-bda3-5a2ef493aa77 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:52.102820 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a676bc-ef49-47fd-bda3-5a2ef493aa77 service swift] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:52.108520 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e5754-1895-4fab-b2f0-76f584a26548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:52.109688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e5754-1895-4fab-b2f0-76f584a26548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:52.109975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e5754-1895-4fab-b2f0-76f584a26548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:52.110368 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e5754-1895-4fab-b2f0-76f584a26548 admin admin] PATH_INFO: `/v3/users/f6683ab715b3452a8a79b89be6b3bfce` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:52.111655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e5754-1895-4fab-b2f0-76f584a26548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6683ab715b3452a8a79b89be6b3bfce)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:52.113658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119e5754-1895-4fab-b2f0-76f584a26548 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:52.375260 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-119e5754-1895-4fab-b2f0-76f584a26548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6683ab715b3452a8a79b89be6b3bfce'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:52.376322 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-119e5754-1895-4fab-b2f0-76f584a26548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6683ab715b3452a8a79b89be6b3bfce'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:52.391661 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-119e5754-1895-4fab-b2f0-76f584a26548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6683ab715b3452a8a79b89be6b3bfce'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:52.392576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-119e5754-1895-4fab-b2f0-76f584a26548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6683ab715b3452a8a79b89be6b3bfce'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:52.482136 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-119e5754-1895-4fab-b2f0-76f584a26548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6683ab715b3452a8a79b89be6b3bfce'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:52.506104 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1232/2482] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:09:52 2022] DELETE /identity/v3/users/f6683ab715b3452a8a79b89be6b3bfce => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:52.822886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505aff2-ee08-4da1-a40e-008303bfe784 service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:52.833407 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505aff2-ee08-4da1-a40e-008303bfe784 service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:52.949271 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb0cb4-43ce-4340-8c76-5f8e80aad36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:52.951345 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb0cb4-43ce-4340-8c76-5f8e80aad36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:52.951657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb0cb4-43ce-4340-8c76-5f8e80aad36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:52.951986 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb0cb4-43ce-4340-8c76-5f8e80aad36a admin admin] PATH_INFO: `/v3/projects/1a388229f5bf43b5a8b64963bd847567` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:52.953319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb0cb4-43ce-4340-8c76-5f8e80aad36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a388229f5bf43b5a8b64963bd847567)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:52.955551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb0cb4-43ce-4340-8c76-5f8e80aad36a admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:53.106140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:53.124209 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dddb0cb4-43ce-4340-8c76-5f8e80aad36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a388229f5bf43b5a8b64963bd847567', 'request_id': 'req-dddb0cb4-43ce-4340-8c76-5f8e80aad36a'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:53.131112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dddb0cb4-43ce-4340-8c76-5f8e80aad36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a388229f5bf43b5a8b64963bd847567', 'request_id': 'req-dddb0cb4-43ce-4340-8c76-5f8e80aad36a'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:53.146905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dddb0cb4-43ce-4340-8c76-5f8e80aad36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a388229f5bf43b5a8b64963bd847567', 'request_id': 'req-dddb0cb4-43ce-4340-8c76-5f8e80aad36a'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:53.236109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dddb0cb4-43ce-4340-8c76-5f8e80aad36a admin admin] The token cache is being invalidate because project 1a388229f5bf43b5a8b64963bd847567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:09:53.236475 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dddb0cb4-43ce-4340-8c76-5f8e80aad36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:53.237010 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dddb0cb4-43ce-4340-8c76-5f8e80aad36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:53.238623 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1251/2483] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:09:52 2022] DELETE /identity/v3/projects/1a388229f5bf43b5a8b64963bd847567 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:53.243992 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bf5e2-0f1b-47b4-a112-a24c48339f59 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:53.244576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bf5e2-0f1b-47b4-a112-a24c48339f59 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:53.244576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bf5e2-0f1b-47b4-a112-a24c48339f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:53.276913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-c30bf5e2-0f1b-47b4-a112-a24c48339f59 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:53.279888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c30bf5e2-0f1b-47b4-a112-a24c48339f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:53.351579 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1233/2484] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:53.360065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5069497-975a-49af-845f-fa40b7aaba2c None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:53.360281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5069497-975a-49af-845f-fa40b7aaba2c None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:53.360563 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5069497-975a-49af-845f-fa40b7aaba2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:53.390263 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-e5069497-975a-49af-845f-fa40b7aaba2c None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:53.393040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-e5069497-975a-49af-845f-fa40b7aaba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:53.406679 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1252/2485] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:09:53.409576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bf5e2-0f1b-47b4-a112-a24c48339f59 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:53.419877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bf5e2-0f1b-47b4-a112-a24c48339f59 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:53.424695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820dd49-5cf6-44a5-a7eb-604a2793c4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:53.425505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820dd49-5cf6-44a5-a7eb-604a2793c4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:53.425795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820dd49-5cf6-44a5-a7eb-604a2793c4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:53.426089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820dd49-5cf6-44a5-a7eb-604a2793c4a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:53.426810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820dd49-5cf6-44a5-a7eb-604a2793c4a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:09:53.427124 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820dd49-5cf6-44a5-a7eb-604a2793c4a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:53.430624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820dd49-5cf6-44a5-a7eb-604a2793c4a4 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:53.444594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1234/2486] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:09:53.448397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5069497-975a-49af-845f-fa40b7aaba2c None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:53.461107 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5069497-975a-49af-845f-fa40b7aaba2c None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:53.467478 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56752922-b1d2-4748-badf-f46a6bafca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:53.468223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56752922-b1d2-4748-badf-f46a6bafca69 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:53.468538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56752922-b1d2-4748-badf-f46a6bafca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:53.468830 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56752922-b1d2-4748-badf-f46a6bafca69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:53.469931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56752922-b1d2-4748-badf-f46a6bafca69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:53.471957 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56752922-b1d2-4748-badf-f46a6bafca69 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:53.598722 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1253/2487] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:09:53 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:53.600154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820dd49-5cf6-44a5-a7eb-604a2793c4a4 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:53.610766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820dd49-5cf6-44a5-a7eb-604a2793c4a4 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:53.699833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:53.723880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a93033-06f0-484d-9c12-86c7c82d6865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:53.733059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a93033-06f0-484d-9c12-86c7c82d6865 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:53.733059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a93033-06f0-484d-9c12-86c7c82d6865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:53.733059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a93033-06f0-484d-9c12-86c7c82d6865 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:53.733059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a93033-06f0-484d-9c12-86c7c82d6865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:53.733059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a93033-06f0-484d-9c12-86c7c82d6865 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:53.824820 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1235/2488] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:09:53 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:53.829582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56752922-b1d2-4748-badf-f46a6bafca69 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:53.840980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56752922-b1d2-4748-badf-f46a6bafca69 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:53.846115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ccf06-2a90-4b8e-a6c9-afb4b3de3da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:53.847070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ccf06-2a90-4b8e-a6c9-afb4b3de3da6 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:53.847369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ccf06-2a90-4b8e-a6c9-afb4b3de3da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:53.847755 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ccf06-2a90-4b8e-a6c9-afb4b3de3da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:53.848443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ccf06-2a90-4b8e-a6c9-afb4b3de3da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:53.850447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ccf06-2a90-4b8e-a6c9-afb4b3de3da6 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:53.862867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1254/2489] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:53.867184 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a93033-06f0-484d-9c12-86c7c82d6865 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:53.878808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a93033-06f0-484d-9c12-86c7c82d6865 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:53.883795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e6b99-2ebc-440c-893f-79f722059cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:53.884488 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e6b99-2ebc-440c-893f-79f722059cff admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:53.884810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e6b99-2ebc-440c-893f-79f722059cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:53.885115 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e6b99-2ebc-440c-893f-79f722059cff admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:53.885878 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e6b99-2ebc-440c-893f-79f722059cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:53.887517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e6b99-2ebc-440c-893f-79f722059cff admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:53.902116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1236/2490] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:53.911135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ccf06-2a90-4b8e-a6c9-afb4b3de3da6 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:53.924050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ccf06-2a90-4b8e-a6c9-afb4b3de3da6 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:53.928918 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60238e5f-57a7-407b-9f20-710b6dd6cf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:53.930215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60238e5f-57a7-407b-9f20-710b6dd6cf67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:53.930656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60238e5f-57a7-407b-9f20-710b6dd6cf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:53.931421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60238e5f-57a7-407b-9f20-710b6dd6cf67 admin admin] PATH_INFO: `/v3/projects/935c2659fe2d4df3a674dce4b30e8517/users/9ef82248ff2a4958b30a5aa311f3e6f0/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:53.952157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60238e5f-57a7-407b-9f20-710b6dd6cf67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935c2659fe2d4df3a674dce4b30e8517, user_id=9ef82248ff2a4958b30a5aa311f3e6f0, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:53.954898 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60238e5f-57a7-407b-9f20-710b6dd6cf67 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:54.056694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1255/2491] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:53 2022] PUT /identity/v3/projects/935c2659fe2d4df3a674dce4b30e8517/users/9ef82248ff2a4958b30a5aa311f3e6f0/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:09:54.069867 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ddb57-3eec-4d49-ae83-254aa5e66f08 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:54.071057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ddb57-3eec-4d49-ae83-254aa5e66f08 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:54.071057 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ddb57-3eec-4d49-ae83-254aa5e66f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:54.106275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-2d3ddb57-3eec-4d49-ae83-254aa5e66f08 None None] MFA Rules not processed for user `9ef82248ff2a4958b30a5aa311f3e6f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:54.108216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-2d3ddb57-3eec-4d49-ae83-254aa5e66f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:54.212695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1237/2492] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:09:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:09:54.224776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60238e5f-57a7-407b-9f20-710b6dd6cf67 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:54.226569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-60238e5f-57a7-407b-9f20-710b6dd6cf67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:54.333228 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60238e5f-57a7-407b-9f20-710b6dd6cf67 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:54.343253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2f366-fd00-4721-b650-ac180ed513b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:54.343879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2f366-fd00-4721-b650-ac180ed513b2 service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:54.344207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2f366-fd00-4721-b650-ac180ed513b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:54.344443 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2f366-fd00-4721-b650-ac180ed513b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:54.352938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2f366-fd00-4721-b650-ac180ed513b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:54.354660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2f366-fd00-4721-b650-ac180ed513b2 service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:54.364968 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1256/2493] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:57.799041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ddb57-3eec-4d49-ae83-254aa5e66f08 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:57.875467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ddb57-3eec-4d49-ae83-254aa5e66f08 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:57.880843 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efea7c5-9737-4ce7-8c5a-a61829e539c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:57.882072 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efea7c5-9737-4ce7-8c5a-a61829e539c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:57.882591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efea7c5-9737-4ce7-8c5a-a61829e539c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:57.883102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efea7c5-9737-4ce7-8c5a-a61829e539c6 admin admin] PATH_INFO: `/v3/users/9ef82248ff2a4958b30a5aa311f3e6f0` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:57.884557 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efea7c5-9737-4ce7-8c5a-a61829e539c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef82248ff2a4958b30a5aa311f3e6f0)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:57.886855 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efea7c5-9737-4ce7-8c5a-a61829e539c6 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:58.093722 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-8efea7c5-9737-4ce7-8c5a-a61829e539c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef82248ff2a4958b30a5aa311f3e6f0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:58.094430 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-8efea7c5-9737-4ce7-8c5a-a61829e539c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef82248ff2a4958b30a5aa311f3e6f0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:58.096542 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:58.101777 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-8efea7c5-9737-4ce7-8c5a-a61829e539c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef82248ff2a4958b30a5aa311f3e6f0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:58.102673 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-8efea7c5-9737-4ce7-8c5a-a61829e539c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef82248ff2a4958b30a5aa311f3e6f0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:58.173591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-8efea7c5-9737-4ce7-8c5a-a61829e539c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef82248ff2a4958b30a5aa311f3e6f0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:58.188611 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1238/2494] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:09:57 2022] DELETE /identity/v3/users/9ef82248ff2a4958b30a5aa311f3e6f0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:58.193345 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149c7d8-7a34-47e1-8958-324c6a2bb96c None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:58.200379 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149c7d8-7a34-47e1-8958-324c6a2bb96c None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:58.200379 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149c7d8-7a34-47e1-8958-324c6a2bb96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:58.211704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-b149c7d8-7a34-47e1-8958-324c6a2bb96c None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:58.212992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b149c7d8-7a34-47e1-8958-324c6a2bb96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:58.265779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:58.285885 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1257/2495] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:58.295679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efea7c5-9737-4ce7-8c5a-a61829e539c6 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:58.297295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-8efea7c5-9737-4ce7-8c5a-a61829e539c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:58.359259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efea7c5-9737-4ce7-8c5a-a61829e539c6 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:58.362955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9ccee-8a1d-45ed-bd26-179b3b712669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:58.363623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9ccee-8a1d-45ed-bd26-179b3b712669 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:58.363914 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9ccee-8a1d-45ed-bd26-179b3b712669 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:58.364200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9ccee-8a1d-45ed-bd26-179b3b712669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:58.376593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9ccee-8a1d-45ed-bd26-179b3b712669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:58.378596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9ccee-8a1d-45ed-bd26-179b3b712669 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:58.390098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1239/2496] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:09:58.858772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149c7d8-7a34-47e1-8958-324c6a2bb96c None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:58.860404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b149c7d8-7a34-47e1-8958-324c6a2bb96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:58.874844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149c7d8-7a34-47e1-8958-324c6a2bb96c None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:58.881495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c8539-ab46-45ca-8ddd-311d05c29c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:58.882488 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c8539-ab46-45ca-8ddd-311d05c29c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:58.882846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c8539-ab46-45ca-8ddd-311d05c29c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:58.883194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c8539-ab46-45ca-8ddd-311d05c29c60 admin admin] PATH_INFO: `/v3/projects/935c2659fe2d4df3a674dce4b30e8517` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:58.884884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c8539-ab46-45ca-8ddd-311d05c29c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935c2659fe2d4df3a674dce4b30e8517)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:58.886922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c8539-ab46-45ca-8ddd-311d05c29c60 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:59.045779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ab0c8539-ab46-45ca-8ddd-311d05c29c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935c2659fe2d4df3a674dce4b30e8517', 'request_id': 'req-ab0c8539-ab46-45ca-8ddd-311d05c29c60'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:59.056414 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ab0c8539-ab46-45ca-8ddd-311d05c29c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935c2659fe2d4df3a674dce4b30e8517', 'request_id': 'req-ab0c8539-ab46-45ca-8ddd-311d05c29c60'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:59.068752 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ab0c8539-ab46-45ca-8ddd-311d05c29c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935c2659fe2d4df3a674dce4b30e8517', 'request_id': 'req-ab0c8539-ab46-45ca-8ddd-311d05c29c60'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:59.170870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ab0c8539-ab46-45ca-8ddd-311d05c29c60 admin admin] The token cache is being invalidate because project 935c2659fe2d4df3a674dce4b30e8517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:09:59.171173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ab0c8539-ab46-45ca-8ddd-311d05c29c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:59.172270 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ab0c8539-ab46-45ca-8ddd-311d05c29c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:09:59.178472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1258/2497] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:09:58 2022] DELETE /identity/v3/projects/935c2659fe2d4df3a674dce4b30e8517 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:09:59.180359 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d57e33-079b-4ad4-948e-de134acec1a7 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:59.180811 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d57e33-079b-4ad4-948e-de134acec1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:59.180988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d57e33-079b-4ad4-948e-de134acec1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:59.199968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-54d57e33-079b-4ad4-948e-de134acec1a7 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:59.201273 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-54d57e33-079b-4ad4-948e-de134acec1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:59.270619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1240/2498] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:09:59.278629 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cddae-7a90-4ac9-854a-fcbdab42b4cd None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:59.279215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cddae-7a90-4ac9-854a-fcbdab42b4cd None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:59.279858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cddae-7a90-4ac9-854a-fcbdab42b4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:59.299911 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-2f3cddae-7a90-4ac9-854a-fcbdab42b4cd None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:09:59.301361 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2f3cddae-7a90-4ac9-854a-fcbdab42b4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:09:59.309890 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1259/2499] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:09:59.314838 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d57e33-079b-4ad4-948e-de134acec1a7 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:59.325491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d57e33-079b-4ad4-948e-de134acec1a7 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:59.332528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c159d67-7688-451e-9b3b-078dbe3bb4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:59.333293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c159d67-7688-451e-9b3b-078dbe3bb4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:59.333582 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c159d67-7688-451e-9b3b-078dbe3bb4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:59.333984 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c159d67-7688-451e-9b3b-078dbe3bb4f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:59.334890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c159d67-7688-451e-9b3b-078dbe3bb4f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:09:59.335233 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c159d67-7688-451e-9b3b-078dbe3bb4f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:59.337019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c159d67-7688-451e-9b3b-078dbe3bb4f2 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:59.350733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1241/2500] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:09:59.355339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cddae-7a90-4ac9-854a-fcbdab42b4cd None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:59.374795 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cddae-7a90-4ac9-854a-fcbdab42b4cd None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:59.374795 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bac9b-0da2-4d88-88ee-1b6d254edb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:59.374795 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bac9b-0da2-4d88-88ee-1b6d254edb78 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:59.374795 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bac9b-0da2-4d88-88ee-1b6d254edb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:59.375095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bac9b-0da2-4d88-88ee-1b6d254edb78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:59.375978 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bac9b-0da2-4d88-88ee-1b6d254edb78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:59.378565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bac9b-0da2-4d88-88ee-1b6d254edb78 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:59.459643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1260/2501] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:09:59 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:09:59.463786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c159d67-7688-451e-9b3b-078dbe3bb4f2 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:59.476583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c159d67-7688-451e-9b3b-078dbe3bb4f2 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:59.535568 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:59.542687 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ce398-61a1-4560-9425-d976dec7f78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:59.543436 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ce398-61a1-4560-9425-d976dec7f78d admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:59.543727 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ce398-61a1-4560-9425-d976dec7f78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:59.544011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ce398-61a1-4560-9425-d976dec7f78d admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:59.545165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ce398-61a1-4560-9425-d976dec7f78d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:59.547450 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ce398-61a1-4560-9425-d976dec7f78d admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:59.739218 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1242/2502] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:09:59 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:09:59.740365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bac9b-0da2-4d88-88ee-1b6d254edb78 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:59.751284 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bac9b-0da2-4d88-88ee-1b6d254edb78 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:59.756360 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a0359-0036-4f5e-b0d3-a409809e0253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:59.757048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0359-0036-4f5e-b0d3-a409809e0253 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:59.757377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0359-0036-4f5e-b0d3-a409809e0253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:59.757659 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0359-0036-4f5e-b0d3-a409809e0253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:59.758488 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a0359-0036-4f5e-b0d3-a409809e0253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:59.760111 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a0359-0036-4f5e-b0d3-a409809e0253 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:59.774025 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1261/2503] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:09:59.778004 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ce398-61a1-4560-9425-d976dec7f78d admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:59.790165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ce398-61a1-4560-9425-d976dec7f78d admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:59.798617 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e5718-28f2-49f3-8c95-7461e23ee50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:59.802310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e5718-28f2-49f3-8c95-7461e23ee50c admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:59.802310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e5718-28f2-49f3-8c95-7461e23ee50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:59.802310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e5718-28f2-49f3-8c95-7461e23ee50c admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:59.802310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e5718-28f2-49f3-8c95-7461e23ee50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:59.802310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e5718-28f2-49f3-8c95-7461e23ee50c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:09:59.815484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1243/2504] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:09:59.819765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a0359-0036-4f5e-b0d3-a409809e0253 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:09:59.830165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a0359-0036-4f5e-b0d3-a409809e0253 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:09:59.835092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0cad5-e360-4904-81a6-a089b7c3224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:09:59.835992 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0cad5-e360-4904-81a6-a089b7c3224e admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:09:59.836305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0cad5-e360-4904-81a6-a089b7c3224e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:09:59.836584 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0cad5-e360-4904-81a6-a089b7c3224e admin admin] PATH_INFO: `/v3/projects/5b4fb17444b44cb9b95ec3d89e5e5d6d/users/56dceecca90c42e88611c782fcf38328/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:09:59.854233 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0cad5-e360-4904-81a6-a089b7c3224e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4fb17444b44cb9b95ec3d89e5e5d6d, user_id=56dceecca90c42e88611c782fcf38328, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:09:59.856994 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0cad5-e360-4904-81a6-a089b7c3224e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:00.003315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1262/2505] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:09:59 2022] PUT /identity/v3/projects/5b4fb17444b44cb9b95ec3d89e5e5d6d/users/56dceecca90c42e88611c782fcf38328/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:00.014297 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11048687-64f6-4bca-869f-a191f774a470 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:00.014657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11048687-64f6-4bca-869f-a191f774a470 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:00.015011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11048687-64f6-4bca-869f-a191f774a470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:00.043715 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-11048687-64f6-4bca-869f-a191f774a470 None None] MFA Rules not processed for user `56dceecca90c42e88611c782fcf38328`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:00.045079 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-11048687-64f6-4bca-869f-a191f774a470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:00.114441 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1244/2506] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:00.119148 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0cad5-e360-4904-81a6-a089b7c3224e admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:00.181057 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0cad5-e360-4904-81a6-a089b7c3224e admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:00.185795 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adaa7db-02b9-4d0a-bde1-24756c3a2455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:00.186457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaa7db-02b9-4d0a-bde1-24756c3a2455 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:00.187137 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaa7db-02b9-4d0a-bde1-24756c3a2455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:00.187137 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adaa7db-02b9-4d0a-bde1-24756c3a2455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:00.187691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adaa7db-02b9-4d0a-bde1-24756c3a2455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:00.189621 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adaa7db-02b9-4d0a-bde1-24756c3a2455 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:00.250867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:00.257594 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1263/2507] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:10:00 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:00.261750 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11048687-64f6-4bca-869f-a191f774a470 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:00.273339 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11048687-64f6-4bca-869f-a191f774a470 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:00.332411 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebe70a-9632-47ae-a02e-405ad0f5cdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:00.333099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebe70a-9632-47ae-a02e-405ad0f5cdd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:00.333423 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebe70a-9632-47ae-a02e-405ad0f5cdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:00.333711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebe70a-9632-47ae-a02e-405ad0f5cdd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:00.334425 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebe70a-9632-47ae-a02e-405ad0f5cdd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:00.336393 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebe70a-9632-47ae-a02e-405ad0f5cdd3 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:00.431444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1245/2508] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:10:00 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:00.435969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adaa7db-02b9-4d0a-bde1-24756c3a2455 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:00.446974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adaa7db-02b9-4d0a-bde1-24756c3a2455 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:00.454256 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c737b71-54de-4050-8509-377a7f633ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:00.454989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c737b71-54de-4050-8509-377a7f633ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:00.455272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c737b71-54de-4050-8509-377a7f633ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:00.455549 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c737b71-54de-4050-8509-377a7f633ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:00.456281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c737b71-54de-4050-8509-377a7f633ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:00.457956 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c737b71-54de-4050-8509-377a7f633ec7 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:00.469737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1264/2509] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:00.473996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebe70a-9632-47ae-a02e-405ad0f5cdd3 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:00.484505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebe70a-9632-47ae-a02e-405ad0f5cdd3 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:00.489345 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0704fcf-b39d-49bc-9fa7-873455e17502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:00.490022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0704fcf-b39d-49bc-9fa7-873455e17502 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:00.490315 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0704fcf-b39d-49bc-9fa7-873455e17502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:00.490601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0704fcf-b39d-49bc-9fa7-873455e17502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:00.491339 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0704fcf-b39d-49bc-9fa7-873455e17502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:00.493275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0704fcf-b39d-49bc-9fa7-873455e17502 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:00.504888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1246/2510] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:00.509254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c737b71-54de-4050-8509-377a7f633ec7 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:00.520253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c737b71-54de-4050-8509-377a7f633ec7 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:00.525710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa452b-4fac-40f8-bfe5-c6c136c5e58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:00.526599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa452b-4fac-40f8-bfe5-c6c136c5e58b admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:00.526887 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa452b-4fac-40f8-bfe5-c6c136c5e58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:00.527170 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa452b-4fac-40f8-bfe5-c6c136c5e58b admin admin] PATH_INFO: `/v3/projects/1f09cba22b784c109c37e53cceb0efdb/users/76e1429775b142b99f31681d72ba594e/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:00.542611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa452b-4fac-40f8-bfe5-c6c136c5e58b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f09cba22b784c109c37e53cceb0efdb, user_id=76e1429775b142b99f31681d72ba594e, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:00.545356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa452b-4fac-40f8-bfe5-c6c136c5e58b admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:00.702082 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1265/2511] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:00 2022] PUT /identity/v3/projects/1f09cba22b784c109c37e53cceb0efdb/users/76e1429775b142b99f31681d72ba594e/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:00.714636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0d1a9-c9e4-4224-aeab-f726de43ae65 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:00.719612 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0d1a9-c9e4-4224-aeab-f726de43ae65 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:00.719612 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0d1a9-c9e4-4224-aeab-f726de43ae65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:00.744818 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-e1a0d1a9-c9e4-4224-aeab-f726de43ae65 None None] MFA Rules not processed for user `76e1429775b142b99f31681d72ba594e`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:00.746296 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e1a0d1a9-c9e4-4224-aeab-f726de43ae65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:00.780738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:00.833881 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1247/2512] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:00.838723 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa452b-4fac-40f8-bfe5-c6c136c5e58b admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:00.931435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa452b-4fac-40f8-bfe5-c6c136c5e58b admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:00.937295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9c76e-521c-497e-b20c-8d73a9be7696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:00.937966 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9c76e-521c-497e-b20c-8d73a9be7696 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:00.938255 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9c76e-521c-497e-b20c-8d73a9be7696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:00.938534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9c76e-521c-497e-b20c-8d73a9be7696 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:00.939225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9c76e-521c-497e-b20c-8d73a9be7696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:00.941151 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9c76e-521c-497e-b20c-8d73a9be7696 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:01.105109 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1266/2513] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:10:00 2022] POST /identity/v3/projects => generated 387 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:01.110053 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0d1a9-c9e4-4224-aeab-f726de43ae65 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:01.121813 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0d1a9-c9e4-4224-aeab-f726de43ae65 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:01.202648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908e51e-a6d5-42cf-ad3f-4992a9573400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:01.202648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908e51e-a6d5-42cf-ad3f-4992a9573400 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:01.202648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908e51e-a6d5-42cf-ad3f-4992a9573400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:01.202648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908e51e-a6d5-42cf-ad3f-4992a9573400 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:01.202992 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908e51e-a6d5-42cf-ad3f-4992a9573400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:01.206836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908e51e-a6d5-42cf-ad3f-4992a9573400 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:01.314199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1248/2514] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:10:01 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:10:01.319932 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9c76e-521c-497e-b20c-8d73a9be7696 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:01.332594 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9c76e-521c-497e-b20c-8d73a9be7696 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:01.337672 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e532b29-d997-4930-ac00-79c63d5d071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:01.338525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e532b29-d997-4930-ac00-79c63d5d071a admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:01.338882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e532b29-d997-4930-ac00-79c63d5d071a admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:01.339229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e532b29-d997-4930-ac00-79c63d5d071a admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:01.340055 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e532b29-d997-4930-ac00-79c63d5d071a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:01.342446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e532b29-d997-4930-ac00-79c63d5d071a admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:01.384058 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1267/2515] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:01.389972 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908e51e-a6d5-42cf-ad3f-4992a9573400 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:01.406413 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908e51e-a6d5-42cf-ad3f-4992a9573400 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:01.412118 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06eaa56-ae9d-47ee-9d95-20d09b477aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:01.416976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06eaa56-ae9d-47ee-9d95-20d09b477aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:01.416976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06eaa56-ae9d-47ee-9d95-20d09b477aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:01.416976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06eaa56-ae9d-47ee-9d95-20d09b477aa2 admin admin] PATH_INFO: `/v3/projects/9c0f78cb60ff4fc592f74749ca1211d0/users/005c9c1de16341faa182d157e90a2cfc/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:01.431523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06eaa56-ae9d-47ee-9d95-20d09b477aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0f78cb60ff4fc592f74749ca1211d0, user_id=005c9c1de16341faa182d157e90a2cfc, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:01.434263 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06eaa56-ae9d-47ee-9d95-20d09b477aa2 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:01.516733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1249/2516] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:01 2022] PUT /identity/v3/projects/9c0f78cb60ff4fc592f74749ca1211d0/users/005c9c1de16341faa182d157e90a2cfc/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:01.520354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e532b29-d997-4930-ac00-79c63d5d071a admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:01.532436 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e532b29-d997-4930-ac00-79c63d5d071a admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:01.571148 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a0108-923b-49d6-ab69-ecca9ada0b4a None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:01.571148 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a0108-923b-49d6-ab69-ecca9ada0b4a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:01.571376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a0108-923b-49d6-ab69-ecca9ada0b4a None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:01.572765 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1250/2517] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 16 15:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 15:10:01.579031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf37b1a-e57a-4702-bbbf-f9b4e448e2c0 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:01.579324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf37b1a-e57a-4702-bbbf-f9b4e448e2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:01.579605 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf37b1a-e57a-4702-bbbf-f9b4e448e2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:01.599294 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-ddf37b1a-e57a-4702-bbbf-f9b4e448e2c0 None None] MFA Rules not processed for user `db3b603ceffb43bc99684e0d2319e3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:01.600510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ddf37b1a-e57a-4702-bbbf-f9b4e448e2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:01.622842 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee97ef-5a2c-4c7f-b496-a8d02aad4d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:01.623643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee97ef-5a2c-4c7f-b496-a8d02aad4d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:01.624002 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee97ef-5a2c-4c7f-b496-a8d02aad4d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:01.624343 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee97ef-5a2c-4c7f-b496-a8d02aad4d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:01.625165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee97ef-5a2c-4c7f-b496-a8d02aad4d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:01.626970 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee97ef-5a2c-4c7f-b496-a8d02aad4d27 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:01.637643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1268/2518] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:01.642278 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee97ef-5a2c-4c7f-b496-a8d02aad4d27 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:01.653940 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee97ef-5a2c-4c7f-b496-a8d02aad4d27 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:01.660628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dd714-3657-40e1-9b17-512472410c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:01.661574 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dd714-3657-40e1-9b17-512472410c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:01.661863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dd714-3657-40e1-9b17-512472410c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:01.662145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dd714-3657-40e1-9b17-512472410c6c admin admin] PATH_INFO: `/v3/projects/9c0f78cb60ff4fc592f74749ca1211d0/users/005c9c1de16341faa182d157e90a2cfc/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:01.664175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dd714-3657-40e1-9b17-512472410c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0f78cb60ff4fc592f74749ca1211d0, user_id=005c9c1de16341faa182d157e90a2cfc, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:01.667232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dd714-3657-40e1-9b17-512472410c6c admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:01.668446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1251/2519] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 16 15:10:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:01.679864 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1269/2520] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:01 2022] PUT /identity/v3/projects/9c0f78cb60ff4fc592f74749ca1211d0/users/005c9c1de16341faa182d157e90a2cfc/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:01.680910 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf37b1a-e57a-4702-bbbf-f9b4e448e2c0 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:01.682446 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ddf37b1a-e57a-4702-bbbf-f9b4e448e2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:01.689686 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8da96b-5602-48a4-9919-311ad0a8c752 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:01.689979 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8da96b-5602-48a4-9919-311ad0a8c752 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:01.690263 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8da96b-5602-48a4-9919-311ad0a8c752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:01.693825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf37b1a-e57a-4702-bbbf-f9b4e448e2c0 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:01.721564 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-6e8da96b-5602-48a4-9919-311ad0a8c752 None None] MFA Rules not processed for user `005c9c1de16341faa182d157e90a2cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:01.723285 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6e8da96b-5602-48a4-9919-311ad0a8c752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:01.734785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:01.745030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:01.749467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b6dca-9ee5-469d-b5bb-82828996f7bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:01.750119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b6dca-9ee5-469d-b5bb-82828996f7bc service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:01.750417 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b6dca-9ee5-469d-b5bb-82828996f7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:01.750695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b6dca-9ee5-469d-b5bb-82828996f7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:01.757867 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b6dca-9ee5-469d-b5bb-82828996f7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:01.759294 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b6dca-9ee5-469d-b5bb-82828996f7bc service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:01.767748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1252/2521] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:01.797567 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1270/2522] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:10:01.808326 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b6dca-9ee5-469d-b5bb-82828996f7bc service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:01.809951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-bb8b6dca-9ee5-469d-b5bb-82828996f7bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:01.855327 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424d159-514d-4740-8b7c-7bf63e9b4792 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:01.859202 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424d159-514d-4740-8b7c-7bf63e9b4792 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:01.859202 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424d159-514d-4740-8b7c-7bf63e9b4792 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:01.859202 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1271/2523] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 16 15:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 15:10:01.862620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb36865-1fc4-4ad0-a7b4-651e704ab6aa None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:01.862941 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb36865-1fc4-4ad0-a7b4-651e704ab6aa None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:01.863223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb36865-1fc4-4ad0-a7b4-651e704ab6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:01.872294 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b6dca-9ee5-469d-b5bb-82828996f7bc service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:01.876668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b73d92-aa17-497d-b545-1139d12597de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:01.877358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b73d92-aa17-497d-b545-1139d12597de service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:01.877646 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b73d92-aa17-497d-b545-1139d12597de service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:01.877933 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b73d92-aa17-497d-b545-1139d12597de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:01.887632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b73d92-aa17-497d-b545-1139d12597de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:01.889403 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b73d92-aa17-497d-b545-1139d12597de service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:01.899957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1253/2524] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:01.901597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-2eb36865-1fc4-4ad0-a7b4-651e704ab6aa None None] MFA Rules not processed for user `60c2f1c63a674e3195c490ab5ad1318f`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:01.902880 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2eb36865-1fc4-4ad0-a7b4-651e704ab6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:01.973101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1272/2525] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 16 15:10:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:10:01.983866 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b73d92-aa17-497d-b545-1139d12597de service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:01.985431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-57b73d92-aa17-497d-b545-1139d12597de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:01.999253 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b73d92-aa17-497d-b545-1139d12597de service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:02.003143 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9770c0-5cdf-41c2-a7c3-293183a26261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:02.003791 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9770c0-5cdf-41c2-a7c3-293183a26261 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:02.004077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9770c0-5cdf-41c2-a7c3-293183a26261 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:02.004363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9770c0-5cdf-41c2-a7c3-293183a26261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:02.016287 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9770c0-5cdf-41c2-a7c3-293183a26261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:02.017835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9770c0-5cdf-41c2-a7c3-293183a26261 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:02.028813 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1254/2526] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:02.962264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb36865-1fc4-4ad0-a7b4-651e704ab6aa None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:02.968154 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2eb36865-1fc4-4ad0-a7b4-651e704ab6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:02.991736 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb36865-1fc4-4ad0-a7b4-651e704ab6aa None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:03.000633 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9eebd-69c6-4bd5-849d-c92ac4db402e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:03.001536 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9eebd-69c6-4bd5-849d-c92ac4db402e service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:03.006796 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9eebd-69c6-4bd5-849d-c92ac4db402e service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:03.006796 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9eebd-69c6-4bd5-849d-c92ac4db402e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:03.006796 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fed9eebd-69c6-4bd5-849d-c92ac4db402e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:03.017654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9eebd-69c6-4bd5-849d-c92ac4db402e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:03.019277 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9eebd-69c6-4bd5-849d-c92ac4db402e service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:03.033607 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1273/2527] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:03.097079 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9770c0-5cdf-41c2-a7c3-293183a26261 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:03.098820 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-cf9770c0-5cdf-41c2-a7c3-293183a26261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:03.111165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9770c0-5cdf-41c2-a7c3-293183a26261 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:03.114894 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df51822-328d-4c10-a1cc-770fa5cb5b96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:03.115618 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df51822-328d-4c10-a1cc-770fa5cb5b96 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:03.115975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df51822-328d-4c10-a1cc-770fa5cb5b96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:03.116319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df51822-328d-4c10-a1cc-770fa5cb5b96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:03.183186 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df51822-328d-4c10-a1cc-770fa5cb5b96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:03.184703 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df51822-328d-4c10-a1cc-770fa5cb5b96 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:03.195830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1255/2528] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:08.353177 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9eebd-69c6-4bd5-849d-c92ac4db402e service nova] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:08.378788 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9eebd-69c6-4bd5-849d-c92ac4db402e service nova] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:08.382724 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a317c-28f0-4597-b7ff-5a9916e01872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:08.383474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a317c-28f0-4597-b7ff-5a9916e01872 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:08.383838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a317c-28f0-4597-b7ff-5a9916e01872 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:08.384174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a317c-28f0-4597-b7ff-5a9916e01872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:08.453826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a317c-28f0-4597-b7ff-5a9916e01872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:08.455286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a317c-28f0-4597-b7ff-5a9916e01872 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:08.465609 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1274/2529] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:13.064857 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df51822-328d-4c10-a1cc-770fa5cb5b96 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:13.136944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df51822-328d-4c10-a1cc-770fa5cb5b96 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:13.143238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65487ac5-5170-4069-82c6-02b464ab6c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:13.144173 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65487ac5-5170-4069-82c6-02b464ab6c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:13.144464 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65487ac5-5170-4069-82c6-02b464ab6c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:13.144745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65487ac5-5170-4069-82c6-02b464ab6c5a admin admin] PATH_INFO: `/v3/users/56dceecca90c42e88611c782fcf38328` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:13.146283 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65487ac5-5170-4069-82c6-02b464ab6c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56dceecca90c42e88611c782fcf38328)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:13.148381 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65487ac5-5170-4069-82c6-02b464ab6c5a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:13.173975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:13.391008 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-65487ac5-5170-4069-82c6-02b464ab6c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56dceecca90c42e88611c782fcf38328'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:13.392042 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-65487ac5-5170-4069-82c6-02b464ab6c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56dceecca90c42e88611c782fcf38328'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:13.399606 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-65487ac5-5170-4069-82c6-02b464ab6c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56dceecca90c42e88611c782fcf38328'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:13.400318 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-65487ac5-5170-4069-82c6-02b464ab6c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56dceecca90c42e88611c782fcf38328'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:13.479101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-65487ac5-5170-4069-82c6-02b464ab6c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56dceecca90c42e88611c782fcf38328'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:13.503922 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1256/2530] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:10:13 2022] DELETE /identity/v3/users/56dceecca90c42e88611c782fcf38328 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:13.508678 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bb7ea-ff40-44f3-94c4-4238a8b5e3d9 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:13.509805 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bb7ea-ff40-44f3-94c4-4238a8b5e3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:13.510321 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bb7ea-ff40-44f3-94c4-4238a8b5e3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:13.532143 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-c65bb7ea-ff40-44f3-94c4-4238a8b5e3d9 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:13.533409 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c65bb7ea-ff40-44f3-94c4-4238a8b5e3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:13.539870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:13.601767 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1275/2531] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:13.615251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65487ac5-5170-4069-82c6-02b464ab6c5a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:13.620061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-65487ac5-5170-4069-82c6-02b464ab6c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:13.681907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65487ac5-5170-4069-82c6-02b464ab6c5a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:13.685619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384509-9f82-4a53-bd6c-14382412ac55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:13.686303 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384509-9f82-4a53-bd6c-14382412ac55 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:13.686602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384509-9f82-4a53-bd6c-14382412ac55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:13.686878 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384509-9f82-4a53-bd6c-14382412ac55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:13.696643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36384509-9f82-4a53-bd6c-14382412ac55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:13.698124 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36384509-9f82-4a53-bd6c-14382412ac55 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:13.708861 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1257/2532] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:14.154756 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bb7ea-ff40-44f3-94c4-4238a8b5e3d9 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:14.156209 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c65bb7ea-ff40-44f3-94c4-4238a8b5e3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:14.171907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bb7ea-ff40-44f3-94c4-4238a8b5e3d9 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:14.177668 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:14.178554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:14.178842 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:14.179124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae admin admin] PATH_INFO: `/v3/projects/5b4fb17444b44cb9b95ec3d89e5e5d6d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:14.180415 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b4fb17444b44cb9b95ec3d89e5e5d6d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:14.182422 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:14.313489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b4fb17444b44cb9b95ec3d89e5e5d6d', 'request_id': 'req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:14.320305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b4fb17444b44cb9b95ec3d89e5e5d6d', 'request_id': 'req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:14.328333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b4fb17444b44cb9b95ec3d89e5e5d6d', 'request_id': 'req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:14.418371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae admin admin] The token cache is being invalidate because project 5b4fb17444b44cb9b95ec3d89e5e5d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:10:14.418669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:14.419354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:14.421651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1276/2533] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:10:14 2022] DELETE /identity/v3/projects/5b4fb17444b44cb9b95ec3d89e5e5d6d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:14.434543 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384509-9f82-4a53-bd6c-14382412ac55 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:14.461122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384509-9f82-4a53-bd6c-14382412ac55 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:14.579396 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae52625-58ad-4ffc-b178-822d81598a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:14.580901 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae52625-58ad-4ffc-b178-822d81598a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:14.583349 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae52625-58ad-4ffc-b178-822d81598a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:14.590399 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae52625-58ad-4ffc-b178-822d81598a33 admin admin] PATH_INFO: `/v3/users/76e1429775b142b99f31681d72ba594e` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:14.590399 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae52625-58ad-4ffc-b178-822d81598a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e1429775b142b99f31681d72ba594e)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:14.593515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae52625-58ad-4ffc-b178-822d81598a33 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:14.900930 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:14.903431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-aae52625-58ad-4ffc-b178-822d81598a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e1429775b142b99f31681d72ba594e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:14.904121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-aae52625-58ad-4ffc-b178-822d81598a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e1429775b142b99f31681d72ba594e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:14.915881 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-aae52625-58ad-4ffc-b178-822d81598a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e1429775b142b99f31681d72ba594e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:14.916636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-aae52625-58ad-4ffc-b178-822d81598a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e1429775b142b99f31681d72ba594e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:15.042833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-aae52625-58ad-4ffc-b178-822d81598a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e1429775b142b99f31681d72ba594e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:15.078825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1258/2534] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:10:14 2022] DELETE /identity/v3/users/76e1429775b142b99f31681d72ba594e => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:15.557553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:15.559473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:15.574771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfafa9d-cadf-4e4b-b681-7b23d5498eae admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:15.656507 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190eb24e-75af-4961-bb02-134f256b1d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:15.657048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190eb24e-75af-4961-bb02-134f256b1d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:15.657464 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190eb24e-75af-4961-bb02-134f256b1d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:15.657845 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190eb24e-75af-4961-bb02-134f256b1d88 admin admin] PATH_INFO: `/v3/projects/1f09cba22b784c109c37e53cceb0efdb` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:15.659202 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190eb24e-75af-4961-bb02-134f256b1d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f09cba22b784c109c37e53cceb0efdb)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:15.661436 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190eb24e-75af-4961-bb02-134f256b1d88 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:15.799495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae52625-58ad-4ffc-b178-822d81598a33 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:15.801068 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-aae52625-58ad-4ffc-b178-822d81598a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:15.823349 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:15.835538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-190eb24e-75af-4961-bb02-134f256b1d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f09cba22b784c109c37e53cceb0efdb', 'request_id': 'req-190eb24e-75af-4961-bb02-134f256b1d88'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:15.843626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-190eb24e-75af-4961-bb02-134f256b1d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f09cba22b784c109c37e53cceb0efdb', 'request_id': 'req-190eb24e-75af-4961-bb02-134f256b1d88'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:15.850651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-190eb24e-75af-4961-bb02-134f256b1d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f09cba22b784c109c37e53cceb0efdb', 'request_id': 'req-190eb24e-75af-4961-bb02-134f256b1d88'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:15.871535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae52625-58ad-4ffc-b178-822d81598a33 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:15.924089 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eabe0c-9274-4314-83c5-a9f95ed84429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:15.924778 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eabe0c-9274-4314-83c5-a9f95ed84429 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:15.925068 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eabe0c-9274-4314-83c5-a9f95ed84429 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:15.925388 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eabe0c-9274-4314-83c5-a9f95ed84429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:15.927206 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-80eabe0c-9274-4314-83c5-a9f95ed84429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:15.935252 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-190eb24e-75af-4961-bb02-134f256b1d88 admin admin] The token cache is being invalidate because project 1f09cba22b784c109c37e53cceb0efdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:10:15.935841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-190eb24e-75af-4961-bb02-134f256b1d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:15.941490 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-190eb24e-75af-4961-bb02-134f256b1d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:15.941490 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1277/2535] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:10:15 2022] DELETE /identity/v3/projects/1f09cba22b784c109c37e53cceb0efdb => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:15.943695 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190eb24e-75af-4961-bb02-134f256b1d88 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:15.945445 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-190eb24e-75af-4961-bb02-134f256b1d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:16.013668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eabe0c-9274-4314-83c5-a9f95ed84429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:16.015519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eabe0c-9274-4314-83c5-a9f95ed84429 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:16.025525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190eb24e-75af-4961-bb02-134f256b1d88 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:16.027131 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1259/2536] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:10:16.034019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc360e-e5c8-4e13-b92a-83d72924ccbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:16.034792 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc360e-e5c8-4e13-b92a-83d72924ccbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:16.034792 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc360e-e5c8-4e13-b92a-83d72924ccbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:16.034792 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc360e-e5c8-4e13-b92a-83d72924ccbf admin admin] PATH_INFO: `/v3/users/005c9c1de16341faa182d157e90a2cfc` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:16.036120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc360e-e5c8-4e13-b92a-83d72924ccbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=005c9c1de16341faa182d157e90a2cfc)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:16.038164 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc360e-e5c8-4e13-b92a-83d72924ccbf admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:16.282946 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-17cc360e-e5c8-4e13-b92a-83d72924ccbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '005c9c1de16341faa182d157e90a2cfc'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:16.290569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-17cc360e-e5c8-4e13-b92a-83d72924ccbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '005c9c1de16341faa182d157e90a2cfc'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:16.291308 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-17cc360e-e5c8-4e13-b92a-83d72924ccbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '005c9c1de16341faa182d157e90a2cfc'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:16.305823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-17cc360e-e5c8-4e13-b92a-83d72924ccbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '005c9c1de16341faa182d157e90a2cfc'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:16.306654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-17cc360e-e5c8-4e13-b92a-83d72924ccbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '005c9c1de16341faa182d157e90a2cfc'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:16.393474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1278/2537] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:10:15 2022] DELETE /identity/v3/users/005c9c1de16341faa182d157e90a2cfc => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:17.074208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eabe0c-9274-4314-83c5-a9f95ed84429 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:17.075793 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-80eabe0c-9274-4314-83c5-a9f95ed84429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:17.093282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eabe0c-9274-4314-83c5-a9f95ed84429 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:17.119152 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:17.175998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbc031-8f67-4517-bcd7-a717b56baf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:17.177249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbc031-8f67-4517-bcd7-a717b56baf26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:17.177979 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbc031-8f67-4517-bcd7-a717b56baf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:17.177979 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbc031-8f67-4517-bcd7-a717b56baf26 admin admin] PATH_INFO: `/v3/projects/9c0f78cb60ff4fc592f74749ca1211d0` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:17.182618 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbc031-8f67-4517-bcd7-a717b56baf26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c0f78cb60ff4fc592f74749ca1211d0)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:17.182618 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbc031-8f67-4517-bcd7-a717b56baf26 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:17.298786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c3cbc031-8f67-4517-bcd7-a717b56baf26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c0f78cb60ff4fc592f74749ca1211d0', 'request_id': 'req-c3cbc031-8f67-4517-bcd7-a717b56baf26'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:17.306028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c3cbc031-8f67-4517-bcd7-a717b56baf26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c0f78cb60ff4fc592f74749ca1211d0', 'request_id': 'req-c3cbc031-8f67-4517-bcd7-a717b56baf26'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:17.313249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c3cbc031-8f67-4517-bcd7-a717b56baf26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c0f78cb60ff4fc592f74749ca1211d0', 'request_id': 'req-c3cbc031-8f67-4517-bcd7-a717b56baf26'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:17.391318 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c3cbc031-8f67-4517-bcd7-a717b56baf26 admin admin] The token cache is being invalidate because project 9c0f78cb60ff4fc592f74749ca1211d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:10:17.391525 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c3cbc031-8f67-4517-bcd7-a717b56baf26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:17.393068 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c3cbc031-8f67-4517-bcd7-a717b56baf26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:17.400986 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1260/2538] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:10:17 2022] DELETE /identity/v3/projects/9c0f78cb60ff4fc592f74749ca1211d0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:17.402833 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c430f-1216-4c7b-ad2b-b2e4deb8c0ce None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:17.403287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c430f-1216-4c7b-ad2b-b2e4deb8c0ce None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:17.403411 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c430f-1216-4c7b-ad2b-b2e4deb8c0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:17.427184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-fa7c430f-1216-4c7b-ad2b-b2e4deb8c0ce None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:17.428582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fa7c430f-1216-4c7b-ad2b-b2e4deb8c0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:17.473348 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:17.496969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1279/2539] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:17.505652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b54a-9a96-4bb8-8346-410fbf46ba97 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:17.506045 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b54a-9a96-4bb8-8346-410fbf46ba97 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:17.506405 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b54a-9a96-4bb8-8346-410fbf46ba97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:17.526336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-c070b54a-9a96-4bb8-8346-410fbf46ba97 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:17.527738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c070b54a-9a96-4bb8-8346-410fbf46ba97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:17.535925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1261/2540] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:17.540395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c430f-1216-4c7b-ad2b-b2e4deb8c0ce None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:17.551026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c430f-1216-4c7b-ad2b-b2e4deb8c0ce None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:17.556196 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effc766-43b1-47a1-85dc-47f688c2ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:17.557175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effc766-43b1-47a1-85dc-47f688c2ce0e admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:17.560452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effc766-43b1-47a1-85dc-47f688c2ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:17.560452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effc766-43b1-47a1-85dc-47f688c2ce0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:17.560452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effc766-43b1-47a1-85dc-47f688c2ce0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:10:17.560452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effc766-43b1-47a1-85dc-47f688c2ce0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:17.561707 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effc766-43b1-47a1-85dc-47f688c2ce0e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:17.573840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1280/2541] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:10:17.578267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b54a-9a96-4bb8-8346-410fbf46ba97 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:17.587996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b54a-9a96-4bb8-8346-410fbf46ba97 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:17.592850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead49ed4-0fee-468f-9015-feba745fa465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:17.593623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead49ed4-0fee-468f-9015-feba745fa465 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:17.593907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead49ed4-0fee-468f-9015-feba745fa465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:17.594184 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead49ed4-0fee-468f-9015-feba745fa465 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:17.594895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead49ed4-0fee-468f-9015-feba745fa465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:17.597198 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead49ed4-0fee-468f-9015-feba745fa465 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:17.701754 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1262/2542] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:10:17 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:17.706064 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effc766-43b1-47a1-85dc-47f688c2ce0e admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:17.717895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effc766-43b1-47a1-85dc-47f688c2ce0e admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:17.784603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80fc78-1732-4866-a469-3773445dc0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:17.785326 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80fc78-1732-4866-a469-3773445dc0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:17.785645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80fc78-1732-4866-a469-3773445dc0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:17.785930 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80fc78-1732-4866-a469-3773445dc0e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:17.786647 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80fc78-1732-4866-a469-3773445dc0e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:17.788605 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80fc78-1732-4866-a469-3773445dc0e6 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:17.902341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1281/2543] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:10:17 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:17.907378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead49ed4-0fee-468f-9015-feba745fa465 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:17.919541 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead49ed4-0fee-468f-9015-feba745fa465 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:17.926646 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d50a42-bb76-4d90-9899-0043b6c116fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:17.927381 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d50a42-bb76-4d90-9899-0043b6c116fa admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:17.931274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d50a42-bb76-4d90-9899-0043b6c116fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:17.931274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d50a42-bb76-4d90-9899-0043b6c116fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:17.931274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d50a42-bb76-4d90-9899-0043b6c116fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:17.931274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d50a42-bb76-4d90-9899-0043b6c116fa admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:17.951280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1263/2544] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:17.953397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80fc78-1732-4866-a469-3773445dc0e6 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:17.977315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80fc78-1732-4866-a469-3773445dc0e6 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:17.991470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9849a-26e8-4766-8bff-e423f2bae6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:17.991470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9849a-26e8-4766-8bff-e423f2bae6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:17.991470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9849a-26e8-4766-8bff-e423f2bae6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:17.991470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9849a-26e8-4766-8bff-e423f2bae6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:17.992940 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9849a-26e8-4766-8bff-e423f2bae6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:17.992940 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9849a-26e8-4766-8bff-e423f2bae6e9 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:18.003642 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1282/2545] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:18.008934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d50a42-bb76-4d90-9899-0043b6c116fa admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:18.020040 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d50a42-bb76-4d90-9899-0043b6c116fa admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:18.025442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5031a52-aba4-4534-a7af-1398344d0b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:18.027966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5031a52-aba4-4534-a7af-1398344d0b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:18.027966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5031a52-aba4-4534-a7af-1398344d0b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:18.027966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5031a52-aba4-4534-a7af-1398344d0b64 admin admin] PATH_INFO: `/v3/projects/cc16fb5ac2884663ad32205cdc0c518d/users/51d196791f0a4cc4b150bc6330996752/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:18.051034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5031a52-aba4-4534-a7af-1398344d0b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc16fb5ac2884663ad32205cdc0c518d, user_id=51d196791f0a4cc4b150bc6330996752, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:18.054096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5031a52-aba4-4534-a7af-1398344d0b64 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:18.150040 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1264/2546] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:18 2022] PUT /identity/v3/projects/cc16fb5ac2884663ad32205cdc0c518d/users/51d196791f0a4cc4b150bc6330996752/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:18.162739 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9eeef-92b0-482f-851e-6c2314241088 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:18.163029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9eeef-92b0-482f-851e-6c2314241088 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:18.163571 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9eeef-92b0-482f-851e-6c2314241088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:18.194198 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-8fc9eeef-92b0-482f-851e-6c2314241088 None None] MFA Rules not processed for user `51d196791f0a4cc4b150bc6330996752`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:18.195446 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-8fc9eeef-92b0-482f-851e-6c2314241088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:18.296425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1283/2547] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:18.302113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5031a52-aba4-4534-a7af-1398344d0b64 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:18.386058 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:18.398876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5031a52-aba4-4534-a7af-1398344d0b64 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:18.406939 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee93d39-71d5-4525-b4cf-6020aa877837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:18.407920 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee93d39-71d5-4525-b4cf-6020aa877837 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:18.408338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee93d39-71d5-4525-b4cf-6020aa877837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:18.408622 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee93d39-71d5-4525-b4cf-6020aa877837 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:18.409431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee93d39-71d5-4525-b4cf-6020aa877837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:18.414911 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee93d39-71d5-4525-b4cf-6020aa877837 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:18.536676 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1265/2548] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:10:18 2022] POST /identity/v3/projects => generated 389 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:18.540639 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9eeef-92b0-482f-851e-6c2314241088 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:18.553353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9eeef-92b0-482f-851e-6c2314241088 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:18.606865 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:18.629817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77a2b9-c438-42c7-99fd-bbb3c6dc8ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:18.630556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77a2b9-c438-42c7-99fd-bbb3c6dc8ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:18.630846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77a2b9-c438-42c7-99fd-bbb3c6dc8ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:18.631290 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77a2b9-c438-42c7-99fd-bbb3c6dc8ae9 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:18.632072 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77a2b9-c438-42c7-99fd-bbb3c6dc8ae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:18.634113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77a2b9-c438-42c7-99fd-bbb3c6dc8ae9 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:18.749223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1284/2549] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:10:18 2022] POST /identity/v3/users => generated 301 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:18.750828 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee93d39-71d5-4525-b4cf-6020aa877837 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:18.761725 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee93d39-71d5-4525-b4cf-6020aa877837 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:18.767306 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56135d4a-63d9-40a5-b418-a86a0b44d481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:18.767990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135d4a-63d9-40a5-b418-a86a0b44d481 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:18.768282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135d4a-63d9-40a5-b418-a86a0b44d481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:18.768636 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135d4a-63d9-40a5-b418-a86a0b44d481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:18.772129 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56135d4a-63d9-40a5-b418-a86a0b44d481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:18.772129 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56135d4a-63d9-40a5-b418-a86a0b44d481 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:18.782999 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1266/2550] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:18.787070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77a2b9-c438-42c7-99fd-bbb3c6dc8ae9 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:18.799459 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77a2b9-c438-42c7-99fd-bbb3c6dc8ae9 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:18.804701 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78deeda-b456-468c-99fa-b3f2874343d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:18.805715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78deeda-b456-468c-99fa-b3f2874343d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:18.806031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78deeda-b456-468c-99fa-b3f2874343d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:18.806381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78deeda-b456-468c-99fa-b3f2874343d0 admin admin] PATH_INFO: `/v3/projects/3bb77b09e77f4c91bcae21b841ef555c/users/4c308830cf1a426091a24507316b4116/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:18.823059 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78deeda-b456-468c-99fa-b3f2874343d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb77b09e77f4c91bcae21b841ef555c, user_id=4c308830cf1a426091a24507316b4116, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:18.825864 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78deeda-b456-468c-99fa-b3f2874343d0 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:18.895118 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1285/2551] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:18 2022] PUT /identity/v3/projects/3bb77b09e77f4c91bcae21b841ef555c/users/4c308830cf1a426091a24507316b4116/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:18.898855 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56135d4a-63d9-40a5-b418-a86a0b44d481 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:18.913884 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56135d4a-63d9-40a5-b418-a86a0b44d481 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:18.993477 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0f9c1-d483-476c-9538-2d0e1102479e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:18.994165 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0f9c1-d483-476c-9538-2d0e1102479e admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:18.994452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0f9c1-d483-476c-9538-2d0e1102479e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:18.994742 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0f9c1-d483-476c-9538-2d0e1102479e admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:18.995476 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf0f9c1-d483-476c-9538-2d0e1102479e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:18.997392 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf0f9c1-d483-476c-9538-2d0e1102479e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:19.012481 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1267/2552] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:19.015792 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78deeda-b456-468c-99fa-b3f2874343d0 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:19.027024 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78deeda-b456-468c-99fa-b3f2874343d0 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:19.032823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff6415-0d7b-4ca9-943f-db2849b0f01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:19.038218 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff6415-0d7b-4ca9-943f-db2849b0f01b admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:19.038218 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff6415-0d7b-4ca9-943f-db2849b0f01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:19.038218 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff6415-0d7b-4ca9-943f-db2849b0f01b admin admin] PATH_INFO: `/v3/projects/3bb77b09e77f4c91bcae21b841ef555c/users/4c308830cf1a426091a24507316b4116/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:19.038218 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff6415-0d7b-4ca9-943f-db2849b0f01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb77b09e77f4c91bcae21b841ef555c, user_id=4c308830cf1a426091a24507316b4116, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:19.040526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff6415-0d7b-4ca9-943f-db2849b0f01b admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:19.052432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1286/2553] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:19 2022] PUT /identity/v3/projects/3bb77b09e77f4c91bcae21b841ef555c/users/4c308830cf1a426091a24507316b4116/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:19.063482 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb81a2-6a5d-4556-b536-dc24a7aa3033 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:19.066883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb81a2-6a5d-4556-b536-dc24a7aa3033 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:19.066883 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb81a2-6a5d-4556-b536-dc24a7aa3033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:19.097299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-13cb81a2-6a5d-4556-b536-dc24a7aa3033 None None] MFA Rules not processed for user `4c308830cf1a426091a24507316b4116`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:19.100685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-13cb81a2-6a5d-4556-b536-dc24a7aa3033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:19.212553 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1268/2554] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:19.224863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff6415-0d7b-4ca9-943f-db2849b0f01b admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:19.226952 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9bff6415-0d7b-4ca9-943f-db2849b0f01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:19.327973 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff6415-0d7b-4ca9-943f-db2849b0f01b admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:19.332118 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e8b72-f0da-48c8-9b2b-71a5de130b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:19.332823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e8b72-f0da-48c8-9b2b-71a5de130b80 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:19.333112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e8b72-f0da-48c8-9b2b-71a5de130b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:19.333444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e8b72-f0da-48c8-9b2b-71a5de130b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:19.345899 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e8b72-f0da-48c8-9b2b-71a5de130b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:19.347496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e8b72-f0da-48c8-9b2b-71a5de130b80 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:19.358938 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1287/2555] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:19.443475 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb81a2-6a5d-4556-b536-dc24a7aa3033 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:19.444839 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-13cb81a2-6a5d-4556-b536-dc24a7aa3033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:19.459706 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb81a2-6a5d-4556-b536-dc24a7aa3033 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:19.465686 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defd636-44ef-4d5f-92e0-77521151abb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:19.466425 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defd636-44ef-4d5f-92e0-77521151abb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:19.466719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defd636-44ef-4d5f-92e0-77521151abb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:19.467002 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defd636-44ef-4d5f-92e0-77521151abb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:19.516861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e8b72-f0da-48c8-9b2b-71a5de130b80 service cinder] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:19.518682 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-306e8b72-f0da-48c8-9b2b-71a5de130b80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:19.572682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:19.595349 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defd636-44ef-4d5f-92e0-77521151abb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:19.596858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defd636-44ef-4d5f-92e0-77521151abb2 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:19.612206 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1269/2556] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:19.627345 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e8b72-f0da-48c8-9b2b-71a5de130b80 service cinder] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:19.632048 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96a257-e9f9-4e51-b0e0-99ea31fa0048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:19.632721 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96a257-e9f9-4e51-b0e0-99ea31fa0048 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:19.633007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96a257-e9f9-4e51-b0e0-99ea31fa0048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:19.633607 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96a257-e9f9-4e51-b0e0-99ea31fa0048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:19.635544 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4c96a257-e9f9-4e51-b0e0-99ea31fa0048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:19.709582 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:19.733460 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96a257-e9f9-4e51-b0e0-99ea31fa0048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:19.736303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96a257-e9f9-4e51-b0e0-99ea31fa0048 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:19.750909 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1288/2557] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:10:22.273681 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b66c90-2871-4b7f-ab8b-4c890467fd56 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:22.277076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b66c90-2871-4b7f-ab8b-4c890467fd56 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:22.277076 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b66c90-2871-4b7f-ab8b-4c890467fd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:22.306062 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-50b66c90-2871-4b7f-ab8b-4c890467fd56 None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:22.308438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-50b66c90-2871-4b7f-ab8b-4c890467fd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:22.418634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1270/2558] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 16 15:10:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:22.431850 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96a257-e9f9-4e51-b0e0-99ea31fa0048 service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:22.433597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4c96a257-e9f9-4e51-b0e0-99ea31fa0048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:22.519733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96a257-e9f9-4e51-b0e0-99ea31fa0048 service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:22.525387 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bce694-ab3f-4d75-b4bb-60a7709af775 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:22.529416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bce694-ab3f-4d75-b4bb-60a7709af775 service swift] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:22.529416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bce694-ab3f-4d75-b4bb-60a7709af775 service swift] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:22.529416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bce694-ab3f-4d75-b4bb-60a7709af775 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:22.543157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bce694-ab3f-4d75-b4bb-60a7709af775 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:22.548667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bce694-ab3f-4d75-b4bb-60a7709af775 service swift] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:22.564485 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1289/2559] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 15:10:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:10:24.195747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b66c90-2871-4b7f-ab8b-4c890467fd56 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:24.195747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-50b66c90-2871-4b7f-ab8b-4c890467fd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:24.453913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b66c90-2871-4b7f-ab8b-4c890467fd56 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:24.484474 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77720a-2b6b-4dcc-a720-1ff97ebf4b8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:24.485477 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77720a-2b6b-4dcc-a720-1ff97ebf4b8c service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:24.485666 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77720a-2b6b-4dcc-a720-1ff97ebf4b8c service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:24.485878 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77720a-2b6b-4dcc-a720-1ff97ebf4b8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:24.498743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-5f77720a-2b6b-4dcc-a720-1ff97ebf4b8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:24.548538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77720a-2b6b-4dcc-a720-1ff97ebf4b8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:24.548538 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77720a-2b6b-4dcc-a720-1ff97ebf4b8c service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:24.574041 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1271/2560] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:25.632356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bce694-ab3f-4d75-b4bb-60a7709af775 service swift] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:25.634442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-d1bce694-ab3f-4d75-b4bb-60a7709af775 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:25.775681 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bce694-ab3f-4d75-b4bb-60a7709af775 service swift] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:25.791212 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd539a50-5ed8-4777-a433-f329174b2e4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534035b2e8cf4f769e3dbbaabc0f6ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:25.792757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd539a50-5ed8-4777-a433-f329174b2e4c service placement] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:25.793290 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd539a50-5ed8-4777-a433-f329174b2e4c service placement] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:25.797673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd539a50-5ed8-4777-a433-f329174b2e4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:25.800052 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-bd539a50-5ed8-4777-a433-f329174b2e4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:25.832557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd539a50-5ed8-4777-a433-f329174b2e4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:25.837329 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd539a50-5ed8-4777-a433-f329174b2e4c service placement] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:25.852679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77720a-2b6b-4dcc-a720-1ff97ebf4b8c service nova] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:25.854469 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-5f77720a-2b6b-4dcc-a720-1ff97ebf4b8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:25.884552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77720a-2b6b-4dcc-a720-1ff97ebf4b8c service nova] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:25.895831 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1290/2561] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:25.900346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa3e66-ce43-47e8-96dd-98844a4e9e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:25.902455 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa3e66-ce43-47e8-96dd-98844a4e9e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:25.902970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa3e66-ce43-47e8-96dd-98844a4e9e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:25.904259 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa3e66-ce43-47e8-96dd-98844a4e9e09 admin admin] PATH_INFO: `/v3/users/538cc13998f14a3ba870184f18648526` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:25.910437 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa3e66-ce43-47e8-96dd-98844a4e9e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=538cc13998f14a3ba870184f18648526)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:25.916642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa3e66-ce43-47e8-96dd-98844a4e9e09 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:26.187116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6baa3e66-ce43-47e8-96dd-98844a4e9e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538cc13998f14a3ba870184f18648526'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:26.188825 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6baa3e66-ce43-47e8-96dd-98844a4e9e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538cc13998f14a3ba870184f18648526'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:26.207909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6baa3e66-ce43-47e8-96dd-98844a4e9e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538cc13998f14a3ba870184f18648526'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:26.212892 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6baa3e66-ce43-47e8-96dd-98844a4e9e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538cc13998f14a3ba870184f18648526'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:26.302648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6baa3e66-ce43-47e8-96dd-98844a4e9e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538cc13998f14a3ba870184f18648526'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:26.314849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:26.329295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1272/2562] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:10:25 2022] DELETE /identity/v3/users/538cc13998f14a3ba870184f18648526 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:26.641639 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd539a50-5ed8-4777-a433-f329174b2e4c service placement] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:26.652588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa3e66-ce43-47e8-96dd-98844a4e9e09 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:26.660845 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-6baa3e66-ce43-47e8-96dd-98844a4e9e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:26.665780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd539a50-5ed8-4777-a433-f329174b2e4c service placement] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:26.792738 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53edebb-0b1d-4bdf-af1e-f1495906dad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:26.794020 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53edebb-0b1d-4bdf-af1e-f1495906dad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:26.794691 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53edebb-0b1d-4bdf-af1e-f1495906dad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:26.795310 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53edebb-0b1d-4bdf-af1e-f1495906dad7 admin admin] PATH_INFO: `/v3/projects/6f72325fb32840f1bcf296f6b2ea6e38` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:26.797460 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53edebb-0b1d-4bdf-af1e-f1495906dad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f72325fb32840f1bcf296f6b2ea6e38)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:26.798746 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa3e66-ce43-47e8-96dd-98844a4e9e09 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:26.799626 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53edebb-0b1d-4bdf-af1e-f1495906dad7 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:26.806169 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34844df4-bf57-4d6d-bd2a-b25ad4eb0e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:26.807081 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844df4-bf57-4d6d-bd2a-b25ad4eb0e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:26.807516 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844df4-bf57-4d6d-bd2a-b25ad4eb0e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:26.807808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34844df4-bf57-4d6d-bd2a-b25ad4eb0e9d admin admin] PATH_INFO: `/v3/users/51d196791f0a4cc4b150bc6330996752` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:26.809087 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34844df4-bf57-4d6d-bd2a-b25ad4eb0e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d196791f0a4cc4b150bc6330996752)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:26.810789 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:26.811670 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34844df4-bf57-4d6d-bd2a-b25ad4eb0e9d admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:26.985164 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a53edebb-0b1d-4bdf-af1e-f1495906dad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f72325fb32840f1bcf296f6b2ea6e38', 'request_id': 'req-a53edebb-0b1d-4bdf-af1e-f1495906dad7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:26.985164 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a53edebb-0b1d-4bdf-af1e-f1495906dad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f72325fb32840f1bcf296f6b2ea6e38', 'request_id': 'req-a53edebb-0b1d-4bdf-af1e-f1495906dad7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:26.989570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a53edebb-0b1d-4bdf-af1e-f1495906dad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f72325fb32840f1bcf296f6b2ea6e38', 'request_id': 'req-a53edebb-0b1d-4bdf-af1e-f1495906dad7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:27.037864 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-34844df4-bf57-4d6d-bd2a-b25ad4eb0e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d196791f0a4cc4b150bc6330996752'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:27.040003 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-34844df4-bf57-4d6d-bd2a-b25ad4eb0e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d196791f0a4cc4b150bc6330996752'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:27.049221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-34844df4-bf57-4d6d-bd2a-b25ad4eb0e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d196791f0a4cc4b150bc6330996752'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:27.050124 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-34844df4-bf57-4d6d-bd2a-b25ad4eb0e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d196791f0a4cc4b150bc6330996752'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:27.061001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a53edebb-0b1d-4bdf-af1e-f1495906dad7 admin admin] The token cache is being invalidate because project 6f72325fb32840f1bcf296f6b2ea6e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:10:27.061496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a53edebb-0b1d-4bdf-af1e-f1495906dad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:27.062305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a53edebb-0b1d-4bdf-af1e-f1495906dad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:27.067846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1291/2563] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:10:26 2022] DELETE /identity/v3/projects/6f72325fb32840f1bcf296f6b2ea6e38 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:27.071561 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6eb59-c18c-49a9-837d-e3d65ad942f4 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:27.071561 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6eb59-c18c-49a9-837d-e3d65ad942f4 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:27.071561 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6eb59-c18c-49a9-837d-e3d65ad942f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:27.095558 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-67a6eb59-c18c-49a9-837d-e3d65ad942f4 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:27.096851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-67a6eb59-c18c-49a9-837d-e3d65ad942f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:27.153628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-34844df4-bf57-4d6d-bd2a-b25ad4eb0e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d196791f0a4cc4b150bc6330996752'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:27.174901 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1273/2564] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:10:26 2022] DELETE /identity/v3/users/51d196791f0a4cc4b150bc6330996752 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:27.180271 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc83d-5aa9-4624-9dd3-d248621b19f4 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:27.180543 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc83d-5aa9-4624-9dd3-d248621b19f4 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:27.180821 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc83d-5aa9-4624-9dd3-d248621b19f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:27.188506 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1292/2565] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:27.190666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce41a5-8653-4dd5-90d2-515f8efe8055 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:27.215553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce41a5-8653-4dd5-90d2-515f8efe8055 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:27.215553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce41a5-8653-4dd5-90d2-515f8efe8055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:27.215815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-78edc83d-5aa9-4624-9dd3-d248621b19f4 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:27.215815 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-78edc83d-5aa9-4624-9dd3-d248621b19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:27.216026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-5cce41a5-8653-4dd5-90d2-515f8efe8055 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:27.216026 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5cce41a5-8653-4dd5-90d2-515f8efe8055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:27.274066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1274/2566] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:27.286235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edc83d-5aa9-4624-9dd3-d248621b19f4 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:27.286985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1293/2567] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:10:27.289058 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-78edc83d-5aa9-4624-9dd3-d248621b19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:27.291399 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce41a5-8653-4dd5-90d2-515f8efe8055 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:27.302053 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce41a5-8653-4dd5-90d2-515f8efe8055 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:27.304619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:27.308312 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac7f9c-028e-498d-9f05-47142e804ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:27.309195 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac7f9c-028e-498d-9f05-47142e804ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:27.309591 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac7f9c-028e-498d-9f05-47142e804ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:27.309969 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac7f9c-028e-498d-9f05-47142e804ae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:27.311757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac7f9c-028e-498d-9f05-47142e804ae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:10:27.312398 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac7f9c-028e-498d-9f05-47142e804ae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:27.314575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac7f9c-028e-498d-9f05-47142e804ae5 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:27.330418 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1294/2568] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:10:27.337735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac7f9c-028e-498d-9f05-47142e804ae5 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:27.354235 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac7f9c-028e-498d-9f05-47142e804ae5 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:27.360916 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c780f-2b6e-4198-99d0-1feff974f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:27.361639 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c780f-2b6e-4198-99d0-1feff974f997 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:27.361931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c780f-2b6e-4198-99d0-1feff974f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:27.362331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c780f-2b6e-4198-99d0-1feff974f997 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:27.363037 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c780f-2b6e-4198-99d0-1feff974f997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:27.364974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c780f-2b6e-4198-99d0-1feff974f997 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:27.374795 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edc83d-5aa9-4624-9dd3-d248621b19f4 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:27.378653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590f3cf-2a22-4bb3-ba44-47c725644dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:27.379354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590f3cf-2a22-4bb3-ba44-47c725644dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:27.379643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590f3cf-2a22-4bb3-ba44-47c725644dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:27.379927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590f3cf-2a22-4bb3-ba44-47c725644dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:27.390084 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590f3cf-2a22-4bb3-ba44-47c725644dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:27.391520 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590f3cf-2a22-4bb3-ba44-47c725644dd1 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:27.401866 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1275/2569] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:10:27.659470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:27.669727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1295/2570] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:10:27 2022] POST /identity/v3/projects => generated 363 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:10:27.670831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590f3cf-2a22-4bb3-ba44-47c725644dd1 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:27.680490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590f3cf-2a22-4bb3-ba44-47c725644dd1 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:27.777445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a5f8b-7d1b-49e4-849a-bfed42c520a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:27.778186 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a5f8b-7d1b-49e4-849a-bfed42c520a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:27.778478 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a5f8b-7d1b-49e4-849a-bfed42c520a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:27.778763 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a5f8b-7d1b-49e4-849a-bfed42c520a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:27.779485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a5f8b-7d1b-49e4-849a-bfed42c520a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:27.783018 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a5f8b-7d1b-49e4-849a-bfed42c520a4 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:27.893716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1276/2571] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:10:27 2022] POST /identity/v3/users => generated 282 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:10:27.894959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c780f-2b6e-4198-99d0-1feff974f997 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:27.909436 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c780f-2b6e-4198-99d0-1feff974f997 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:27.914878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a329ae-169a-456a-8771-b51f9a251c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:27.917731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a329ae-169a-456a-8771-b51f9a251c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:27.917731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a329ae-169a-456a-8771-b51f9a251c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:27.917731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a329ae-169a-456a-8771-b51f9a251c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:27.917731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a329ae-169a-456a-8771-b51f9a251c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:27.918912 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a329ae-169a-456a-8771-b51f9a251c0e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:27.933019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1296/2572] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:27.937357 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a5f8b-7d1b-49e4-849a-bfed42c520a4 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:27.952474 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a5f8b-7d1b-49e4-849a-bfed42c520a4 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:27.958073 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db047e1c-5546-4d71-b184-6c35bb82b804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:27.958986 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db047e1c-5546-4d71-b184-6c35bb82b804 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:27.959375 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db047e1c-5546-4d71-b184-6c35bb82b804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:27.959762 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db047e1c-5546-4d71-b184-6c35bb82b804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:27.960620 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db047e1c-5546-4d71-b184-6c35bb82b804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:27.968884 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db047e1c-5546-4d71-b184-6c35bb82b804 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:27.972916 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a329ae-169a-456a-8771-b51f9a251c0e admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:27.974929 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-f7a329ae-169a-456a-8771-b51f9a251c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:27.979887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1277/2573] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:27.982052 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db047e1c-5546-4d71-b184-6c35bb82b804 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:28.001983 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a329ae-169a-456a-8771-b51f9a251c0e admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:28.007588 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62395d-44fc-4374-9f07-ab747987a94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:28.008666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62395d-44fc-4374-9f07-ab747987a94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:28.008997 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db047e1c-5546-4d71-b184-6c35bb82b804 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:28.009251 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62395d-44fc-4374-9f07-ab747987a94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:28.009536 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62395d-44fc-4374-9f07-ab747987a94f admin admin] PATH_INFO: `/v3/projects/cc16fb5ac2884663ad32205cdc0c518d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:28.010846 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62395d-44fc-4374-9f07-ab747987a94f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc16fb5ac2884663ad32205cdc0c518d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:28.012995 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62395d-44fc-4374-9f07-ab747987a94f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:28.029703 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db86369-cefb-4a07-a22c-7de24fc6cb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:28.031146 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86369-cefb-4a07-a22c-7de24fc6cb7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:28.031665 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86369-cefb-4a07-a22c-7de24fc6cb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:28.032147 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86369-cefb-4a07-a22c-7de24fc6cb7d admin admin] PATH_INFO: `/v3/projects/9eaf87089e794298a4dbeea48956b359/users/8b560a851301489ca128cd55e7ba997e/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:28.057842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db86369-cefb-4a07-a22c-7de24fc6cb7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eaf87089e794298a4dbeea48956b359, user_id=8b560a851301489ca128cd55e7ba997e, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:28.061656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db86369-cefb-4a07-a22c-7de24fc6cb7d admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:28.193544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1278/2574] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:27 2022] PUT /identity/v3/projects/9eaf87089e794298a4dbeea48956b359/users/8b560a851301489ca128cd55e7ba997e/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:28.195360 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b96b-47d8-4886-a932-e06b24ad5d90 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:28.195662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b96b-47d8-4886-a932-e06b24ad5d90 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:28.195951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b96b-47d8-4886-a932-e06b24ad5d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:28.226169 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ae62395d-44fc-4374-9f07-ab747987a94f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc16fb5ac2884663ad32205cdc0c518d', 'request_id': 'req-ae62395d-44fc-4374-9f07-ab747987a94f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:28.231497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-06c8b96b-47d8-4886-a932-e06b24ad5d90 None None] MFA Rules not processed for user `8b560a851301489ca128cd55e7ba997e`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:28.232751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-06c8b96b-47d8-4886-a932-e06b24ad5d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:28.239499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ae62395d-44fc-4374-9f07-ab747987a94f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc16fb5ac2884663ad32205cdc0c518d', 'request_id': 'req-ae62395d-44fc-4374-9f07-ab747987a94f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:28.252247 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ae62395d-44fc-4374-9f07-ab747987a94f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc16fb5ac2884663ad32205cdc0c518d', 'request_id': 'req-ae62395d-44fc-4374-9f07-ab747987a94f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:28.308243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:28.320870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1279/2575] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:10:28.325453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b96b-47d8-4886-a932-e06b24ad5d90 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:28.350926 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ae62395d-44fc-4374-9f07-ab747987a94f admin admin] The token cache is being invalidate because project cc16fb5ac2884663ad32205cdc0c518d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:10:28.356163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ae62395d-44fc-4374-9f07-ab747987a94f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:28.356163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ae62395d-44fc-4374-9f07-ab747987a94f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:28.358540 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1297/2576] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:10:27 2022] DELETE /identity/v3/projects/cc16fb5ac2884663ad32205cdc0c518d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:28.363971 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62395d-44fc-4374-9f07-ab747987a94f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:28.365481 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ae62395d-44fc-4374-9f07-ab747987a94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:28.411228 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b96b-47d8-4886-a932-e06b24ad5d90 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:28.421921 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d90c0-5454-46c9-be23-caa91e36aacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:28.422700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d90c0-5454-46c9-be23-caa91e36aacf admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:28.423026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d90c0-5454-46c9-be23-caa91e36aacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:28.423335 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d90c0-5454-46c9-be23-caa91e36aacf admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:28.424091 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d90c0-5454-46c9-be23-caa91e36aacf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:28.426641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d90c0-5454-46c9-be23-caa91e36aacf admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:28.466135 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62395d-44fc-4374-9f07-ab747987a94f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:28.472258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c22eda-c9a4-4c56-8087-7f1ea1886be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:28.475435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c22eda-c9a4-4c56-8087-7f1ea1886be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:28.475435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c22eda-c9a4-4c56-8087-7f1ea1886be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:28.475435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c22eda-c9a4-4c56-8087-7f1ea1886be9 admin admin] PATH_INFO: `/v3/users/4c308830cf1a426091a24507316b4116` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:28.475435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c22eda-c9a4-4c56-8087-7f1ea1886be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c308830cf1a426091a24507316b4116)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:28.478071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c22eda-c9a4-4c56-8087-7f1ea1886be9 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:28.555277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1280/2577] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:10:28 2022] POST /identity/v3/projects => generated 363 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:10:28.556278 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d90c0-5454-46c9-be23-caa91e36aacf admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:28.558559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e06d90c0-5454-46c9-be23-caa91e36aacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:28.669047 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d90c0-5454-46c9-be23-caa91e36aacf admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:28.679675 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0d476-362b-4927-bbb3-6782d5b37060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:28.680965 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0d476-362b-4927-bbb3-6782d5b37060 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:28.682895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0d476-362b-4927-bbb3-6782d5b37060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:28.683374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0d476-362b-4927-bbb3-6782d5b37060 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:28.685881 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0d476-362b-4927-bbb3-6782d5b37060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:28.690424 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0d476-362b-4927-bbb3-6782d5b37060 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:28.745583 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-18c22eda-c9a4-4c56-8087-7f1ea1886be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c308830cf1a426091a24507316b4116'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:28.756153 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-18c22eda-c9a4-4c56-8087-7f1ea1886be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c308830cf1a426091a24507316b4116'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:28.757263 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-18c22eda-c9a4-4c56-8087-7f1ea1886be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c308830cf1a426091a24507316b4116'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:28.778716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-18c22eda-c9a4-4c56-8087-7f1ea1886be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c308830cf1a426091a24507316b4116'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:28.779455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-18c22eda-c9a4-4c56-8087-7f1ea1886be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c308830cf1a426091a24507316b4116'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:28.781911 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:28.813158 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1281/2578] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:10:28 2022] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:28.817099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0d476-362b-4927-bbb3-6782d5b37060 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:28.819682 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-84a0d476-362b-4927-bbb3-6782d5b37060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:28.834119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0d476-362b-4927-bbb3-6782d5b37060 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:28.839480 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd76c9-846b-49e5-ac22-698df0a5b117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:28.843578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd76c9-846b-49e5-ac22-698df0a5b117 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:28.843578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd76c9-846b-49e5-ac22-698df0a5b117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:28.843578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd76c9-846b-49e5-ac22-698df0a5b117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:28.843578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd76c9-846b-49e5-ac22-698df0a5b117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:28.843578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd76c9-846b-49e5-ac22-698df0a5b117 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:28.855403 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1282/2579] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:10:28.859697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd76c9-846b-49e5-ac22-698df0a5b117 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:28.873082 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd76c9-846b-49e5-ac22-698df0a5b117 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:28.889001 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a433d-41bb-4a6a-8513-bf83dd1d73ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:28.895482 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a433d-41bb-4a6a-8513-bf83dd1d73ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:28.895482 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a433d-41bb-4a6a-8513-bf83dd1d73ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:28.895482 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a433d-41bb-4a6a-8513-bf83dd1d73ca admin admin] PATH_INFO: `/v3/projects/a5015af097e14c818c11b4ee4f3c2fbc/users/2243c0c575f943419b253dc3b1ed6449/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:28.902192 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1298/2580] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:10:28 2022] DELETE /identity/v3/users/4c308830cf1a426091a24507316b4116 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:28.917187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a433d-41bb-4a6a-8513-bf83dd1d73ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5015af097e14c818c11b4ee4f3c2fbc, user_id=2243c0c575f943419b253dc3b1ed6449, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:28.924032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a433d-41bb-4a6a-8513-bf83dd1d73ca admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:29.014102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1283/2581] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:28 2022] PUT /identity/v3/projects/a5015af097e14c818c11b4ee4f3c2fbc/users/2243c0c575f943419b253dc3b1ed6449/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:29.016800 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c22eda-c9a4-4c56-8087-7f1ea1886be9 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:29.095708 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c22eda-c9a4-4c56-8087-7f1ea1886be9 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:29.178271 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b1a58-840c-4526-8af7-261a2f1d2fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:29.179088 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b1a58-840c-4526-8af7-261a2f1d2fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:29.179794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b1a58-840c-4526-8af7-261a2f1d2fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:29.180165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b1a58-840c-4526-8af7-261a2f1d2fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:29.182112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b1a58-840c-4526-8af7-261a2f1d2fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:29.189014 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b1a58-840c-4526-8af7-261a2f1d2fe4 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:29.207798 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1299/2582] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:29.212439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a433d-41bb-4a6a-8513-bf83dd1d73ca admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:29.240378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a433d-41bb-4a6a-8513-bf83dd1d73ca admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:29.251185 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf8977-1ad1-42e4-9736-e7dcde8875b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:29.252394 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf8977-1ad1-42e4-9736-e7dcde8875b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:29.253860 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf8977-1ad1-42e4-9736-e7dcde8875b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:29.253860 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf8977-1ad1-42e4-9736-e7dcde8875b7 admin admin] PATH_INFO: `/v3/projects/a5015af097e14c818c11b4ee4f3c2fbc/users/2243c0c575f943419b253dc3b1ed6449/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:29.257615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf8977-1ad1-42e4-9736-e7dcde8875b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5015af097e14c818c11b4ee4f3c2fbc, user_id=2243c0c575f943419b253dc3b1ed6449, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:29.262242 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf8977-1ad1-42e4-9736-e7dcde8875b7 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:29.288149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1284/2583] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:29 2022] PUT /identity/v3/projects/a5015af097e14c818c11b4ee4f3c2fbc/users/2243c0c575f943419b253dc3b1ed6449/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:29.295604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26a241-f7a8-4421-9bcb-40536cb511d6 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:29.296448 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26a241-f7a8-4421-9bcb-40536cb511d6 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:29.297609 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26a241-f7a8-4421-9bcb-40536cb511d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:29.335879 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-fd26a241-f7a8-4421-9bcb-40536cb511d6 None None] MFA Rules not processed for user `2243c0c575f943419b253dc3b1ed6449`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:29.337290 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fd26a241-f7a8-4421-9bcb-40536cb511d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:29.441355 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1300/2584] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:29 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:29.453156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf8977-1ad1-42e4-9736-e7dcde8875b7 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:29.455004 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-eabf8977-1ad1-42e4-9736-e7dcde8875b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:29.488016 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:29.496564 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26a241-f7a8-4421-9bcb-40536cb511d6 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:29.500467 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fd26a241-f7a8-4421-9bcb-40536cb511d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:29.539909 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:29.541805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf8977-1ad1-42e4-9736-e7dcde8875b7 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:29.546818 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a0243-60c8-456c-8c30-03b9cccbbd57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:29.548431 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a0243-60c8-456c-8c30-03b9cccbbd57 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:29.548895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a0243-60c8-456c-8c30-03b9cccbbd57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:29.549541 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a0243-60c8-456c-8c30-03b9cccbbd57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:29.563554 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a0243-60c8-456c-8c30-03b9cccbbd57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:29.570251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a0243-60c8-456c-8c30-03b9cccbbd57 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:29.577728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1285/2585] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:29 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:29.605289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26a241-f7a8-4421-9bcb-40536cb511d6 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:29.611191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a8958-6d5a-45b3-8dfc-8a82f67e90d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:29.612081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8958-6d5a-45b3-8dfc-8a82f67e90d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:29.614087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8958-6d5a-45b3-8dfc-8a82f67e90d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:29.614087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8958-6d5a-45b3-8dfc-8a82f67e90d5 admin admin] PATH_INFO: `/v3/projects/3bb77b09e77f4c91bcae21b841ef555c` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:29.614087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a8958-6d5a-45b3-8dfc-8a82f67e90d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb77b09e77f4c91bcae21b841ef555c)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:29.616237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a8958-6d5a-45b3-8dfc-8a82f67e90d5 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:29.808524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b9a8958-6d5a-45b3-8dfc-8a82f67e90d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb77b09e77f4c91bcae21b841ef555c', 'request_id': 'req-5b9a8958-6d5a-45b3-8dfc-8a82f67e90d5'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:29.828106 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b9a8958-6d5a-45b3-8dfc-8a82f67e90d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb77b09e77f4c91bcae21b841ef555c', 'request_id': 'req-5b9a8958-6d5a-45b3-8dfc-8a82f67e90d5'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:29.840394 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b9a8958-6d5a-45b3-8dfc-8a82f67e90d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb77b09e77f4c91bcae21b841ef555c', 'request_id': 'req-5b9a8958-6d5a-45b3-8dfc-8a82f67e90d5'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:30.067460 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b9a8958-6d5a-45b3-8dfc-8a82f67e90d5 admin admin] The token cache is being invalidate because project 3bb77b09e77f4c91bcae21b841ef555c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:10:30.067744 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b9a8958-6d5a-45b3-8dfc-8a82f67e90d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:30.068541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b9a8958-6d5a-45b3-8dfc-8a82f67e90d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:30.071826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1301/2586] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:10:29 2022] DELETE /identity/v3/projects/3bb77b09e77f4c91bcae21b841ef555c => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:30.087188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3cfba-0754-4106-a93e-9e18084f5c4f None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:30.087490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3cfba-0754-4106-a93e-9e18084f5c4f None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:30.087838 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3cfba-0754-4106-a93e-9e18084f5c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:30.111632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-14c3cfba-0754-4106-a93e-9e18084f5c4f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:30.112047 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-14c3cfba-0754-4106-a93e-9e18084f5c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:30.200316 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1286/2587] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:30.209523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff71379-c1ce-454e-9fe2-50e4187e2a4d None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:30.209873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff71379-c1ce-454e-9fe2-50e4187e2a4d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:30.210158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff71379-c1ce-454e-9fe2-50e4187e2a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:30.233673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-eff71379-c1ce-454e-9fe2-50e4187e2a4d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:30.234910 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-eff71379-c1ce-454e-9fe2-50e4187e2a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:30.243838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1302/2588] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:30.248374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3cfba-0754-4106-a93e-9e18084f5c4f None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:30.264160 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3cfba-0754-4106-a93e-9e18084f5c4f None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:30.271253 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea78dec-2267-4e07-8aa7-870d7f480a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:30.271943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea78dec-2267-4e07-8aa7-870d7f480a9e admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:30.272419 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea78dec-2267-4e07-8aa7-870d7f480a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:30.272705 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea78dec-2267-4e07-8aa7-870d7f480a9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:30.273482 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea78dec-2267-4e07-8aa7-870d7f480a9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:10:30.273856 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea78dec-2267-4e07-8aa7-870d7f480a9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:30.275379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea78dec-2267-4e07-8aa7-870d7f480a9e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:30.292781 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1287/2589] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:10:30.297421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff71379-c1ce-454e-9fe2-50e4187e2a4d None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:30.308399 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff71379-c1ce-454e-9fe2-50e4187e2a4d None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:30.314171 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1120d-d97e-460d-a0e6-f90e05393a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:30.314893 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1120d-d97e-460d-a0e6-f90e05393a6b admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:30.315240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1120d-d97e-460d-a0e6-f90e05393a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:30.315466 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1120d-d97e-460d-a0e6-f90e05393a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:30.316161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1120d-d97e-460d-a0e6-f90e05393a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:30.318276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1120d-d97e-460d-a0e6-f90e05393a6b admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:30.470914 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1303/2590] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:10:30 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:30.472071 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea78dec-2267-4e07-8aa7-870d7f480a9e admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:30.482746 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea78dec-2267-4e07-8aa7-870d7f480a9e admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:30.583980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08eed57-550c-44ee-9efe-0c4b80b7d9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:30.583980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08eed57-550c-44ee-9efe-0c4b80b7d9b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:30.583980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08eed57-550c-44ee-9efe-0c4b80b7d9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:30.583980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08eed57-550c-44ee-9efe-0c4b80b7d9b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:30.584494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08eed57-550c-44ee-9efe-0c4b80b7d9b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:30.584494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08eed57-550c-44ee-9efe-0c4b80b7d9b1 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:30.683374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1288/2591] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:10:30 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:30.685097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1120d-d97e-460d-a0e6-f90e05393a6b admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:30.701673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1120d-d97e-460d-a0e6-f90e05393a6b admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:30.707195 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faccc5c-80e5-4cd0-b9f8-66536ee47996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:30.708052 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faccc5c-80e5-4cd0-b9f8-66536ee47996 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:30.708346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faccc5c-80e5-4cd0-b9f8-66536ee47996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:30.708625 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faccc5c-80e5-4cd0-b9f8-66536ee47996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:30.709422 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faccc5c-80e5-4cd0-b9f8-66536ee47996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:30.711067 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faccc5c-80e5-4cd0-b9f8-66536ee47996 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:30.723597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1304/2592] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:30.729361 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08eed57-550c-44ee-9efe-0c4b80b7d9b1 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:30.739761 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08eed57-550c-44ee-9efe-0c4b80b7d9b1 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:30.745244 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70f6c8-a427-46f6-88e2-c27c45b7c67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:30.745917 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70f6c8-a427-46f6-88e2-c27c45b7c67e admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:30.746207 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70f6c8-a427-46f6-88e2-c27c45b7c67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:30.746491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70f6c8-a427-46f6-88e2-c27c45b7c67e admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:30.747319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70f6c8-a427-46f6-88e2-c27c45b7c67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:30.748975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70f6c8-a427-46f6-88e2-c27c45b7c67e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:30.759988 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1289/2593] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:30.764818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faccc5c-80e5-4cd0-b9f8-66536ee47996 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:30.774837 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faccc5c-80e5-4cd0-b9f8-66536ee47996 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:30.779521 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ff842-c297-4e17-81bb-3415bd8d1b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:30.781011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ff842-c297-4e17-81bb-3415bd8d1b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:30.781420 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ff842-c297-4e17-81bb-3415bd8d1b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:30.781710 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ff842-c297-4e17-81bb-3415bd8d1b59 admin admin] PATH_INFO: `/v3/projects/a4987dd7a429484bb67486350db3cbc5/users/4ae19d4fbbdf4827959a790345b39bcb/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:30.796798 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ff842-c297-4e17-81bb-3415bd8d1b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4987dd7a429484bb67486350db3cbc5, user_id=4ae19d4fbbdf4827959a790345b39bcb, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:30.799882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ff842-c297-4e17-81bb-3415bd8d1b59 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:30.821494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70f6c8-a427-46f6-88e2-c27c45b7c67e admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:30.823536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ef70f6c8-a427-46f6-88e2-c27c45b7c67e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:30.920434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70f6c8-a427-46f6-88e2-c27c45b7c67e admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:30.920434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b24d95-3ba4-46ea-ae00-5e3ac08e1d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:30.920434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b24d95-3ba4-46ea-ae00-5e3ac08e1d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:30.920434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b24d95-3ba4-46ea-ae00-5e3ac08e1d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:30.920859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b24d95-3ba4-46ea-ae00-5e3ac08e1d4e admin admin] PATH_INFO: `/v3/users/8b560a851301489ca128cd55e7ba997e` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:30.920859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b24d95-3ba4-46ea-ae00-5e3ac08e1d4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b560a851301489ca128cd55e7ba997e)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:30.920859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b24d95-3ba4-46ea-ae00-5e3ac08e1d4e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:31.273322 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1305/2594] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:30 2022] PUT /identity/v3/projects/a4987dd7a429484bb67486350db3cbc5/users/4ae19d4fbbdf4827959a790345b39bcb/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:31.287196 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143e176-8ffd-41b6-8027-0c05a012e2be None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:31.287493 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143e176-8ffd-41b6-8027-0c05a012e2be None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:31.287781 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143e176-8ffd-41b6-8027-0c05a012e2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:31.310192 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:31.321053 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-b143e176-8ffd-41b6-8027-0c05a012e2be None None] MFA Rules not processed for user `4ae19d4fbbdf4827959a790345b39bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:31.322392 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b143e176-8ffd-41b6-8027-0c05a012e2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:31.363134 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:31.402093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1306/2595] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:10:31.407643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143e176-8ffd-41b6-8027-0c05a012e2be None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:31.492034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143e176-8ffd-41b6-8027-0c05a012e2be None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:31.500714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96b0bd-1c6b-48d8-97df-db19b5da8b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:31.501755 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96b0bd-1c6b-48d8-97df-db19b5da8b2d admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:31.502643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96b0bd-1c6b-48d8-97df-db19b5da8b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:31.503199 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96b0bd-1c6b-48d8-97df-db19b5da8b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:31.504176 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96b0bd-1c6b-48d8-97df-db19b5da8b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:31.506523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96b0bd-1c6b-48d8-97df-db19b5da8b2d admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:31.520497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b1b24d95-3ba4-46ea-ae00-5e3ac08e1d4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b560a851301489ca128cd55e7ba997e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:31.527603 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b1b24d95-3ba4-46ea-ae00-5e3ac08e1d4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b560a851301489ca128cd55e7ba997e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:31.543700 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b1b24d95-3ba4-46ea-ae00-5e3ac08e1d4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b560a851301489ca128cd55e7ba997e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:31.544578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b1b24d95-3ba4-46ea-ae00-5e3ac08e1d4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b560a851301489ca128cd55e7ba997e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:31.645920 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1307/2596] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:10:31 2022] POST /identity/v3/projects => generated 387 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:10:31.649750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96b0bd-1c6b-48d8-97df-db19b5da8b2d admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:31.651700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9d96b0bd-1c6b-48d8-97df-db19b5da8b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:31.667829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b1b24d95-3ba4-46ea-ae00-5e3ac08e1d4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b560a851301489ca128cd55e7ba997e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:31.702625 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1290/2597] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:10:30 2022] DELETE /identity/v3/users/8b560a851301489ca128cd55e7ba997e => generated 0 bytes in 879 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:31.704254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9783d88-ecb8-43e1-b49a-5efd54992a97 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:31.704549 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9783d88-ecb8-43e1-b49a-5efd54992a97 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:31.704833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9783d88-ecb8-43e1-b49a-5efd54992a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:31.734266 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-a9783d88-ecb8-43e1-b49a-5efd54992a97 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:31.739525 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a9783d88-ecb8-43e1-b49a-5efd54992a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:31.739930 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96b0bd-1c6b-48d8-97df-db19b5da8b2d admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:31.816972 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd49cf-876c-4cc9-8501-a3daae452c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:31.816972 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd49cf-876c-4cc9-8501-a3daae452c48 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:31.816972 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd49cf-876c-4cc9-8501-a3daae452c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:31.816972 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd49cf-876c-4cc9-8501-a3daae452c48 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:31.818181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd49cf-876c-4cc9-8501-a3daae452c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:31.818797 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1291/2598] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:31.820854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd49cf-876c-4cc9-8501-a3daae452c48 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:31.823840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9783d88-ecb8-43e1-b49a-5efd54992a97 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:31.825510 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a9783d88-ecb8-43e1-b49a-5efd54992a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:31.905650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:31.908213 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9783d88-ecb8-43e1-b49a-5efd54992a97 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:31.912199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6a9df-e2e5-4a8c-8e54-d5158a65cec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:31.914358 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1308/2599] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:10:31 2022] POST /identity/v3/users => generated 300 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:10:31.914501 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6a9df-e2e5-4a8c-8e54-d5158a65cec9 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:31.914501 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6a9df-e2e5-4a8c-8e54-d5158a65cec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:31.914501 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6a9df-e2e5-4a8c-8e54-d5158a65cec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:31.916522 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd49cf-876c-4cc9-8501-a3daae452c48 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:31.926999 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6a9df-e2e5-4a8c-8e54-d5158a65cec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:31.928826 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6a9df-e2e5-4a8c-8e54-d5158a65cec9 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:31.929922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd49cf-876c-4cc9-8501-a3daae452c48 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:31.935303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1c3ef-9503-4572-a13d-9c6e5b78b049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:31.936044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1c3ef-9503-4572-a13d-9c6e5b78b049 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:31.936367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1c3ef-9503-4572-a13d-9c6e5b78b049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:31.936700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1c3ef-9503-4572-a13d-9c6e5b78b049 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:31.937899 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1c3ef-9503-4572-a13d-9c6e5b78b049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:31.941573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1c3ef-9503-4572-a13d-9c6e5b78b049 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:31.945755 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1292/2600] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:10:31.965932 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1309/2601] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:10:31.974463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6a9df-e2e5-4a8c-8e54-d5158a65cec9 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:31.986926 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6a9df-e2e5-4a8c-8e54-d5158a65cec9 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:31.991830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3903db-8d3c-4ada-ae54-e9893d0fe6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:31.992976 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3903db-8d3c-4ada-ae54-e9893d0fe6d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:31.993297 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3903db-8d3c-4ada-ae54-e9893d0fe6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:31.993575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3903db-8d3c-4ada-ae54-e9893d0fe6d6 admin admin] PATH_INFO: `/v3/projects/01a32c779694497681681e76851ea2ec/users/91ab7dae134d43d4a3e182846764c82d/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:32.012948 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3903db-8d3c-4ada-ae54-e9893d0fe6d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a32c779694497681681e76851ea2ec, user_id=91ab7dae134d43d4a3e182846764c82d, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:32.016648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3903db-8d3c-4ada-ae54-e9893d0fe6d6 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:32.145310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1293/2602] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:31 2022] PUT /identity/v3/projects/01a32c779694497681681e76851ea2ec/users/91ab7dae134d43d4a3e182846764c82d/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:32.149519 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1c3ef-9503-4572-a13d-9c6e5b78b049 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:32.166765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1c3ef-9503-4572-a13d-9c6e5b78b049 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:32.338433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35906846-86fe-41bb-898e-8b80850e6664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:32.339123 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35906846-86fe-41bb-898e-8b80850e6664 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:32.339423 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35906846-86fe-41bb-898e-8b80850e6664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:32.339704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35906846-86fe-41bb-898e-8b80850e6664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:32.340455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35906846-86fe-41bb-898e-8b80850e6664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:32.346209 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35906846-86fe-41bb-898e-8b80850e6664 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:32.359795 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1310/2603] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:10:32.363878 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3903db-8d3c-4ada-ae54-e9893d0fe6d6 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:32.375887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3903db-8d3c-4ada-ae54-e9893d0fe6d6 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:32.380818 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb63c5-3305-4cce-beb5-d4773b041247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:32.381777 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb63c5-3305-4cce-beb5-d4773b041247 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:32.382067 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb63c5-3305-4cce-beb5-d4773b041247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:32.382351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb63c5-3305-4cce-beb5-d4773b041247 admin admin] PATH_INFO: `/v3/projects/01a32c779694497681681e76851ea2ec/users/91ab7dae134d43d4a3e182846764c82d/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:32.384459 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb63c5-3305-4cce-beb5-d4773b041247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a32c779694497681681e76851ea2ec, user_id=91ab7dae134d43d4a3e182846764c82d, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:32.387163 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb63c5-3305-4cce-beb5-d4773b041247 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:32.427303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d643b-9fc0-4e64-bd1b-4eba9f75ad4e None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:32.427597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d643b-9fc0-4e64-bd1b-4eba9f75ad4e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:32.431105 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d643b-9fc0-4e64-bd1b-4eba9f75ad4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:32.431276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1294/2604] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:32 2022] PUT /identity/v3/projects/01a32c779694497681681e76851ea2ec/users/91ab7dae134d43d4a3e182846764c82d/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:32.459570 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-5c4d643b-9fc0-4e64-bd1b-4eba9f75ad4e None None] MFA Rules not processed for user `91ab7dae134d43d4a3e182846764c82d`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:32.461572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5c4d643b-9fc0-4e64-bd1b-4eba9f75ad4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:32.564466 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1311/2605] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:10:32.575529 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb63c5-3305-4cce-beb5-d4773b041247 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:32.577523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-28bb63c5-3305-4cce-beb5-d4773b041247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:32.590793 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:32.602564 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d643b-9fc0-4e64-bd1b-4eba9f75ad4e None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:32.604417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5c4d643b-9fc0-4e64-bd1b-4eba9f75ad4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:32.707778 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb63c5-3305-4cce-beb5-d4773b041247 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:32.716127 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d643b-9fc0-4e64-bd1b-4eba9f75ad4e None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:32.716318 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4efe39-0265-4d32-bc80-7940bfae1858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:32.717192 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4efe39-0265-4d32-bc80-7940bfae1858 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:32.718845 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4efe39-0265-4d32-bc80-7940bfae1858 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:32.719138 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4efe39-0265-4d32-bc80-7940bfae1858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:32.721448 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46b776-8ed3-4821-b9da-3a60296ede6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:32.722338 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46b776-8ed3-4821-b9da-3a60296ede6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:32.722624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46b776-8ed3-4821-b9da-3a60296ede6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:32.722899 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46b776-8ed3-4821-b9da-3a60296ede6f admin admin] PATH_INFO: `/v3/projects/9eaf87089e794298a4dbeea48956b359` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:32.724645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46b776-8ed3-4821-b9da-3a60296ede6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eaf87089e794298a4dbeea48956b359)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:32.726605 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46b776-8ed3-4821-b9da-3a60296ede6f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:32.735442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4efe39-0265-4d32-bc80-7940bfae1858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:32.737996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4efe39-0265-4d32-bc80-7940bfae1858 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:32.747282 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:32.754696 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1295/2606] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:32.917262 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4efe39-0265-4d32-bc80-7940bfae1858 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:32.936053 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4efe39-0265-4d32-bc80-7940bfae1858 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:32.947813 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dc46b776-8ed3-4821-b9da-3a60296ede6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eaf87089e794298a4dbeea48956b359', 'request_id': 'req-dc46b776-8ed3-4821-b9da-3a60296ede6f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:32.955586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dc46b776-8ed3-4821-b9da-3a60296ede6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eaf87089e794298a4dbeea48956b359', 'request_id': 'req-dc46b776-8ed3-4821-b9da-3a60296ede6f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:32.962827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dc46b776-8ed3-4821-b9da-3a60296ede6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eaf87089e794298a4dbeea48956b359', 'request_id': 'req-dc46b776-8ed3-4821-b9da-3a60296ede6f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:33.025082 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7d3ae-4836-4fb3-ad6c-4df91bb9a0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:33.026024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7d3ae-4836-4fb3-ad6c-4df91bb9a0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:33.028754 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7d3ae-4836-4fb3-ad6c-4df91bb9a0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:33.028754 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7d3ae-4836-4fb3-ad6c-4df91bb9a0a7 admin admin] PATH_INFO: `/v3/users/4ae19d4fbbdf4827959a790345b39bcb` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:33.029583 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7d3ae-4836-4fb3-ad6c-4df91bb9a0a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae19d4fbbdf4827959a790345b39bcb)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:33.038346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7d3ae-4836-4fb3-ad6c-4df91bb9a0a7 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:33.114603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dc46b776-8ed3-4821-b9da-3a60296ede6f admin admin] The token cache is being invalidate because project 9eaf87089e794298a4dbeea48956b359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:10:33.114925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dc46b776-8ed3-4821-b9da-3a60296ede6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:33.115808 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dc46b776-8ed3-4821-b9da-3a60296ede6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:33.121513 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1312/2607] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:10:32 2022] DELETE /identity/v3/projects/9eaf87089e794298a4dbeea48956b359 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:33.122572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46b776-8ed3-4821-b9da-3a60296ede6f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:33.124067 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-dc46b776-8ed3-4821-b9da-3a60296ede6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:33.140271 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46b776-8ed3-4821-b9da-3a60296ede6f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:33.148077 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873bd69-91b2-45b4-b5dc-014fdf8a48e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:33.149610 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873bd69-91b2-45b4-b5dc-014fdf8a48e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:33.150073 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873bd69-91b2-45b4-b5dc-014fdf8a48e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:33.150771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873bd69-91b2-45b4-b5dc-014fdf8a48e9 admin admin] PATH_INFO: `/v3/users/2243c0c575f943419b253dc3b1ed6449` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:33.152937 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873bd69-91b2-45b4-b5dc-014fdf8a48e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2243c0c575f943419b253dc3b1ed6449)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:33.157009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873bd69-91b2-45b4-b5dc-014fdf8a48e9 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:33.254092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e7d7d3ae-4836-4fb3-ad6c-4df91bb9a0a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae19d4fbbdf4827959a790345b39bcb'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:33.254847 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e7d7d3ae-4836-4fb3-ad6c-4df91bb9a0a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae19d4fbbdf4827959a790345b39bcb'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:33.266813 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e7d7d3ae-4836-4fb3-ad6c-4df91bb9a0a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae19d4fbbdf4827959a790345b39bcb'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:33.267856 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e7d7d3ae-4836-4fb3-ad6c-4df91bb9a0a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae19d4fbbdf4827959a790345b39bcb'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:33.336050 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e7d7d3ae-4836-4fb3-ad6c-4df91bb9a0a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae19d4fbbdf4827959a790345b39bcb'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:33.357320 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1296/2608] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:10:32 2022] DELETE /identity/v3/users/4ae19d4fbbdf4827959a790345b39bcb => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:33.362550 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68084304-8f4f-46a1-b5be-cf3695650561 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:33.362844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68084304-8f4f-46a1-b5be-cf3695650561 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:33.365058 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68084304-8f4f-46a1-b5be-cf3695650561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:33.381492 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-68084304-8f4f-46a1-b5be-cf3695650561 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:33.384875 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-68084304-8f4f-46a1-b5be-cf3695650561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:33.413960 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:33.434550 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-6873bd69-91b2-45b4-b5dc-014fdf8a48e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2243c0c575f943419b253dc3b1ed6449'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:33.445651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-6873bd69-91b2-45b4-b5dc-014fdf8a48e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2243c0c575f943419b253dc3b1ed6449'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:33.448044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-6873bd69-91b2-45b4-b5dc-014fdf8a48e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2243c0c575f943419b253dc3b1ed6449'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:33.461568 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1297/2609] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:33.469530 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68084304-8f4f-46a1-b5be-cf3695650561 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:33.471924 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-68084304-8f4f-46a1-b5be-cf3695650561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:33.472665 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-6873bd69-91b2-45b4-b5dc-014fdf8a48e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2243c0c575f943419b253dc3b1ed6449'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:33.473414 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-6873bd69-91b2-45b4-b5dc-014fdf8a48e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2243c0c575f943419b253dc3b1ed6449'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:33.546831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68084304-8f4f-46a1-b5be-cf3695650561 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:33.560494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a5c63-cb13-48f2-b57d-f640425d55e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:33.561351 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a5c63-cb13-48f2-b57d-f640425d55e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:33.561711 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a5c63-cb13-48f2-b57d-f640425d55e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:33.562091 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a5c63-cb13-48f2-b57d-f640425d55e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:33.564308 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-eb1a5c63-cb13-48f2-b57d-f640425d55e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:33.578190 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1313/2610] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:10:33 2022] DELETE /identity/v3/users/2243c0c575f943419b253dc3b1ed6449 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:33.582365 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a5c63-cb13-48f2-b57d-f640425d55e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:33.583873 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a5c63-cb13-48f2-b57d-f640425d55e5 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:33.600169 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1298/2611] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:34.476407 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873bd69-91b2-45b4-b5dc-014fdf8a48e9 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:34.478149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6873bd69-91b2-45b4-b5dc-014fdf8a48e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:34.480201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a5c63-cb13-48f2-b57d-f640425d55e5 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:34.482271 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-eb1a5c63-cb13-48f2-b57d-f640425d55e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:34.499564 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a5c63-cb13-48f2-b57d-f640425d55e5 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:34.575020 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873bd69-91b2-45b4-b5dc-014fdf8a48e9 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:34.579847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae9a94-93e7-45a9-b2bd-54274ad347d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:34.580764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae9a94-93e7-45a9-b2bd-54274ad347d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:34.580980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9b7ba-4383-4ada-9738-c058471db48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:34.581106 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae9a94-93e7-45a9-b2bd-54274ad347d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:34.581388 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae9a94-93e7-45a9-b2bd-54274ad347d8 admin admin] PATH_INFO: `/v3/projects/a5015af097e14c818c11b4ee4f3c2fbc` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:34.582046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9b7ba-4383-4ada-9738-c058471db48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:34.582363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9b7ba-4383-4ada-9738-c058471db48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:34.582565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae9a94-93e7-45a9-b2bd-54274ad347d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5015af097e14c818c11b4ee4f3c2fbc)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:34.582679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9b7ba-4383-4ada-9738-c058471db48b admin admin] PATH_INFO: `/v3/projects/a4987dd7a429484bb67486350db3cbc5` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:34.583827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9b7ba-4383-4ada-9738-c058471db48b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4987dd7a429484bb67486350db3cbc5)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:34.584573 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae9a94-93e7-45a9-b2bd-54274ad347d8 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:34.585916 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9b7ba-4383-4ada-9738-c058471db48b admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:34.601070 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:35.505345 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7eae9a94-93e7-45a9-b2bd-54274ad347d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5015af097e14c818c11b4ee4f3c2fbc', 'request_id': 'req-7eae9a94-93e7-45a9-b2bd-54274ad347d8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:35.506046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c9a9b7ba-4383-4ada-9738-c058471db48b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4987dd7a429484bb67486350db3cbc5', 'request_id': 'req-c9a9b7ba-4383-4ada-9738-c058471db48b'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:35.511867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7eae9a94-93e7-45a9-b2bd-54274ad347d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5015af097e14c818c11b4ee4f3c2fbc', 'request_id': 'req-7eae9a94-93e7-45a9-b2bd-54274ad347d8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:35.512491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c9a9b7ba-4383-4ada-9738-c058471db48b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4987dd7a429484bb67486350db3cbc5', 'request_id': 'req-c9a9b7ba-4383-4ada-9738-c058471db48b'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:35.518806 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7eae9a94-93e7-45a9-b2bd-54274ad347d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5015af097e14c818c11b4ee4f3c2fbc', 'request_id': 'req-7eae9a94-93e7-45a9-b2bd-54274ad347d8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:35.519171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c9a9b7ba-4383-4ada-9738-c058471db48b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4987dd7a429484bb67486350db3cbc5', 'request_id': 'req-c9a9b7ba-4383-4ada-9738-c058471db48b'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:35.637580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7eae9a94-93e7-45a9-b2bd-54274ad347d8 admin admin] The token cache is being invalidate because project a5015af097e14c818c11b4ee4f3c2fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:10:35.638043 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7eae9a94-93e7-45a9-b2bd-54274ad347d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:35.638800 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-7eae9a94-93e7-45a9-b2bd-54274ad347d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:35.641514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1314/2612] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:10:34 2022] DELETE /identity/v3/projects/a5015af097e14c818c11b4ee4f3c2fbc => generated 0 bytes in 1165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:35.650496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f776b4-effe-4f1e-8eb4-6bdf0b8df409 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:35.650496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f776b4-effe-4f1e-8eb4-6bdf0b8df409 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:35.650496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f776b4-effe-4f1e-8eb4-6bdf0b8df409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:35.671631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-f0f776b4-effe-4f1e-8eb4-6bdf0b8df409 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:35.673270 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-f0f776b4-effe-4f1e-8eb4-6bdf0b8df409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:35.723633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c9a9b7ba-4383-4ada-9738-c058471db48b admin admin] The token cache is being invalidate because project a4987dd7a429484bb67486350db3cbc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:10:35.724082 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c9a9b7ba-4383-4ada-9738-c058471db48b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:35.724990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c9a9b7ba-4383-4ada-9738-c058471db48b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:35.726703 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1299/2613] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:10:34 2022] DELETE /identity/v3/projects/a4987dd7a429484bb67486350db3cbc5 => generated 0 bytes in 1247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:35.733792 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9b7ba-4383-4ada-9738-c058471db48b admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:35.733792 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c9a9b7ba-4383-4ada-9738-c058471db48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:35.741461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:35.769538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1315/2614] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:35.771017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f4985-46ec-4a44-96b6-de96f256d650 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:35.771312 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f4985-46ec-4a44-96b6-de96f256d650 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:35.771596 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f4985-46ec-4a44-96b6-de96f256d650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:35.807886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-bd5f4985-46ec-4a44-96b6-de96f256d650 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:35.809946 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-bd5f4985-46ec-4a44-96b6-de96f256d650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:35.822841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1316/2615] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:35.828368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f4985-46ec-4a44-96b6-de96f256d650 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:35.850986 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f4985-46ec-4a44-96b6-de96f256d650 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:35.851203 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9b7ba-4383-4ada-9738-c058471db48b admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:35.857557 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546c137-21d0-45b1-8d7f-85a0272b6e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:35.859212 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546c137-21d0-45b1-8d7f-85a0272b6e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:35.859652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546c137-21d0-45b1-8d7f-85a0272b6e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:35.860142 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546c137-21d0-45b1-8d7f-85a0272b6e09 admin admin] PATH_INFO: `/v3/users/91ab7dae134d43d4a3e182846764c82d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:35.861480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b5d7f-eb79-445f-8d67-c7caf492dfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:35.861827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546c137-21d0-45b1-8d7f-85a0272b6e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91ab7dae134d43d4a3e182846764c82d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:35.862306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b5d7f-eb79-445f-8d67-c7caf492dfcd admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:35.862663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b5d7f-eb79-445f-8d67-c7caf492dfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:35.863010 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b5d7f-eb79-445f-8d67-c7caf492dfcd admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:35.863828 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b5d7f-eb79-445f-8d67-c7caf492dfcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:10:35.864151 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b5d7f-eb79-445f-8d67-c7caf492dfcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:35.864794 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546c137-21d0-45b1-8d7f-85a0272b6e09 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:35.865805 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b5d7f-eb79-445f-8d67-c7caf492dfcd admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:35.887514 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1317/2616] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:10:35.891838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b5d7f-eb79-445f-8d67-c7caf492dfcd admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:35.906566 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b5d7f-eb79-445f-8d67-c7caf492dfcd admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:35.913205 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b488c-be11-4272-9759-ab391b4900de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:35.914055 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b488c-be11-4272-9759-ab391b4900de admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:35.916462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b488c-be11-4272-9759-ab391b4900de admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:35.916462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b488c-be11-4272-9759-ab391b4900de admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:35.916462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b488c-be11-4272-9759-ab391b4900de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:35.917919 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b488c-be11-4272-9759-ab391b4900de admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:36.053359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1318/2617] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:10:35 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:36.057455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b488c-be11-4272-9759-ab391b4900de admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:36.143693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b488c-be11-4272-9759-ab391b4900de admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:36.148120 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-7546c137-21d0-45b1-8d7f-85a0272b6e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91ab7dae134d43d4a3e182846764c82d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:36.148120 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-7546c137-21d0-45b1-8d7f-85a0272b6e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91ab7dae134d43d4a3e182846764c82d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:36.150011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be0f45-5665-4e01-bdf0-922d9253ab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:36.151702 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be0f45-5665-4e01-bdf0-922d9253ab69 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:36.152188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be0f45-5665-4e01-bdf0-922d9253ab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:36.153405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be0f45-5665-4e01-bdf0-922d9253ab69 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:36.154806 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be0f45-5665-4e01-bdf0-922d9253ab69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:36.160083 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be0f45-5665-4e01-bdf0-922d9253ab69 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:36.168608 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-7546c137-21d0-45b1-8d7f-85a0272b6e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91ab7dae134d43d4a3e182846764c82d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:36.171835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-7546c137-21d0-45b1-8d7f-85a0272b6e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91ab7dae134d43d4a3e182846764c82d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:36.177568 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:36.331148 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-7546c137-21d0-45b1-8d7f-85a0272b6e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91ab7dae134d43d4a3e182846764c82d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:36.340193 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1319/2618] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:10:36 2022] POST /identity/v3/users => generated 283 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:36.350329 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be0f45-5665-4e01-bdf0-922d9253ab69 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:36.353090 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1300/2619] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:10:35 2022] DELETE /identity/v3/users/91ab7dae134d43d4a3e182846764c82d => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:36.357554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-27be0f45-5665-4e01-bdf0-922d9253ab69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:36.366389 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be0f45-5665-4e01-bdf0-922d9253ab69 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:36.434347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d64a6a-eae9-42ae-8db2-78b0f58a4cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:36.435008 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d64a6a-eae9-42ae-8db2-78b0f58a4cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:36.435294 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d64a6a-eae9-42ae-8db2-78b0f58a4cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:36.435574 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d64a6a-eae9-42ae-8db2-78b0f58a4cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:36.436339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d64a6a-eae9-42ae-8db2-78b0f58a4cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:36.438013 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d64a6a-eae9-42ae-8db2-78b0f58a4cfb admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:36.447923 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1320/2620] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:36.454956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546c137-21d0-45b1-8d7f-85a0272b6e09 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:36.465353 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546c137-21d0-45b1-8d7f-85a0272b6e09 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:36.473478 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc04c1-f145-44ed-8785-4d3abf9a71e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:36.481843 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc04c1-f145-44ed-8785-4d3abf9a71e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:36.481843 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc04c1-f145-44ed-8785-4d3abf9a71e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:36.481843 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc04c1-f145-44ed-8785-4d3abf9a71e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:36.481843 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc04c1-f145-44ed-8785-4d3abf9a71e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:36.481843 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc04c1-f145-44ed-8785-4d3abf9a71e1 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:36.488591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1301/2621] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:36.493084 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d64a6a-eae9-42ae-8db2-78b0f58a4cfb admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:36.503294 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d64a6a-eae9-42ae-8db2-78b0f58a4cfb admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:36.508032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d5796-26a0-4407-bbca-ea31ef2d2eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:36.508923 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d5796-26a0-4407-bbca-ea31ef2d2eae admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:36.509287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d5796-26a0-4407-bbca-ea31ef2d2eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:36.509591 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d5796-26a0-4407-bbca-ea31ef2d2eae admin admin] PATH_INFO: `/v3/projects/bdf4e3c87252420aa5ce1e6a3c486fc6/users/fa3f0f683eaa4020bee2f00a269e5a98/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:36.525857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d5796-26a0-4407-bbca-ea31ef2d2eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf4e3c87252420aa5ce1e6a3c486fc6, user_id=fa3f0f683eaa4020bee2f00a269e5a98, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:36.528578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d5796-26a0-4407-bbca-ea31ef2d2eae admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:36.605225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1321/2622] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:36 2022] PUT /identity/v3/projects/bdf4e3c87252420aa5ce1e6a3c486fc6/users/fa3f0f683eaa4020bee2f00a269e5a98/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:36.615707 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194ae77-b293-4548-b3fe-4342539dc4e4 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:36.616151 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194ae77-b293-4548-b3fe-4342539dc4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:36.616512 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194ae77-b293-4548-b3fe-4342539dc4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:36.653548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-5194ae77-b293-4548-b3fe-4342539dc4e4 None None] MFA Rules not processed for user `fa3f0f683eaa4020bee2f00a269e5a98`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:36.653548 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-5194ae77-b293-4548-b3fe-4342539dc4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:36.727009 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1302/2623] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:36.731526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d5796-26a0-4407-bbca-ea31ef2d2eae admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:36.794164 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d5796-26a0-4407-bbca-ea31ef2d2eae admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:36.799289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700c740-60de-4655-b1ec-ca56ff71300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:36.799955 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700c740-60de-4655-b1ec-ca56ff71300f admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:36.800244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700c740-60de-4655-b1ec-ca56ff71300f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:36.800527 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700c740-60de-4655-b1ec-ca56ff71300f admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:36.801275 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700c740-60de-4655-b1ec-ca56ff71300f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:36.803206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700c740-60de-4655-b1ec-ca56ff71300f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:36.825235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194ae77-b293-4548-b3fe-4342539dc4e4 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:36.826628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-5194ae77-b293-4548-b3fe-4342539dc4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:36.836628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:36.843747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194ae77-b293-4548-b3fe-4342539dc4e4 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:36.849396 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed83489-826c-4994-9f41-715e388c3992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:36.850298 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed83489-826c-4994-9f41-715e388c3992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:36.850589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed83489-826c-4994-9f41-715e388c3992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:36.850869 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed83489-826c-4994-9f41-715e388c3992 admin admin] PATH_INFO: `/v3/projects/01a32c779694497681681e76851ea2ec` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:36.852144 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed83489-826c-4994-9f41-715e388c3992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a32c779694497681681e76851ea2ec)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:36.854171 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed83489-826c-4994-9f41-715e388c3992 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:36.957843 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1322/2624] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:10:36 2022] POST /identity/v3/projects => generated 365 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:10:36.959601 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700c740-60de-4655-b1ec-ca56ff71300f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:36.966098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-5ed83489-826c-4994-9f41-715e388c3992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a32c779694497681681e76851ea2ec', 'request_id': 'req-5ed83489-826c-4994-9f41-715e388c3992'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:36.972656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-5ed83489-826c-4994-9f41-715e388c3992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a32c779694497681681e76851ea2ec', 'request_id': 'req-5ed83489-826c-4994-9f41-715e388c3992'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:36.988985 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-5ed83489-826c-4994-9f41-715e388c3992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a32c779694497681681e76851ea2ec', 'request_id': 'req-5ed83489-826c-4994-9f41-715e388c3992'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:37.020637 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:37.034404 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700c740-60de-4655-b1ec-ca56ff71300f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:37.039281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b056538-55c3-445f-b7d1-919a7ab0fc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:37.039959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b056538-55c3-445f-b7d1-919a7ab0fc0d admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.040250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b056538-55c3-445f-b7d1-919a7ab0fc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.040534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b056538-55c3-445f-b7d1-919a7ab0fc0d admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.041254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b056538-55c3-445f-b7d1-919a7ab0fc0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:37.043473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b056538-55c3-445f-b7d1-919a7ab0fc0d admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:37.046112 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-5ed83489-826c-4994-9f41-715e388c3992 admin admin] The token cache is being invalidate because project 01a32c779694497681681e76851ea2ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:10:37.048826 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-5ed83489-826c-4994-9f41-715e388c3992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:37.048826 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-5ed83489-826c-4994-9f41-715e388c3992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:37.048826 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1303/2625] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:10:36 2022] DELETE /identity/v3/projects/01a32c779694497681681e76851ea2ec => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:37.053404 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768a92-be10-4096-8303-173812498dd8 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.053800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768a92-be10-4096-8303-173812498dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.054080 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768a92-be10-4096-8303-173812498dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.080140 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-a9768a92-be10-4096-8303-173812498dd8 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:37.082295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a9768a92-be10-4096-8303-173812498dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:37.092158 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1304/2626] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:37.100663 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005c7f4-56b0-4409-8ea7-aa88ca0ebd95 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.100969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005c7f4-56b0-4409-8ea7-aa88ca0ebd95 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.101308 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005c7f4-56b0-4409-8ea7-aa88ca0ebd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.121604 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-0005c7f4-56b0-4409-8ea7-aa88ca0ebd95 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:37.122806 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-0005c7f4-56b0-4409-8ea7-aa88ca0ebd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:37.132304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1305/2627] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:10:37.136352 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005c7f4-56b0-4409-8ea7-aa88ca0ebd95 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:37.146299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005c7f4-56b0-4409-8ea7-aa88ca0ebd95 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:37.151372 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd02820-c046-4805-8350-3963e0aac5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:37.152120 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd02820-c046-4805-8350-3963e0aac5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.152410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd02820-c046-4805-8350-3963e0aac5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.152708 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd02820-c046-4805-8350-3963e0aac5d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.159760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd02820-c046-4805-8350-3963e0aac5d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:10:37.159760 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd02820-c046-4805-8350-3963e0aac5d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:37.159967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1323/2628] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:10:36 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:37.160065 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd02820-c046-4805-8350-3963e0aac5d0 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:37.160755 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b056538-55c3-445f-b7d1-919a7ab0fc0d admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:37.162566 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6b056538-55c3-445f-b7d1-919a7ab0fc0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:37.171797 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1306/2629] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:10:37.173014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd02820-c046-4805-8350-3963e0aac5d0 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:37.175795 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b056538-55c3-445f-b7d1-919a7ab0fc0d admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:37.180735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ec9e5-276d-4200-8b46-a52ad7238833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:37.186029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ec9e5-276d-4200-8b46-a52ad7238833 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.186029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ec9e5-276d-4200-8b46-a52ad7238833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.186029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ec9e5-276d-4200-8b46-a52ad7238833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.186029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ec9e5-276d-4200-8b46-a52ad7238833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:37.187039 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd02820-c046-4805-8350-3963e0aac5d0 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:37.187154 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ec9e5-276d-4200-8b46-a52ad7238833 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:37.188499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5597d03-10b7-42a4-a1a2-9e363fbfa92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:37.189162 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5597d03-10b7-42a4-a1a2-9e363fbfa92c admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.189468 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5597d03-10b7-42a4-a1a2-9e363fbfa92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.189749 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5597d03-10b7-42a4-a1a2-9e363fbfa92c admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.190440 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5597d03-10b7-42a4-a1a2-9e363fbfa92c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:37.192387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5597d03-10b7-42a4-a1a2-9e363fbfa92c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:37.196214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1324/2630] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:10:37.200323 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ec9e5-276d-4200-8b46-a52ad7238833 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:37.210282 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ec9e5-276d-4200-8b46-a52ad7238833 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:37.214986 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602d3ac-ef05-4ef5-a365-709417edfdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:37.215927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d3ac-ef05-4ef5-a365-709417edfdf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.216212 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d3ac-ef05-4ef5-a365-709417edfdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.216493 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d3ac-ef05-4ef5-a365-709417edfdf6 admin admin] PATH_INFO: `/v3/projects/838f0103f2744eafb1a4f04663b4cc36/users/fec1c698e4c041b88939b294e29a7650/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.230887 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602d3ac-ef05-4ef5-a365-709417edfdf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=838f0103f2744eafb1a4f04663b4cc36, user_id=fec1c698e4c041b88939b294e29a7650, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:37.234275 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602d3ac-ef05-4ef5-a365-709417edfdf6 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:37.298188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1307/2631] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:10:37 2022] POST /identity/v3/projects => generated 361 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:10:37.302155 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5597d03-10b7-42a4-a1a2-9e363fbfa92c admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:37.327208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1325/2632] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:37 2022] PUT /identity/v3/projects/838f0103f2744eafb1a4f04663b4cc36/users/fec1c698e4c041b88939b294e29a7650/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:37.331130 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602d3ac-ef05-4ef5-a365-709417edfdf6 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:37.370365 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5597d03-10b7-42a4-a1a2-9e363fbfa92c admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:37.407191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602d3ac-ef05-4ef5-a365-709417edfdf6 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:37.412536 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a99db-3dfd-402e-b80d-f846dd4db2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:37.413251 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a99db-3dfd-402e-b80d-f846dd4db2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.413548 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a99db-3dfd-402e-b80d-f846dd4db2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.413832 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a99db-3dfd-402e-b80d-f846dd4db2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.414580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a99db-3dfd-402e-b80d-f846dd4db2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:37.416353 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a99db-3dfd-402e-b80d-f846dd4db2f1 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:37.418236 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:37.430590 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1326/2633] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:10:37.434604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a99db-3dfd-402e-b80d-f846dd4db2f1 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:37.439660 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4926b06-ae27-4803-8c1a-381f53b0568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:37.440459 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4926b06-ae27-4803-8c1a-381f53b0568b admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.440748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4926b06-ae27-4803-8c1a-381f53b0568b admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.441068 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4926b06-ae27-4803-8c1a-381f53b0568b admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.441827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4926b06-ae27-4803-8c1a-381f53b0568b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:37.443743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4926b06-ae27-4803-8c1a-381f53b0568b admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:37.447299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a99db-3dfd-402e-b80d-f846dd4db2f1 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:37.453688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1366f-cd25-46d2-8290-98174ab0de7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:37.454580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1366f-cd25-46d2-8290-98174ab0de7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.454861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1366f-cd25-46d2-8290-98174ab0de7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.455141 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1366f-cd25-46d2-8290-98174ab0de7a admin admin] PATH_INFO: `/v3/projects/838f0103f2744eafb1a4f04663b4cc36/users/fec1c698e4c041b88939b294e29a7650/roles/c865040abd6c4b099381557da21c471d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.457977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1366f-cd25-46d2-8290-98174ab0de7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=838f0103f2744eafb1a4f04663b4cc36, user_id=fec1c698e4c041b88939b294e29a7650, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:37.461739 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1366f-cd25-46d2-8290-98174ab0de7a admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:37.473491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1327/2634] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:37 2022] PUT /identity/v3/projects/838f0103f2744eafb1a4f04663b4cc36/users/fec1c698e4c041b88939b294e29a7650/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:37.485498 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2f8a1-851f-4f76-88c0-74346c54166e None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.485792 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2f8a1-851f-4f76-88c0-74346c54166e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.486129 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2f8a1-851f-4f76-88c0-74346c54166e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.514491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-03e2f8a1-851f-4f76-88c0-74346c54166e None None] MFA Rules not processed for user `fec1c698e4c041b88939b294e29a7650`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:37.515776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-03e2f8a1-851f-4f76-88c0-74346c54166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:37.549537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1308/2635] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:10:37 2022] POST /identity/v3/users => generated 281 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:37.556344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4926b06-ae27-4803-8c1a-381f53b0568b admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:37.566142 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4926b06-ae27-4803-8c1a-381f53b0568b admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:37.588044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1328/2636] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:10:37.605751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2f8a1-851f-4f76-88c0-74346c54166e None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:37.607178 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-03e2f8a1-851f-4f76-88c0-74346c54166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:37.618989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:37.652092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f9324-28f7-4c33-bf19-efa322e1603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:37.652092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9324-28f7-4c33-bf19-efa322e1603a admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.652092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9324-28f7-4c33-bf19-efa322e1603a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.652092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9324-28f7-4c33-bf19-efa322e1603a admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.657299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f9324-28f7-4c33-bf19-efa322e1603a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:37.657299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f9324-28f7-4c33-bf19-efa322e1603a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:37.657299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1309/2637] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:10:37.657299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f9324-28f7-4c33-bf19-efa322e1603a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:37.672042 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f9324-28f7-4c33-bf19-efa322e1603a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:37.678198 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519ad40-37fd-4a5e-9d04-64fc81af7e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:37.678968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519ad40-37fd-4a5e-9d04-64fc81af7e59 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.679334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519ad40-37fd-4a5e-9d04-64fc81af7e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.679910 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519ad40-37fd-4a5e-9d04-64fc81af7e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.680495 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519ad40-37fd-4a5e-9d04-64fc81af7e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:37.682032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2f8a1-851f-4f76-88c0-74346c54166e None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:37.682454 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519ad40-37fd-4a5e-9d04-64fc81af7e59 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:37.685747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c78698-6a98-47fa-a73d-4a7c6b262325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:37.686794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c78698-6a98-47fa-a73d-4a7c6b262325 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.687083 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c78698-6a98-47fa-a73d-4a7c6b262325 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.688951 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c78698-6a98-47fa-a73d-4a7c6b262325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.697169 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1310/2638] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:10:37.698213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c78698-6a98-47fa-a73d-4a7c6b262325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:37.699002 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519ad40-37fd-4a5e-9d04-64fc81af7e59 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:37.699908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c78698-6a98-47fa-a73d-4a7c6b262325 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:37.710070 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519ad40-37fd-4a5e-9d04-64fc81af7e59 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:37.712133 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1329/2639] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:10:37.714963 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fbbee-11fd-4aca-9aaa-3b2d1e162f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:37.715852 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fbbee-11fd-4aca-9aaa-3b2d1e162f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.716152 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fbbee-11fd-4aca-9aaa-3b2d1e162f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.716414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fbbee-11fd-4aca-9aaa-3b2d1e162f5a admin admin] PATH_INFO: `/v3/projects/9d987fe5330549a7a2b5956a4d3785fd/users/f2efbc19072e4147a74c87250848cf50/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.732695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fbbee-11fd-4aca-9aaa-3b2d1e162f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d987fe5330549a7a2b5956a4d3785fd, user_id=f2efbc19072e4147a74c87250848cf50, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:37.735987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fbbee-11fd-4aca-9aaa-3b2d1e162f5a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:37.832116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1311/2640] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:37 2022] PUT /identity/v3/projects/9d987fe5330549a7a2b5956a4d3785fd/users/f2efbc19072e4147a74c87250848cf50/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:37.842455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a85353-7be0-491c-8299-2dc00540997e None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.843246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a85353-7be0-491c-8299-2dc00540997e None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.843581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a85353-7be0-491c-8299-2dc00540997e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.871886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-78a85353-7be0-491c-8299-2dc00540997e None None] MFA Rules not processed for user `f2efbc19072e4147a74c87250848cf50`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:37.873158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-78a85353-7be0-491c-8299-2dc00540997e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:37.911781 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fbbee-11fd-4aca-9aaa-3b2d1e162f5a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:37.953807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1330/2641] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:37.986916 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fbbee-11fd-4aca-9aaa-3b2d1e162f5a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:37.991902 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b56fc-b5e2-497b-ab96-318f4ffae3fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:37.992955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b56fc-b5e2-497b-ab96-318f4ffae3fc service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:37.993570 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b56fc-b5e2-497b-ab96-318f4ffae3fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:37.993944 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b56fc-b5e2-497b-ab96-318f4ffae3fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:37.994218 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a85353-7be0-491c-8299-2dc00540997e None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:37.995589 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-78a85353-7be0-491c-8299-2dc00540997e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:37.995808 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b47b56fc-b5e2-497b-ab96-318f4ffae3fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:38.008953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a85353-7be0-491c-8299-2dc00540997e None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:38.013042 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af506f8f-f1f4-43d9-a1bf-adfe836a41fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:38.013771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506f8f-f1f4-43d9-a1bf-adfe836a41fe service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:38.014062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506f8f-f1f4-43d9-a1bf-adfe836a41fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:38.014342 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506f8f-f1f4-43d9-a1bf-adfe836a41fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:38.025111 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af506f8f-f1f4-43d9-a1bf-adfe836a41fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:38.025943 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af506f8f-f1f4-43d9-a1bf-adfe836a41fe service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:38.037262 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1331/2642] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:10:38.054634 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af506f8f-f1f4-43d9-a1bf-adfe836a41fe service cinder] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:38.056471 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:38.070205 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b56fc-b5e2-497b-ab96-318f4ffae3fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:38.073574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b56fc-b5e2-497b-ab96-318f4ffae3fc service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:38.080938 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1312/2643] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:10:38.128712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af506f8f-f1f4-43d9-a1bf-adfe836a41fe service cinder] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:38.133636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eff1a3-11be-4112-89e9-94702c0e19dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:38.134524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eff1a3-11be-4112-89e9-94702c0e19dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:38.134806 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eff1a3-11be-4112-89e9-94702c0e19dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:38.135087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eff1a3-11be-4112-89e9-94702c0e19dd admin admin] PATH_INFO: `/v3/users/f2efbc19072e4147a74c87250848cf50` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:38.136346 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eff1a3-11be-4112-89e9-94702c0e19dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2efbc19072e4147a74c87250848cf50)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:38.138301 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eff1a3-11be-4112-89e9-94702c0e19dd admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:38.388156 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:38.400700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-c2eff1a3-11be-4112-89e9-94702c0e19dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2efbc19072e4147a74c87250848cf50'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:38.408037 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-c2eff1a3-11be-4112-89e9-94702c0e19dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2efbc19072e4147a74c87250848cf50'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:38.408701 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-c2eff1a3-11be-4112-89e9-94702c0e19dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2efbc19072e4147a74c87250848cf50'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:38.420295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-c2eff1a3-11be-4112-89e9-94702c0e19dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2efbc19072e4147a74c87250848cf50'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:38.423345 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-c2eff1a3-11be-4112-89e9-94702c0e19dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2efbc19072e4147a74c87250848cf50'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:38.535137 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1332/2644] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:10:38 2022] DELETE /identity/v3/users/f2efbc19072e4147a74c87250848cf50 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:38.539677 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85a202-1e2a-4729-82a2-7e46b1771c55 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:38.539975 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85a202-1e2a-4729-82a2-7e46b1771c55 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:38.540263 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85a202-1e2a-4729-82a2-7e46b1771c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:38.561409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-be85a202-1e2a-4729-82a2-7e46b1771c55 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:38.561409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-be85a202-1e2a-4729-82a2-7e46b1771c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:38.626587 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1313/2645] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:38.634097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eff1a3-11be-4112-89e9-94702c0e19dd admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:38.636733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-c2eff1a3-11be-4112-89e9-94702c0e19dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:38.701572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eff1a3-11be-4112-89e9-94702c0e19dd admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:38.709844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461476f-bd75-4ab2-8412-0ed764455855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:38.709844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461476f-bd75-4ab2-8412-0ed764455855 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:38.709844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461476f-bd75-4ab2-8412-0ed764455855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:38.709844 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461476f-bd75-4ab2-8412-0ed764455855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:38.716924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461476f-bd75-4ab2-8412-0ed764455855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:38.719072 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461476f-bd75-4ab2-8412-0ed764455855 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:38.729677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1333/2646] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:10:39.135774 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85a202-1e2a-4729-82a2-7e46b1771c55 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:39.137245 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-be85a202-1e2a-4729-82a2-7e46b1771c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:39.151688 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85a202-1e2a-4729-82a2-7e46b1771c55 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:39.156360 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca55c77-221f-48b0-9bc3-c67f22f98e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:39.160374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca55c77-221f-48b0-9bc3-c67f22f98e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:39.160374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca55c77-221f-48b0-9bc3-c67f22f98e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:39.160374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca55c77-221f-48b0-9bc3-c67f22f98e5c admin admin] PATH_INFO: `/v3/projects/9d987fe5330549a7a2b5956a4d3785fd` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:39.160374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca55c77-221f-48b0-9bc3-c67f22f98e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d987fe5330549a7a2b5956a4d3785fd)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:39.161003 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca55c77-221f-48b0-9bc3-c67f22f98e5c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:39.303037 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bca55c77-221f-48b0-9bc3-c67f22f98e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d987fe5330549a7a2b5956a4d3785fd', 'request_id': 'req-bca55c77-221f-48b0-9bc3-c67f22f98e5c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:39.309443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bca55c77-221f-48b0-9bc3-c67f22f98e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d987fe5330549a7a2b5956a4d3785fd', 'request_id': 'req-bca55c77-221f-48b0-9bc3-c67f22f98e5c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:39.315622 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bca55c77-221f-48b0-9bc3-c67f22f98e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d987fe5330549a7a2b5956a4d3785fd', 'request_id': 'req-bca55c77-221f-48b0-9bc3-c67f22f98e5c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:39.427607 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bca55c77-221f-48b0-9bc3-c67f22f98e5c admin admin] The token cache is being invalidate because project 9d987fe5330549a7a2b5956a4d3785fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:10:39.427836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bca55c77-221f-48b0-9bc3-c67f22f98e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:39.428461 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bca55c77-221f-48b0-9bc3-c67f22f98e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:39.430148 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1314/2647] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:10:39 2022] DELETE /identity/v3/projects/9d987fe5330549a7a2b5956a4d3785fd => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:39.435530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f3968-ae49-470f-8bf1-bdc290b76464 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:39.437033 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f3968-ae49-470f-8bf1-bdc290b76464 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:39.437033 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f3968-ae49-470f-8bf1-bdc290b76464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:39.454213 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-991f3968-ae49-470f-8bf1-bdc290b76464 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:39.455411 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-991f3968-ae49-470f-8bf1-bdc290b76464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:39.513209 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1334/2648] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:10:39.520969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d9f9b-544d-4a1d-998a-3ab8cf9e86e1 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:39.521298 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d9f9b-544d-4a1d-998a-3ab8cf9e86e1 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:39.521615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d9f9b-544d-4a1d-998a-3ab8cf9e86e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:39.539564 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-281d9f9b-544d-4a1d-998a-3ab8cf9e86e1 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:39.540753 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-281d9f9b-544d-4a1d-998a-3ab8cf9e86e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:39.549306 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1315/2649] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:39.553530 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f3968-ae49-470f-8bf1-bdc290b76464 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:39.564171 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f3968-ae49-470f-8bf1-bdc290b76464 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:39.569018 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ec4bd-f2f5-4abd-bf74-8355209bdb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:39.569765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ec4bd-f2f5-4abd-bf74-8355209bdb05 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:39.570065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ec4bd-f2f5-4abd-bf74-8355209bdb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:39.570376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ec4bd-f2f5-4abd-bf74-8355209bdb05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:39.571167 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ec4bd-f2f5-4abd-bf74-8355209bdb05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:10:39.571496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ec4bd-f2f5-4abd-bf74-8355209bdb05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:39.573287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ec4bd-f2f5-4abd-bf74-8355209bdb05 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:39.585700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1335/2650] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:10:39.590061 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d9f9b-544d-4a1d-998a-3ab8cf9e86e1 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:39.599899 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d9f9b-544d-4a1d-998a-3ab8cf9e86e1 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:39.605719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e509021-8bf5-4359-9be2-1814ae983184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:39.606369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e509021-8bf5-4359-9be2-1814ae983184 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:39.606650 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e509021-8bf5-4359-9be2-1814ae983184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:39.606926 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e509021-8bf5-4359-9be2-1814ae983184 admin admin] PATH_INFO: `/v3/projects` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:39.607621 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e509021-8bf5-4359-9be2-1814ae983184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:39.609526 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e509021-8bf5-4359-9be2-1814ae983184 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:39.693111 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1316/2651] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:10:39 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:10:39.696628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ec4bd-f2f5-4abd-bf74-8355209bdb05 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:39.707473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ec4bd-f2f5-4abd-bf74-8355209bdb05 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:39.741602 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:39.777603 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34a9e9-79b3-4fc1-a8b5-f56315512733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:39.778867 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34a9e9-79b3-4fc1-a8b5-f56315512733 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:39.779232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34a9e9-79b3-4fc1-a8b5-f56315512733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:39.779525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34a9e9-79b3-4fc1-a8b5-f56315512733 admin admin] PATH_INFO: `/v3/users` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:39.780881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34a9e9-79b3-4fc1-a8b5-f56315512733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:39.783180 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34a9e9-79b3-4fc1-a8b5-f56315512733 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:39.908750 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1336/2652] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:10:39 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:39.912826 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e509021-8bf5-4359-9be2-1814ae983184 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:39.923969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e509021-8bf5-4359-9be2-1814ae983184 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:39.928817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4ae6c-9cad-40ec-b197-f1f5111c11f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:39.929541 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4ae6c-9cad-40ec-b197-f1f5111c11f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:39.929833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4ae6c-9cad-40ec-b197-f1f5111c11f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:39.930116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4ae6c-9cad-40ec-b197-f1f5111c11f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:39.930853 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4ae6c-9cad-40ec-b197-f1f5111c11f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:39.932604 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4ae6c-9cad-40ec-b197-f1f5111c11f1 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:39.943920 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1317/2653] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:39.948035 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34a9e9-79b3-4fc1-a8b5-f56315512733 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:39.958719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34a9e9-79b3-4fc1-a8b5-f56315512733 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:39.963557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44db2d-ab21-4bdd-b2c4-889fb539edad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:39.964308 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44db2d-ab21-4bdd-b2c4-889fb539edad admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:39.964596 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44db2d-ab21-4bdd-b2c4-889fb539edad admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:39.964878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44db2d-ab21-4bdd-b2c4-889fb539edad admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:39.965807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44db2d-ab21-4bdd-b2c4-889fb539edad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:39.967451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44db2d-ab21-4bdd-b2c4-889fb539edad admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:39.978367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1337/2654] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:39.982598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4ae6c-9cad-40ec-b197-f1f5111c11f1 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:39.992642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4ae6c-9cad-40ec-b197-f1f5111c11f1 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:39.997493 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6b7f7-99f7-4464-8b80-a442896667f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:39.998372 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6b7f7-99f7-4464-8b80-a442896667f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:39.998664 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6b7f7-99f7-4464-8b80-a442896667f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:39.999532 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6b7f7-99f7-4464-8b80-a442896667f2 admin admin] PATH_INFO: `/v3/projects/6be2f42995b7466bad6bced5650d3a08/users/f0ee766ca0be43bfb95ff59404b2b133/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:40.013902 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6b7f7-99f7-4464-8b80-a442896667f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be2f42995b7466bad6bced5650d3a08, user_id=f0ee766ca0be43bfb95ff59404b2b133, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:40.017121 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6b7f7-99f7-4464-8b80-a442896667f2 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:40.111658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1318/2655] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:39 2022] PUT /identity/v3/projects/6be2f42995b7466bad6bced5650d3a08/users/f0ee766ca0be43bfb95ff59404b2b133/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:40.124741 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b1661-7d90-4f86-8492-62097999ccb7 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:40.127519 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b1661-7d90-4f86-8492-62097999ccb7 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:40.127519 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b1661-7d90-4f86-8492-62097999ccb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:40.152172 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-0b4b1661-7d90-4f86-8492-62097999ccb7 None None] MFA Rules not processed for user `f0ee766ca0be43bfb95ff59404b2b133`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:40.153427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-0b4b1661-7d90-4f86-8492-62097999ccb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:40.225620 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1338/2656] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:40.240314 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6b7f7-99f7-4464-8b80-a442896667f2 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:40.242545 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e5c6b7f7-99f7-4464-8b80-a442896667f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:40.254649 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:40.305582 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6b7f7-99f7-4464-8b80-a442896667f2 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:40.310002 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e30bc-dd52-44c0-ab2c-60d842efa65c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:40.310658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e30bc-dd52-44c0-ab2c-60d842efa65c service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:40.311012 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e30bc-dd52-44c0-ab2c-60d842efa65c service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:40.311258 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e30bc-dd52-44c0-ab2c-60d842efa65c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:40.321438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e30bc-dd52-44c0-ab2c-60d842efa65c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:40.323032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e30bc-dd52-44c0-ab2c-60d842efa65c service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:40.333346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1319/2657] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:42.956927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8d2cd-bf2f-47b2-a64c-e934d06386dc None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:42.956927 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8d2cd-bf2f-47b2-a64c-e934d06386dc None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:42.957486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8d2cd-bf2f-47b2-a64c-e934d06386dc None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:42.959198 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1339/2658] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 16 15:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:10:42.976255 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33077c-61df-4527-81f8-1ed75bcdc748 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:42.976835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33077c-61df-4527-81f8-1ed75bcdc748 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:42.976835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33077c-61df-4527-81f8-1ed75bcdc748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:42.995618 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-0b33077c-61df-4527-81f8-1ed75bcdc748 None None] MFA Rules not processed for user `60c2f1c63a674e3195c490ab5ad1318f`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:42.996859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-0b33077c-61df-4527-81f8-1ed75bcdc748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:43.067050 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1320/2659] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 16 15:10:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:43.078852 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8d2cd-bf2f-47b2-a64c-e934d06386dc None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:43.080576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-cde8d2cd-bf2f-47b2-a64c-e934d06386dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:43.142834 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8d2cd-bf2f-47b2-a64c-e934d06386dc None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:43.146495 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e995fc-f5d5-4853-9cb8-d9d5a2a42471 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8f268ca2cb34c06b188908495cdcd53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:43.147137 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e995fc-f5d5-4853-9cb8-d9d5a2a42471 service glance] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:43.147447 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e995fc-f5d5-4853-9cb8-d9d5a2a42471 service glance] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:43.147726 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e995fc-f5d5-4853-9cb8-d9d5a2a42471 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:43.158222 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e995fc-f5d5-4853-9cb8-d9d5a2a42471 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:43.159636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e995fc-f5d5-4853-9cb8-d9d5a2a42471 service glance] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:43.171330 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1340/2660] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:10:43.401086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fedc1-08ed-4234-9c39-6494efe05f46 None None] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:43.401445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fedc1-08ed-4234-9c39-6494efe05f46 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:43.401734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fedc1-08ed-4234-9c39-6494efe05f46 None None] PATH_INFO: `/` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:43.403216 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1321/2661] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 16 15:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:10:43.408229 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00008a58-85e0-4f95-8415-446b6c4f1f7b None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:43.408524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00008a58-85e0-4f95-8415-446b6c4f1f7b None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:43.408824 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00008a58-85e0-4f95-8415-446b6c4f1f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:43.428368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-00008a58-85e0-4f95-8415-446b6c4f1f7b None None] MFA Rules not processed for user `db3b603ceffb43bc99684e0d2319e3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:43.429615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-00008a58-85e0-4f95-8415-446b6c4f1f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:43.473714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:43.481165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1341/2662] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 16 15:10:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:43.494010 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fedc1-08ed-4234-9c39-6494efe05f46 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:43.495868 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-037fedc1-08ed-4234-9c39-6494efe05f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:43.509884 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fedc1-08ed-4234-9c39-6494efe05f46 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:43.513590 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db3639-88a7-442c-b1dc-e19c9bbe4d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:43.514242 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db3639-88a7-442c-b1dc-e19c9bbe4d9a service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:43.514519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db3639-88a7-442c-b1dc-e19c9bbe4d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:43.514802 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db3639-88a7-442c-b1dc-e19c9bbe4d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:43.522290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db3639-88a7-442c-b1dc-e19c9bbe4d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:43.523769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db3639-88a7-442c-b1dc-e19c9bbe4d9a service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:43.532452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1322/2663] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:43.619696 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758dd33-1fa8-4d21-87ee-e3bf91e791f7 None None] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:43.620001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758dd33-1fa8-4d21-87ee-e3bf91e791f7 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:43.620303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758dd33-1fa8-4d21-87ee-e3bf91e791f7 None None] PATH_INFO: `/` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:43.624150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1342/2664] 10.222.0.23 () {54 vars in 921 bytes} [Thu Jun 16 15:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 15:10:43.627055 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e2385-f7d4-4978-bcb2-5b5e5b7924ec None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:43.627383 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e2385-f7d4-4978-bcb2-5b5e5b7924ec None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:43.627669 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e2385-f7d4-4978-bcb2-5b5e5b7924ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:43.646442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-065e2385-f7d4-4978-bcb2-5b5e5b7924ec None None] MFA Rules not processed for user `60c2f1c63a674e3195c490ab5ad1318f`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:43.647722 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-065e2385-f7d4-4978-bcb2-5b5e5b7924ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:43.658816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1323/2665] 10.222.0.23 () {58 vars in 1018 bytes} [Thu Jun 16 15:10:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:43.670362 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758dd33-1fa8-4d21-87ee-e3bf91e791f7 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:43.673956 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2758dd33-1fa8-4d21-87ee-e3bf91e791f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:43.696163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758dd33-1fa8-4d21-87ee-e3bf91e791f7 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:43.701420 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3a516-c511-4350-9b1c-ffb183d1c7b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:43.701912 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3a516-c511-4350-9b1c-ffb183d1c7b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:43.702225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3a516-c511-4350-9b1c-ffb183d1c7b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:43.702509 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3a516-c511-4350-9b1c-ffb183d1c7b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:43.713862 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3a516-c511-4350-9b1c-ffb183d1c7b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:43.715419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3a516-c511-4350-9b1c-ffb183d1c7b5 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:43.727317 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1343/2666] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:44.740641 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e2385-f7d4-4978-bcb2-5b5e5b7924ec None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:44.792305 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e2385-f7d4-4978-bcb2-5b5e5b7924ec None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:44.797067 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fd92f-8092-4aee-b096-74a7ac35ebf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:44.797982 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fd92f-8092-4aee-b096-74a7ac35ebf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:44.798276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fd92f-8092-4aee-b096-74a7ac35ebf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:44.798563 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fd92f-8092-4aee-b096-74a7ac35ebf8 admin admin] PATH_INFO: `/v3/users/f0ee766ca0be43bfb95ff59404b2b133` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:44.799769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fd92f-8092-4aee-b096-74a7ac35ebf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ee766ca0be43bfb95ff59404b2b133)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:44.801887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fd92f-8092-4aee-b096-74a7ac35ebf8 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:45.115038 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:45.276600 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-410fd92f-8092-4aee-b096-74a7ac35ebf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ee766ca0be43bfb95ff59404b2b133'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:45.277420 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-410fd92f-8092-4aee-b096-74a7ac35ebf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ee766ca0be43bfb95ff59404b2b133'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:45.285168 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-410fd92f-8092-4aee-b096-74a7ac35ebf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ee766ca0be43bfb95ff59404b2b133'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:45.285893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-410fd92f-8092-4aee-b096-74a7ac35ebf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ee766ca0be43bfb95ff59404b2b133'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:45.502356 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-410fd92f-8092-4aee-b096-74a7ac35ebf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ee766ca0be43bfb95ff59404b2b133'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:45.521473 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1324/2667] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:10:44 2022] DELETE /identity/v3/users/f0ee766ca0be43bfb95ff59404b2b133 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:45.546586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22074a6-e046-476a-9853-ea4c3e185181 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:45.546586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22074a6-e046-476a-9853-ea4c3e185181 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:45.546586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22074a6-e046-476a-9853-ea4c3e185181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:45.546586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-a22074a6-e046-476a-9853-ea4c3e185181 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:45.547377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a22074a6-e046-476a-9853-ea4c3e185181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:45.605673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1344/2668] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:45.615943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fd92f-8092-4aee-b096-74a7ac35ebf8 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:45.617533 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-410fd92f-8092-4aee-b096-74a7ac35ebf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:45.684281 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fd92f-8092-4aee-b096-74a7ac35ebf8 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:45.684281 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f142e-29d5-456d-8b07-7090436a2fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:45.684281 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f142e-29d5-456d-8b07-7090436a2fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:45.684281 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f142e-29d5-456d-8b07-7090436a2fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:45.684747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f142e-29d5-456d-8b07-7090436a2fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:45.690642 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f142e-29d5-456d-8b07-7090436a2fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:45.692066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f142e-29d5-456d-8b07-7090436a2fa6 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:45.701349 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1325/2669] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:46.431826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22074a6-e046-476a-9853-ea4c3e185181 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:46.433469 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a22074a6-e046-476a-9853-ea4c3e185181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:46.446391 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22074a6-e046-476a-9853-ea4c3e185181 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:46.451516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0456ff-8063-4988-85ac-dfbdfe10beb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:46.453051 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0456ff-8063-4988-85ac-dfbdfe10beb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:46.453391 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0456ff-8063-4988-85ac-dfbdfe10beb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:46.453734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0456ff-8063-4988-85ac-dfbdfe10beb7 admin admin] PATH_INFO: `/v3/projects/6be2f42995b7466bad6bced5650d3a08` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:46.460686 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0456ff-8063-4988-85ac-dfbdfe10beb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be2f42995b7466bad6bced5650d3a08)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:46.460686 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0456ff-8063-4988-85ac-dfbdfe10beb7 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:46.792463 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-fc0456ff-8063-4988-85ac-dfbdfe10beb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be2f42995b7466bad6bced5650d3a08', 'request_id': 'req-fc0456ff-8063-4988-85ac-dfbdfe10beb7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:46.799557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-fc0456ff-8063-4988-85ac-dfbdfe10beb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be2f42995b7466bad6bced5650d3a08', 'request_id': 'req-fc0456ff-8063-4988-85ac-dfbdfe10beb7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:46.805856 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-fc0456ff-8063-4988-85ac-dfbdfe10beb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be2f42995b7466bad6bced5650d3a08', 'request_id': 'req-fc0456ff-8063-4988-85ac-dfbdfe10beb7'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:46.943984 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-fc0456ff-8063-4988-85ac-dfbdfe10beb7 admin admin] The token cache is being invalidate because project 6be2f42995b7466bad6bced5650d3a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:10:46.944362 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-fc0456ff-8063-4988-85ac-dfbdfe10beb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:46.945091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-fc0456ff-8063-4988-85ac-dfbdfe10beb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:46.946812 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1345/2670] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:10:46 2022] DELETE /identity/v3/projects/6be2f42995b7466bad6bced5650d3a08 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:46.951657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d85c91-192d-4ed7-84c9-b470541d17be None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:46.952206 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d85c91-192d-4ed7-84c9-b470541d17be None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:46.952324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d85c91-192d-4ed7-84c9-b470541d17be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:46.976251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-37d85c91-192d-4ed7-84c9-b470541d17be None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:46.976251 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-37d85c91-192d-4ed7-84c9-b470541d17be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:47.034116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1326/2671] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:47.042111 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a7c9c-3988-4f63-b9a8-1e6aadb08df8 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:47.042403 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a7c9c-3988-4f63-b9a8-1e6aadb08df8 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:47.042685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a7c9c-3988-4f63-b9a8-1e6aadb08df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:47.062873 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-108a7c9c-3988-4f63-b9a8-1e6aadb08df8 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:47.064104 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-108a7c9c-3988-4f63-b9a8-1e6aadb08df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:47.072581 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1346/2672] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:47.077187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d85c91-192d-4ed7-84c9-b470541d17be None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:47.087096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d85c91-192d-4ed7-84c9-b470541d17be None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:47.091746 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156208b-1c99-49ad-b91f-2ad0145f8d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:47.092445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156208b-1c99-49ad-b91f-2ad0145f8d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:47.092758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156208b-1c99-49ad-b91f-2ad0145f8d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:47.093116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156208b-1c99-49ad-b91f-2ad0145f8d1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:47.093998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156208b-1c99-49ad-b91f-2ad0145f8d1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:10:47.094326 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156208b-1c99-49ad-b91f-2ad0145f8d1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:47.096058 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156208b-1c99-49ad-b91f-2ad0145f8d1d admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:47.110882 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1327/2673] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:10:47.115228 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a7c9c-3988-4f63-b9a8-1e6aadb08df8 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:47.126608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a7c9c-3988-4f63-b9a8-1e6aadb08df8 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:47.132122 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bef56-c57d-4ced-b4be-5cca811d2fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:47.132830 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bef56-c57d-4ced-b4be-5cca811d2fea admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:47.133113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bef56-c57d-4ced-b4be-5cca811d2fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:47.133578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bef56-c57d-4ced-b4be-5cca811d2fea admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:47.134299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bef56-c57d-4ced-b4be-5cca811d2fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:47.136412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bef56-c57d-4ced-b4be-5cca811d2fea admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:47.319251 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1347/2674] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:10:47 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:47.323578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156208b-1c99-49ad-b91f-2ad0145f8d1d admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:47.334605 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156208b-1c99-49ad-b91f-2ad0145f8d1d admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:47.366132 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:47.394156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d154a2-6748-4f30-9340-95fc00b07883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:47.394857 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d154a2-6748-4f30-9340-95fc00b07883 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:47.396877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d154a2-6748-4f30-9340-95fc00b07883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:47.396877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d154a2-6748-4f30-9340-95fc00b07883 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:47.396877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d154a2-6748-4f30-9340-95fc00b07883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:47.398026 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d154a2-6748-4f30-9340-95fc00b07883 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:47.615274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1328/2675] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:10:47 2022] POST /identity/v3/users => generated 285 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:10:47.616892 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bef56-c57d-4ced-b4be-5cca811d2fea admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:47.628099 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bef56-c57d-4ced-b4be-5cca811d2fea admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:47.633106 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e5c52-a42e-4532-9fc5-0615384fb350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:47.633841 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e5c52-a42e-4532-9fc5-0615384fb350 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:47.634138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e5c52-a42e-4532-9fc5-0615384fb350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:47.634583 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e5c52-a42e-4532-9fc5-0615384fb350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:47.635344 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e5c52-a42e-4532-9fc5-0615384fb350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:47.637045 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e5c52-a42e-4532-9fc5-0615384fb350 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:47.652700 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1348/2676] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:47.654425 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d154a2-6748-4f30-9340-95fc00b07883 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:47.666279 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d154a2-6748-4f30-9340-95fc00b07883 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:47.671260 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e28a9-0a0d-4bab-a176-1e01e7b03849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:47.672104 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e28a9-0a0d-4bab-a176-1e01e7b03849 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:47.672394 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e28a9-0a0d-4bab-a176-1e01e7b03849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:47.672523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e28a9-0a0d-4bab-a176-1e01e7b03849 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:47.673311 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e28a9-0a0d-4bab-a176-1e01e7b03849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:47.674977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e28a9-0a0d-4bab-a176-1e01e7b03849 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:47.688777 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1329/2677] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 15:10:47.693488 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e5c52-a42e-4532-9fc5-0615384fb350 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:47.705523 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e5c52-a42e-4532-9fc5-0615384fb350 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:47.710926 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded41b9a-829a-417a-89b4-f91ea582a766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:47.712191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded41b9a-829a-417a-89b4-f91ea582a766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:47.712510 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded41b9a-829a-417a-89b4-f91ea582a766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:47.712774 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded41b9a-829a-417a-89b4-f91ea582a766 admin admin] PATH_INFO: `/v3/projects/3d5fb305075747e6b42fc4e46abe1f9a/users/2c7a26f8efc64e899d9ff55b95b8e1d8/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:47.731589 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded41b9a-829a-417a-89b4-f91ea582a766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5fb305075747e6b42fc4e46abe1f9a, user_id=2c7a26f8efc64e899d9ff55b95b8e1d8, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:47.734574 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded41b9a-829a-417a-89b4-f91ea582a766 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:47.910255 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1349/2678] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:47 2022] PUT /identity/v3/projects/3d5fb305075747e6b42fc4e46abe1f9a/users/2c7a26f8efc64e899d9ff55b95b8e1d8/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:47.921181 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6ecdd-d5a3-4afd-92d7-eb4ba9001180 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:47.921473 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6ecdd-d5a3-4afd-92d7-eb4ba9001180 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:47.921759 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6ecdd-d5a3-4afd-92d7-eb4ba9001180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:47.947515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-4be6ecdd-d5a3-4afd-92d7-eb4ba9001180 None None] MFA Rules not processed for user `2c7a26f8efc64e899d9ff55b95b8e1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:47.948755 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4be6ecdd-d5a3-4afd-92d7-eb4ba9001180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:48.013746 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1330/2679] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:48.025914 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded41b9a-829a-417a-89b4-f91ea582a766 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:48.027906 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ded41b9a-829a-417a-89b4-f91ea582a766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:48.035348 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:48.087348 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded41b9a-829a-417a-89b4-f91ea582a766 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:48.091240 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77ac65-04b3-4928-9027-57f9f8fcd27e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8f268ca2cb34c06b188908495cdcd53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:48.091889 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77ac65-04b3-4928-9027-57f9f8fcd27e service glance] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:48.092173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77ac65-04b3-4928-9027-57f9f8fcd27e service glance] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:48.092451 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77ac65-04b3-4928-9027-57f9f8fcd27e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:48.100912 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77ac65-04b3-4928-9027-57f9f8fcd27e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:48.102760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77ac65-04b3-4928-9027-57f9f8fcd27e service glance] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:48.113147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1350/2680] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:49.689445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6ecdd-d5a3-4afd-92d7-eb4ba9001180 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:49.690955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-4be6ecdd-d5a3-4afd-92d7-eb4ba9001180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:49.764908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6ecdd-d5a3-4afd-92d7-eb4ba9001180 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:49.771496 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1c92e-c9be-42c3-889d-a95a3d040321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:49.772179 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1c92e-c9be-42c3-889d-a95a3d040321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:49.772447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1c92e-c9be-42c3-889d-a95a3d040321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:49.772909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1c92e-c9be-42c3-889d-a95a3d040321 admin admin] PATH_INFO: `/v3/users/fa3f0f683eaa4020bee2f00a269e5a98` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:49.774236 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1c92e-c9be-42c3-889d-a95a3d040321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3f0f683eaa4020bee2f00a269e5a98)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:49.776205 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1c92e-c9be-42c3-889d-a95a3d040321 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:49.792136 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedfc03-7ba2-4ad7-babe-b2287fbb67f3 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:49.793060 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedfc03-7ba2-4ad7-babe-b2287fbb67f3 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:49.794148 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedfc03-7ba2-4ad7-babe-b2287fbb67f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:49.812935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-9bedfc03-7ba2-4ad7-babe-b2287fbb67f3 None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:49.814208 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9bedfc03-7ba2-4ad7-babe-b2287fbb67f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:49.871124 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1351/2681] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 16 15:10:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:10:49.885497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedfc03-7ba2-4ad7-babe-b2287fbb67f3 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:49.887144 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9bedfc03-7ba2-4ad7-babe-b2287fbb67f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:49.961011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedfc03-7ba2-4ad7-babe-b2287fbb67f3 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:49.966897 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86831b5e-9182-4c06-917b-a0967bee0dc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:49.967636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86831b5e-9182-4c06-917b-a0967bee0dc5 service swift] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:49.968013 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86831b5e-9182-4c06-917b-a0967bee0dc5 service swift] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:49.968384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86831b5e-9182-4c06-917b-a0967bee0dc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:49.982162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86831b5e-9182-4c06-917b-a0967bee0dc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:49.984372 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86831b5e-9182-4c06-917b-a0967bee0dc5 service swift] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:49.992751 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1352/2682] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 15:10:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 15:10:50.218225 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c3b1c92e-c9be-42c3-889d-a95a3d040321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3f0f683eaa4020bee2f00a269e5a98'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:50.218893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c3b1c92e-c9be-42c3-889d-a95a3d040321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3f0f683eaa4020bee2f00a269e5a98'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:50.225801 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c3b1c92e-c9be-42c3-889d-a95a3d040321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3f0f683eaa4020bee2f00a269e5a98'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:50.226453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c3b1c92e-c9be-42c3-889d-a95a3d040321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3f0f683eaa4020bee2f00a269e5a98'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:50.468814 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c3b1c92e-c9be-42c3-889d-a95a3d040321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3f0f683eaa4020bee2f00a269e5a98'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:50.499662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1331/2683] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:10:49 2022] DELETE /identity/v3/users/fa3f0f683eaa4020bee2f00a269e5a98 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:50.503914 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fcc3a-3a4b-4568-a963-7849b4ed47d6 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:50.504416 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fcc3a-3a4b-4568-a963-7849b4ed47d6 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:50.504842 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fcc3a-3a4b-4568-a963-7849b4ed47d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:50.532504 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-989fcc3a-3a4b-4568-a963-7849b4ed47d6 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:50.533961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-989fcc3a-3a4b-4568-a963-7849b4ed47d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:50.640768 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1353/2684] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:50.651106 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1c92e-c9be-42c3-889d-a95a3d040321 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:50.652743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c3b1c92e-c9be-42c3-889d-a95a3d040321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:50.729886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1c92e-c9be-42c3-889d-a95a3d040321 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:50.732553 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:50.736476 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627b348-b008-4793-a4aa-9e2ef4f50023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:50.737267 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627b348-b008-4793-a4aa-9e2ef4f50023 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:50.737564 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627b348-b008-4793-a4aa-9e2ef4f50023 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:50.737845 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627b348-b008-4793-a4aa-9e2ef4f50023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:50.749316 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627b348-b008-4793-a4aa-9e2ef4f50023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:50.757919 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627b348-b008-4793-a4aa-9e2ef4f50023 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:50.761524 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1332/2685] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:10:51.209784 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:51.467204 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fcc3a-3a4b-4568-a963-7849b4ed47d6 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:51.468709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-989fcc3a-3a4b-4568-a963-7849b4ed47d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:51.482373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fcc3a-3a4b-4568-a963-7849b4ed47d6 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:51.505714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d219-9451-486b-9bae-d73170199f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:51.507079 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d219-9451-486b-9bae-d73170199f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:51.507637 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d219-9451-486b-9bae-d73170199f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:51.508142 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d219-9451-486b-9bae-d73170199f39 admin admin] PATH_INFO: `/v3/projects/bdf4e3c87252420aa5ce1e6a3c486fc6` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:51.509619 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0d219-9451-486b-9bae-d73170199f39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf4e3c87252420aa5ce1e6a3c486fc6)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:51.512118 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0d219-9451-486b-9bae-d73170199f39 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:51.746095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-98a0d219-9451-486b-9bae-d73170199f39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf4e3c87252420aa5ce1e6a3c486fc6', 'request_id': 'req-98a0d219-9451-486b-9bae-d73170199f39'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:51.753396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-98a0d219-9451-486b-9bae-d73170199f39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf4e3c87252420aa5ce1e6a3c486fc6', 'request_id': 'req-98a0d219-9451-486b-9bae-d73170199f39'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:51.761786 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-98a0d219-9451-486b-9bae-d73170199f39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf4e3c87252420aa5ce1e6a3c486fc6', 'request_id': 'req-98a0d219-9451-486b-9bae-d73170199f39'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:52.000694 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-98a0d219-9451-486b-9bae-d73170199f39 admin admin] The token cache is being invalidate because project bdf4e3c87252420aa5ce1e6a3c486fc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:10:52.000993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-98a0d219-9451-486b-9bae-d73170199f39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:52.001782 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-98a0d219-9451-486b-9bae-d73170199f39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:52.003563 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1354/2686] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:10:51 2022] DELETE /identity/v3/projects/bdf4e3c87252420aa5ce1e6a3c486fc6 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:52.007511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627b348-b008-4793-a4aa-9e2ef4f50023 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:52.019560 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627b348-b008-4793-a4aa-9e2ef4f50023 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:52.081071 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab4257-f70a-4b35-b2ed-150dd319f122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:52.081966 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab4257-f70a-4b35-b2ed-150dd319f122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:52.082278 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab4257-f70a-4b35-b2ed-150dd319f122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:52.082561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab4257-f70a-4b35-b2ed-150dd319f122 admin admin] PATH_INFO: `/v3/users/fec1c698e4c041b88939b294e29a7650` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:52.086908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab4257-f70a-4b35-b2ed-150dd319f122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fec1c698e4c041b88939b294e29a7650)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:52.086908 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab4257-f70a-4b35-b2ed-150dd319f122 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:52.500946 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c9ab4257-f70a-4b35-b2ed-150dd319f122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fec1c698e4c041b88939b294e29a7650'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:52.501628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c9ab4257-f70a-4b35-b2ed-150dd319f122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fec1c698e4c041b88939b294e29a7650'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:52.510044 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c9ab4257-f70a-4b35-b2ed-150dd319f122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fec1c698e4c041b88939b294e29a7650'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:52.510733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c9ab4257-f70a-4b35-b2ed-150dd319f122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fec1c698e4c041b88939b294e29a7650'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:52.679571 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-c9ab4257-f70a-4b35-b2ed-150dd319f122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fec1c698e4c041b88939b294e29a7650'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:52.688729 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:52.705615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1333/2687] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:10:52 2022] DELETE /identity/v3/users/fec1c698e4c041b88939b294e29a7650 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:53.316586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d219-9451-486b-9bae-d73170199f39 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:53.319066 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-98a0d219-9451-486b-9bae-d73170199f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:53.334445 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d219-9451-486b-9bae-d73170199f39 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:53.440151 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416f823-5632-413a-88bb-cc2fb12e60b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:53.441126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416f823-5632-413a-88bb-cc2fb12e60b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:53.441529 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416f823-5632-413a-88bb-cc2fb12e60b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:53.441886 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416f823-5632-413a-88bb-cc2fb12e60b6 admin admin] PATH_INFO: `/v3/projects/838f0103f2744eafb1a4f04663b4cc36` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:53.444136 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416f823-5632-413a-88bb-cc2fb12e60b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=838f0103f2744eafb1a4f04663b4cc36)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:53.446653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416f823-5632-413a-88bb-cc2fb12e60b6 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:53.573757 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b416f823-5632-413a-88bb-cc2fb12e60b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '838f0103f2744eafb1a4f04663b4cc36', 'request_id': 'req-b416f823-5632-413a-88bb-cc2fb12e60b6'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:53.583331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b416f823-5632-413a-88bb-cc2fb12e60b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '838f0103f2744eafb1a4f04663b4cc36', 'request_id': 'req-b416f823-5632-413a-88bb-cc2fb12e60b6'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:53.599857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b416f823-5632-413a-88bb-cc2fb12e60b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '838f0103f2744eafb1a4f04663b4cc36', 'request_id': 'req-b416f823-5632-413a-88bb-cc2fb12e60b6'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:53.599857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:53.718647 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b416f823-5632-413a-88bb-cc2fb12e60b6 admin admin] The token cache is being invalidate because project 838f0103f2744eafb1a4f04663b4cc36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:10:53.719849 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b416f823-5632-413a-88bb-cc2fb12e60b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:53.720145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-b416f823-5632-413a-88bb-cc2fb12e60b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:10:53.721916 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1355/2688] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:10:53 2022] DELETE /identity/v3/projects/838f0103f2744eafb1a4f04663b4cc36 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:53.726949 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf36aae-a191-47a5-bffa-0bcbb3d14dfb None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:53.727598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf36aae-a191-47a5-bffa-0bcbb3d14dfb None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:53.727598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf36aae-a191-47a5-bffa-0bcbb3d14dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:53.751090 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-baf36aae-a191-47a5-bffa-0bcbb3d14dfb None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:53.752336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-baf36aae-a191-47a5-bffa-0bcbb3d14dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:53.839263 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1334/2689] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:53.850667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7f75c-df3d-4f7f-a52b-3326ed761b98 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:53.850667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7f75c-df3d-4f7f-a52b-3326ed761b98 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:53.850667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7f75c-df3d-4f7f-a52b-3326ed761b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:53.901775 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-8aa7f75c-df3d-4f7f-a52b-3326ed761b98 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:53.903348 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-8aa7f75c-df3d-4f7f-a52b-3326ed761b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:53.935658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1356/2690] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:53.941024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf36aae-a191-47a5-bffa-0bcbb3d14dfb None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:53.951557 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf36aae-a191-47a5-bffa-0bcbb3d14dfb None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:53.956959 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42834b82-81a4-431d-9b65-23fb97199e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:53.957751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42834b82-81a4-431d-9b65-23fb97199e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:53.958116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42834b82-81a4-431d-9b65-23fb97199e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:53.958853 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42834b82-81a4-431d-9b65-23fb97199e0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:53.959287 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42834b82-81a4-431d-9b65-23fb97199e0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:10:53.959799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42834b82-81a4-431d-9b65-23fb97199e0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:53.961544 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42834b82-81a4-431d-9b65-23fb97199e0e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:53.978485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1335/2691] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:10:53.983941 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7f75c-df3d-4f7f-a52b-3326ed761b98 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:54.003687 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7f75c-df3d-4f7f-a52b-3326ed761b98 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:54.009410 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4c1f8-f7e7-4334-82f6-ce007345b315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:54.010090 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4c1f8-f7e7-4334-82f6-ce007345b315 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:54.010383 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4c1f8-f7e7-4334-82f6-ce007345b315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:54.011064 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4c1f8-f7e7-4334-82f6-ce007345b315 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:54.011959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4c1f8-f7e7-4334-82f6-ce007345b315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:54.013922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4c1f8-f7e7-4334-82f6-ce007345b315 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:54.301670 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1357/2692] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:10:53 2022] POST /identity/v3/projects => generated 375 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:54.302961 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42834b82-81a4-431d-9b65-23fb97199e0e admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:54.313896 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42834b82-81a4-431d-9b65-23fb97199e0e admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:54.394486 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd4114-3c87-4bc3-ba92-edb0d603d1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:54.395175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd4114-3c87-4bc3-ba92-edb0d603d1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:54.395467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd4114-3c87-4bc3-ba92-edb0d603d1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:54.395751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd4114-3c87-4bc3-ba92-edb0d603d1e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:54.396452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd4114-3c87-4bc3-ba92-edb0d603d1e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:54.398523 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd4114-3c87-4bc3-ba92-edb0d603d1e2 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:54.520779 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1336/2693] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:10:54 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:54.531144 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4c1f8-f7e7-4334-82f6-ce007345b315 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:54.545374 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4c1f8-f7e7-4334-82f6-ce007345b315 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:54.551222 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4744c7-0d1d-4f23-a3f3-f698ca5b390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:54.556661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4744c7-0d1d-4f23-a3f3-f698ca5b390f admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:54.556661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4744c7-0d1d-4f23-a3f3-f698ca5b390f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:54.556661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4744c7-0d1d-4f23-a3f3-f698ca5b390f admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:54.556661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4744c7-0d1d-4f23-a3f3-f698ca5b390f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:54.556661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4744c7-0d1d-4f23-a3f3-f698ca5b390f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:54.568151 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1358/2694] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:54.572324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd4114-3c87-4bc3-ba92-edb0d603d1e2 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:54.583350 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd4114-3c87-4bc3-ba92-edb0d603d1e2 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:54.588706 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c289e6c-ce83-4a2a-8f5c-12f5feb69bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:54.589443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c289e6c-ce83-4a2a-8f5c-12f5feb69bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:54.592956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c289e6c-ce83-4a2a-8f5c-12f5feb69bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:54.592956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c289e6c-ce83-4a2a-8f5c-12f5feb69bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:54.592956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c289e6c-ce83-4a2a-8f5c-12f5feb69bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:54.592956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c289e6c-ce83-4a2a-8f5c-12f5feb69bc8 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:54.608688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4744c7-0d1d-4f23-a3f3-f698ca5b390f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:54.617254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1337/2695] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:54.632804 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4744c7-0d1d-4f23-a3f3-f698ca5b390f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:54.639279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f42bb-e68a-4e3c-82a8-a33998e2b80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:54.645230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f42bb-e68a-4e3c-82a8-a33998e2b80e admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:54.645230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f42bb-e68a-4e3c-82a8-a33998e2b80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:54.645230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f42bb-e68a-4e3c-82a8-a33998e2b80e admin admin] PATH_INFO: `/v3/projects/f21ccb3790e14a008df11703b48df604/users/3355ce7072d742eb9a65f133d825cfb5/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:54.658756 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f42bb-e68a-4e3c-82a8-a33998e2b80e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f21ccb3790e14a008df11703b48df604, user_id=3355ce7072d742eb9a65f133d825cfb5, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:54.661650 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f42bb-e68a-4e3c-82a8-a33998e2b80e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:54.755676 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1359/2696] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:54 2022] PUT /identity/v3/projects/f21ccb3790e14a008df11703b48df604/users/3355ce7072d742eb9a65f133d825cfb5/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:10:54.766781 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87f67-1173-4e3b-9d2f-7965eaee6987 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:54.767328 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87f67-1173-4e3b-9d2f-7965eaee6987 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:54.767499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b87f67-1173-4e3b-9d2f-7965eaee6987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:54.824173 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-06b87f67-1173-4e3b-9d2f-7965eaee6987 None None] MFA Rules not processed for user `3355ce7072d742eb9a65f133d825cfb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:54.825506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-06b87f67-1173-4e3b-9d2f-7965eaee6987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:54.870408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:54.901181 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1338/2697] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:10:54.905755 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f42bb-e68a-4e3c-82a8-a33998e2b80e admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:54.977261 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f42bb-e68a-4e3c-82a8-a33998e2b80e admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:54.982766 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d573c-446e-41a1-b110-37294e076a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:54.983501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d573c-446e-41a1-b110-37294e076a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:54.983847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d573c-446e-41a1-b110-37294e076a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:54.984145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d573c-446e-41a1-b110-37294e076a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:54.984986 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d573c-446e-41a1-b110-37294e076a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:54.987168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d573c-446e-41a1-b110-37294e076a6a admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:55.096822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1360/2698] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:10:54 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:55.100886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b87f67-1173-4e3b-9d2f-7965eaee6987 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:55.115071 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b87f67-1173-4e3b-9d2f-7965eaee6987 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:55.221022 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae986ee-8309-457d-8b28-2e3f7891223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:55.221911 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae986ee-8309-457d-8b28-2e3f7891223c admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:55.222199 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae986ee-8309-457d-8b28-2e3f7891223c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:55.222476 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae986ee-8309-457d-8b28-2e3f7891223c admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:55.223206 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae986ee-8309-457d-8b28-2e3f7891223c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:55.225334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae986ee-8309-457d-8b28-2e3f7891223c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:55.386395 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1339/2699] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:10:55 2022] POST /identity/v3/users => generated 294 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:10:55.390323 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d573c-446e-41a1-b110-37294e076a6a admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:55.402157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d573c-446e-41a1-b110-37294e076a6a admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:55.407695 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67f366-47d3-40b5-b6d0-540cc72ed662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:55.408598 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67f366-47d3-40b5-b6d0-540cc72ed662 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:55.408944 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67f366-47d3-40b5-b6d0-540cc72ed662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:55.409554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67f366-47d3-40b5-b6d0-540cc72ed662 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:55.410154 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67f366-47d3-40b5-b6d0-540cc72ed662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:55.411838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67f366-47d3-40b5-b6d0-540cc72ed662 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:55.425526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1361/2700] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:55.447101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae986ee-8309-457d-8b28-2e3f7891223c admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:55.461272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae986ee-8309-457d-8b28-2e3f7891223c admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:55.467235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440976a2-4cb8-4169-aa69-482be17c0e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:55.468659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440976a2-4cb8-4169-aa69-482be17c0e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:55.468956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440976a2-4cb8-4169-aa69-482be17c0e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:55.469309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440976a2-4cb8-4169-aa69-482be17c0e31 admin admin] PATH_INFO: `/v3/projects/fd53416252834ecfb3a93be1ba8c5de4/users/5904f8c3f936445199f80415df77efb0/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:55.497103 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440976a2-4cb8-4169-aa69-482be17c0e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd53416252834ecfb3a93be1ba8c5de4, user_id=5904f8c3f936445199f80415df77efb0, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:55.500874 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440976a2-4cb8-4169-aa69-482be17c0e31 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:55.587834 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1340/2701] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:55 2022] PUT /identity/v3/projects/fd53416252834ecfb3a93be1ba8c5de4/users/5904f8c3f936445199f80415df77efb0/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:55.591955 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67f366-47d3-40b5-b6d0-540cc72ed662 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:55.603322 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67f366-47d3-40b5-b6d0-540cc72ed662 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:55.665435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b4bc7-d13b-42f5-9bb9-21e963568719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:55.666121 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b4bc7-d13b-42f5-9bb9-21e963568719 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:55.666408 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b4bc7-d13b-42f5-9bb9-21e963568719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:55.666687 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b4bc7-d13b-42f5-9bb9-21e963568719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:55.667436 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b4bc7-d13b-42f5-9bb9-21e963568719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:55.669171 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b4bc7-d13b-42f5-9bb9-21e963568719 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:55.681913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1362/2702] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:10:55.686050 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440976a2-4cb8-4169-aa69-482be17c0e31 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:55.696468 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440976a2-4cb8-4169-aa69-482be17c0e31 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:55.701754 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9c753-cac5-4d0d-9b09-02426c03e2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:55.702805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9c753-cac5-4d0d-9b09-02426c03e2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:55.703187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9c753-cac5-4d0d-9b09-02426c03e2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:55.703573 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9c753-cac5-4d0d-9b09-02426c03e2a5 admin admin] PATH_INFO: `/v3/projects/fd53416252834ecfb3a93be1ba8c5de4/users/5904f8c3f936445199f80415df77efb0/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:55.705751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9c753-cac5-4d0d-9b09-02426c03e2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd53416252834ecfb3a93be1ba8c5de4, user_id=5904f8c3f936445199f80415df77efb0, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:55.708637 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9c753-cac5-4d0d-9b09-02426c03e2a5 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:55.720630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1341/2703] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:10:55 2022] PUT /identity/v3/projects/fd53416252834ecfb3a93be1ba8c5de4/users/5904f8c3f936445199f80415df77efb0/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:10:55.732470 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746f797-6cc9-4849-a8a8-877e15f1f0ab None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:55.732764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746f797-6cc9-4849-a8a8-877e15f1f0ab None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:55.734826 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746f797-6cc9-4849-a8a8-877e15f1f0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:55.743979 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:55.776976 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-5746f797-6cc9-4849-a8a8-877e15f1f0ab None None] MFA Rules not processed for user `5904f8c3f936445199f80415df77efb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:10:55.778507 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5746f797-6cc9-4849-a8a8-877e15f1f0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:55.904878 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1363/2704] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:10:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:10:55.946678 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9c753-cac5-4d0d-9b09-02426c03e2a5 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:10:55.948821 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-fda9c753-cac5-4d0d-9b09-02426c03e2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:10:56.072771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9c753-cac5-4d0d-9b09-02426c03e2a5 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:10:56.086163 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3aabf-c6d2-4f58-9a20-d39a698fb96f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:10:56.086852 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3aabf-c6d2-4f58-9a20-d39a698fb96f service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:10:56.087146 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3aabf-c6d2-4f58-9a20-d39a698fb96f service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:10:56.087434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3aabf-c6d2-4f58-9a20-d39a698fb96f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:10:56.170473 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:56.199739 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3aabf-c6d2-4f58-9a20-d39a698fb96f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:10:56.202384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3aabf-c6d2-4f58-9a20-d39a698fb96f service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:10:56.224054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1342/2705] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:10:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:02.106727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746f797-6cc9-4849-a8a8-877e15f1f0ab None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:02.117175 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746f797-6cc9-4849-a8a8-877e15f1f0ab None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:02.121222 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576442d-80ed-4caa-aea4-0b86b96f6e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:02.121857 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576442d-80ed-4caa-aea4-0b86b96f6e32 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:02.122140 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576442d-80ed-4caa-aea4-0b86b96f6e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:02.122431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576442d-80ed-4caa-aea4-0b86b96f6e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:02.131948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576442d-80ed-4caa-aea4-0b86b96f6e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:02.133405 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576442d-80ed-4caa-aea4-0b86b96f6e32 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:02.142716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1364/2706] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:06.263499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=7 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:09.424490 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57801ee-3944-45a5-b9ad-7bbfdaa2f5c2 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:09.425066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57801ee-3944-45a5-b9ad-7bbfdaa2f5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:09.425066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57801ee-3944-45a5-b9ad-7bbfdaa2f5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:09.442681 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-d57801ee-3944-45a5-b9ad-7bbfdaa2f5c2 None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:09.445167 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d57801ee-3944-45a5-b9ad-7bbfdaa2f5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:09.507657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1343/2707] 10.222.0.23 () {58 vars in 967 bytes} [Thu Jun 16 15:11:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:09.524011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576442d-80ed-4caa-aea4-0b86b96f6e32 service cinder] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:09.524011 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b576442d-80ed-4caa-aea4-0b86b96f6e32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:09.621574 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576442d-80ed-4caa-aea4-0b86b96f6e32 service cinder] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:09.626991 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82850ad2-82dc-4f71-b0e9-be6cf98e4d3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:09.627661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82850ad2-82dc-4f71-b0e9-be6cf98e4d3b service swift] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:09.629295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82850ad2-82dc-4f71-b0e9-be6cf98e4d3b service swift] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:09.629295 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82850ad2-82dc-4f71-b0e9-be6cf98e4d3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:09.637499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82850ad2-82dc-4f71-b0e9-be6cf98e4d3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:09.639160 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82850ad2-82dc-4f71-b0e9-be6cf98e4d3b service swift] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:09.649557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1365/2708] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 15:11:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:11:16.211242 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57801ee-3944-45a5-b9ad-7bbfdaa2f5c2 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:16.211880 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d57801ee-3944-45a5-b9ad-7bbfdaa2f5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:16.294766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57801ee-3944-45a5-b9ad-7bbfdaa2f5c2 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:16.299445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126928f8-977d-464a-846c-50278ef0d65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:16.300316 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126928f8-977d-464a-846c-50278ef0d65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:16.300603 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126928f8-977d-464a-846c-50278ef0d65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:16.300884 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126928f8-977d-464a-846c-50278ef0d65f admin admin] PATH_INFO: `/v3/users/2c7a26f8efc64e899d9ff55b95b8e1d8` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:16.302141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126928f8-977d-464a-846c-50278ef0d65f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7a26f8efc64e899d9ff55b95b8e1d8)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:16.304069 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126928f8-977d-464a-846c-50278ef0d65f admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:16.512829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-126928f8-977d-464a-846c-50278ef0d65f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7a26f8efc64e899d9ff55b95b8e1d8'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:16.513946 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-126928f8-977d-464a-846c-50278ef0d65f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7a26f8efc64e899d9ff55b95b8e1d8'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:16.522619 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-126928f8-977d-464a-846c-50278ef0d65f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7a26f8efc64e899d9ff55b95b8e1d8'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:16.523293 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-126928f8-977d-464a-846c-50278ef0d65f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7a26f8efc64e899d9ff55b95b8e1d8'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:16.615556 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-126928f8-977d-464a-846c-50278ef0d65f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7a26f8efc64e899d9ff55b95b8e1d8'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:16.634788 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1344/2709] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:11:16 2022] DELETE /identity/v3/users/2c7a26f8efc64e899d9ff55b95b8e1d8 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:16.639382 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51e376-58f9-42e1-948d-8d9227aeb576 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:16.639882 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51e376-58f9-42e1-948d-8d9227aeb576 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:16.639980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51e376-58f9-42e1-948d-8d9227aeb576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:16.657110 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-fd51e376-58f9-42e1-948d-8d9227aeb576 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:16.659490 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fd51e376-58f9-42e1-948d-8d9227aeb576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:16.720840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1366/2710] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:16.730571 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126928f8-977d-464a-846c-50278ef0d65f admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:16.732003 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-126928f8-977d-464a-846c-50278ef0d65f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:16.761767 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:16.791697 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126928f8-977d-464a-846c-50278ef0d65f admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:16.795372 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b736f5-5c24-446d-88df-5d8a62b995d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:16.803108 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b736f5-5c24-446d-88df-5d8a62b995d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:16.803108 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b736f5-5c24-446d-88df-5d8a62b995d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:16.803108 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b736f5-5c24-446d-88df-5d8a62b995d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:16.805603 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b736f5-5c24-446d-88df-5d8a62b995d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:16.807099 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b736f5-5c24-446d-88df-5d8a62b995d7 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:16.817051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1345/2711] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:17.213045 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51e376-58f9-42e1-948d-8d9227aeb576 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:17.214508 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fd51e376-58f9-42e1-948d-8d9227aeb576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:17.224925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:17.228953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51e376-58f9-42e1-948d-8d9227aeb576 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:17.234487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad11ab-5559-4ea5-bc76-51c44ace4b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:17.236016 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad11ab-5559-4ea5-bc76-51c44ace4b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:17.236303 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad11ab-5559-4ea5-bc76-51c44ace4b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:17.236624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad11ab-5559-4ea5-bc76-51c44ace4b77 admin admin] PATH_INFO: `/v3/projects/3d5fb305075747e6b42fc4e46abe1f9a` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:17.237785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad11ab-5559-4ea5-bc76-51c44ace4b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d5fb305075747e6b42fc4e46abe1f9a)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:17.239760 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad11ab-5559-4ea5-bc76-51c44ace4b77 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:17.366305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2fad11ab-5559-4ea5-bc76-51c44ace4b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d5fb305075747e6b42fc4e46abe1f9a', 'request_id': 'req-2fad11ab-5559-4ea5-bc76-51c44ace4b77'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:17.372870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2fad11ab-5559-4ea5-bc76-51c44ace4b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d5fb305075747e6b42fc4e46abe1f9a', 'request_id': 'req-2fad11ab-5559-4ea5-bc76-51c44ace4b77'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:17.378576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2fad11ab-5559-4ea5-bc76-51c44ace4b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d5fb305075747e6b42fc4e46abe1f9a', 'request_id': 'req-2fad11ab-5559-4ea5-bc76-51c44ace4b77'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:17.392107 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b736f5-5c24-446d-88df-5d8a62b995d7 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:17.393634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e6b736f5-5c24-446d-88df-5d8a62b995d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:17.406310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b736f5-5c24-446d-88df-5d8a62b995d7 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:17.463194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6191b-52e5-40af-9466-70e9d386c886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:17.464098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6191b-52e5-40af-9466-70e9d386c886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:17.464416 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6191b-52e5-40af-9466-70e9d386c886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:17.464705 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6191b-52e5-40af-9466-70e9d386c886 admin admin] PATH_INFO: `/v3/users/3355ce7072d742eb9a65f133d825cfb5` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:17.465939 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6191b-52e5-40af-9466-70e9d386c886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3355ce7072d742eb9a65f133d825cfb5)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:17.467877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6191b-52e5-40af-9466-70e9d386c886 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:17.468402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2fad11ab-5559-4ea5-bc76-51c44ace4b77 admin admin] The token cache is being invalidate because project 3d5fb305075747e6b42fc4e46abe1f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:11:17.468698 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2fad11ab-5559-4ea5-bc76-51c44ace4b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:17.469888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-2fad11ab-5559-4ea5-bc76-51c44ace4b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:17.472688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1367/2712] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:11:17 2022] DELETE /identity/v3/projects/3d5fb305075747e6b42fc4e46abe1f9a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:17.677912 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-69d6191b-52e5-40af-9466-70e9d386c886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3355ce7072d742eb9a65f133d825cfb5'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:17.678601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-69d6191b-52e5-40af-9466-70e9d386c886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3355ce7072d742eb9a65f133d825cfb5'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:17.686588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-69d6191b-52e5-40af-9466-70e9d386c886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3355ce7072d742eb9a65f133d825cfb5'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:17.687374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-69d6191b-52e5-40af-9466-70e9d386c886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3355ce7072d742eb9a65f133d825cfb5'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:17.771248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-69d6191b-52e5-40af-9466-70e9d386c886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3355ce7072d742eb9a65f133d825cfb5'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:17.789723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1346/2713] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:11:17 2022] DELETE /identity/v3/users/3355ce7072d742eb9a65f133d825cfb5 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:17.794354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadff29-18b3-4efd-9c71-c6485c7489a7 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:17.794817 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadff29-18b3-4efd-9c71-c6485c7489a7 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:17.794939 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadff29-18b3-4efd-9c71-c6485c7489a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:17.812098 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-aaadff29-18b3-4efd-9c71-c6485c7489a7 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:17.813382 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-aaadff29-18b3-4efd-9c71-c6485c7489a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:17.870569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1368/2714] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:17.880438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6191b-52e5-40af-9466-70e9d386c886 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:17.881897 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-69d6191b-52e5-40af-9466-70e9d386c886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:17.934947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:17.940437 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6191b-52e5-40af-9466-70e9d386c886 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:17.945414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05646c-0e0d-4723-86a3-f913513a7c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:17.946113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05646c-0e0d-4723-86a3-f913513a7c3f service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:17.946405 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05646c-0e0d-4723-86a3-f913513a7c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:17.946689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05646c-0e0d-4723-86a3-f913513a7c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:17.958561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05646c-0e0d-4723-86a3-f913513a7c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:17.959998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05646c-0e0d-4723-86a3-f913513a7c3f service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:17.972657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1347/2715] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:11:18.464565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadff29-18b3-4efd-9c71-c6485c7489a7 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:18.466513 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-aaadff29-18b3-4efd-9c71-c6485c7489a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:18.478793 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadff29-18b3-4efd-9c71-c6485c7489a7 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:18.483891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b889c9c-c2dc-48ef-b625-46867b584e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:18.484829 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b889c9c-c2dc-48ef-b625-46867b584e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:18.485651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b889c9c-c2dc-48ef-b625-46867b584e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:18.485935 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b889c9c-c2dc-48ef-b625-46867b584e3c admin admin] PATH_INFO: `/v3/projects/f21ccb3790e14a008df11703b48df604` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:18.487143 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b889c9c-c2dc-48ef-b625-46867b584e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f21ccb3790e14a008df11703b48df604)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:18.489069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b889c9c-c2dc-48ef-b625-46867b584e3c admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:18.593023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b889c9c-c2dc-48ef-b625-46867b584e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f21ccb3790e14a008df11703b48df604', 'request_id': 'req-5b889c9c-c2dc-48ef-b625-46867b584e3c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:18.599365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b889c9c-c2dc-48ef-b625-46867b584e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f21ccb3790e14a008df11703b48df604', 'request_id': 'req-5b889c9c-c2dc-48ef-b625-46867b584e3c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:18.604918 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b889c9c-c2dc-48ef-b625-46867b584e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f21ccb3790e14a008df11703b48df604', 'request_id': 'req-5b889c9c-c2dc-48ef-b625-46867b584e3c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:18.665885 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b889c9c-c2dc-48ef-b625-46867b584e3c admin admin] The token cache is being invalidate because project f21ccb3790e14a008df11703b48df604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:11:18.666174 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b889c9c-c2dc-48ef-b625-46867b584e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:18.666802 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b889c9c-c2dc-48ef-b625-46867b584e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:18.668396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1369/2716] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:11:18 2022] DELETE /identity/v3/projects/f21ccb3790e14a008df11703b48df604 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:18.672563 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05646c-0e0d-4723-86a3-f913513a7c3f service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:18.684014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05646c-0e0d-4723-86a3-f913513a7c3f service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:18.741608 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f936d-daa7-45a5-95c3-7449fca03b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:18.742408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f936d-daa7-45a5-95c3-7449fca03b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:18.742694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f936d-daa7-45a5-95c3-7449fca03b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:18.742973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f936d-daa7-45a5-95c3-7449fca03b86 admin admin] PATH_INFO: `/v3/users/5904f8c3f936445199f80415df77efb0` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:18.744430 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f936d-daa7-45a5-95c3-7449fca03b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5904f8c3f936445199f80415df77efb0)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:18.746547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f936d-daa7-45a5-95c3-7449fca03b86 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:18.955185 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-870f936d-daa7-45a5-95c3-7449fca03b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5904f8c3f936445199f80415df77efb0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:18.955909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-870f936d-daa7-45a5-95c3-7449fca03b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5904f8c3f936445199f80415df77efb0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:18.962963 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-870f936d-daa7-45a5-95c3-7449fca03b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5904f8c3f936445199f80415df77efb0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:18.963618 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-870f936d-daa7-45a5-95c3-7449fca03b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5904f8c3f936445199f80415df77efb0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:19.011631 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-870f936d-daa7-45a5-95c3-7449fca03b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5904f8c3f936445199f80415df77efb0'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:19.030443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1348/2717] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:11:18 2022] DELETE /identity/v3/users/5904f8c3f936445199f80415df77efb0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:19.418627 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b889c9c-c2dc-48ef-b625-46867b584e3c admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:19.420126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5b889c9c-c2dc-48ef-b625-46867b584e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:19.436764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b889c9c-c2dc-48ef-b625-46867b584e3c admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:19.445339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:19.496298 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d683e-22da-4111-9485-50b12dba7cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:19.497453 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d683e-22da-4111-9485-50b12dba7cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:19.497924 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d683e-22da-4111-9485-50b12dba7cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:19.498023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d683e-22da-4111-9485-50b12dba7cc2 admin admin] PATH_INFO: `/v3/projects/fd53416252834ecfb3a93be1ba8c5de4` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:19.499152 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d683e-22da-4111-9485-50b12dba7cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd53416252834ecfb3a93be1ba8c5de4)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:19.501052 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d683e-22da-4111-9485-50b12dba7cc2 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:19.631425 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a33d683e-22da-4111-9485-50b12dba7cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd53416252834ecfb3a93be1ba8c5de4', 'request_id': 'req-a33d683e-22da-4111-9485-50b12dba7cc2'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:19.637953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a33d683e-22da-4111-9485-50b12dba7cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd53416252834ecfb3a93be1ba8c5de4', 'request_id': 'req-a33d683e-22da-4111-9485-50b12dba7cc2'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:19.644278 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a33d683e-22da-4111-9485-50b12dba7cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd53416252834ecfb3a93be1ba8c5de4', 'request_id': 'req-a33d683e-22da-4111-9485-50b12dba7cc2'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:19.725300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a33d683e-22da-4111-9485-50b12dba7cc2 admin admin] The token cache is being invalidate because project fd53416252834ecfb3a93be1ba8c5de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:11:19.725597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a33d683e-22da-4111-9485-50b12dba7cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:19.726293 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a33d683e-22da-4111-9485-50b12dba7cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:19.727996 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1370/2718] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:11:19 2022] DELETE /identity/v3/projects/fd53416252834ecfb3a93be1ba8c5de4 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:11:19.733342 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e29a71-4adf-46e6-a50b-39253413de6c None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:19.733829 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e29a71-4adf-46e6-a50b-39253413de6c None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:19.733941 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e29a71-4adf-46e6-a50b-39253413de6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:19.751805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-98e29a71-4adf-46e6-a50b-39253413de6c None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:19.753557 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-98e29a71-4adf-46e6-a50b-39253413de6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:19.811886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1349/2719] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:19.820181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901472ad-da01-42ef-8241-3f4a86e8cf2f None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:19.820473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901472ad-da01-42ef-8241-3f4a86e8cf2f None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:19.820755 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901472ad-da01-42ef-8241-3f4a86e8cf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:19.839417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-901472ad-da01-42ef-8241-3f4a86e8cf2f None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:19.840645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-901472ad-da01-42ef-8241-3f4a86e8cf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:19.848452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1371/2720] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:19.856206 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e29a71-4adf-46e6-a50b-39253413de6c None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:19.866223 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e29a71-4adf-46e6-a50b-39253413de6c None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:19.871137 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997fbde-9f19-488a-84a9-cd2ffb1d3be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:19.871784 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997fbde-9f19-488a-84a9-cd2ffb1d3be5 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:19.872069 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997fbde-9f19-488a-84a9-cd2ffb1d3be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:19.872345 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997fbde-9f19-488a-84a9-cd2ffb1d3be5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:19.873235 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997fbde-9f19-488a-84a9-cd2ffb1d3be5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:11:19.873435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997fbde-9f19-488a-84a9-cd2ffb1d3be5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:19.875015 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997fbde-9f19-488a-84a9-cd2ffb1d3be5 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:19.877411 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:19.887664 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1350/2721] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:11:19.892168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901472ad-da01-42ef-8241-3f4a86e8cf2f None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:19.901430 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901472ad-da01-42ef-8241-3f4a86e8cf2f None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:19.906181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f7e38-84b6-456a-8e60-01f8d67c12d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:19.906836 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f7e38-84b6-456a-8e60-01f8d67c12d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:19.907426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f7e38-84b6-456a-8e60-01f8d67c12d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:19.907426 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f7e38-84b6-456a-8e60-01f8d67c12d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:19.908216 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f7e38-84b6-456a-8e60-01f8d67c12d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:19.910183 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f7e38-84b6-456a-8e60-01f8d67c12d4 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:20.042055 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1372/2722] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:11:19 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:11:20.046257 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997fbde-9f19-488a-84a9-cd2ffb1d3be5 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:20.056862 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997fbde-9f19-488a-84a9-cd2ffb1d3be5 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:20.114630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c3432-1ae2-43ae-825d-9fe3df54a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:20.115338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c3432-1ae2-43ae-825d-9fe3df54a9ec admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:20.115627 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c3432-1ae2-43ae-825d-9fe3df54a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:20.115910 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c3432-1ae2-43ae-825d-9fe3df54a9ec admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:20.116613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c3432-1ae2-43ae-825d-9fe3df54a9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:20.118592 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c3432-1ae2-43ae-825d-9fe3df54a9ec admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:20.245249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1351/2723] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:11:20 2022] POST /identity/v3/users => generated 285 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:11:20.249397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f7e38-84b6-456a-8e60-01f8d67c12d4 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:20.259701 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f7e38-84b6-456a-8e60-01f8d67c12d4 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:20.265649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70106e9-7c6b-4414-b01a-11c539908402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:20.265649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70106e9-7c6b-4414-b01a-11c539908402 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:20.265649 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70106e9-7c6b-4414-b01a-11c539908402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:20.265955 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70106e9-7c6b-4414-b01a-11c539908402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:20.266496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70106e9-7c6b-4414-b01a-11c539908402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:20.268092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70106e9-7c6b-4414-b01a-11c539908402 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:20.278705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1373/2724] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:11:20.282557 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c3432-1ae2-43ae-825d-9fe3df54a9ec admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:20.293329 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c3432-1ae2-43ae-825d-9fe3df54a9ec admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:20.298072 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f9ec4-d6d8-48b9-b5a6-ff5d890b4ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:20.298770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f9ec4-d6d8-48b9-b5a6-ff5d890b4ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:20.299059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f9ec4-d6d8-48b9-b5a6-ff5d890b4ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:20.300043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f9ec4-d6d8-48b9-b5a6-ff5d890b4ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:20.300859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f9ec4-d6d8-48b9-b5a6-ff5d890b4ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:20.302494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f9ec4-d6d8-48b9-b5a6-ff5d890b4ae5 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:20.312534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1352/2725] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:11:20.316739 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70106e9-7c6b-4414-b01a-11c539908402 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:20.326631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70106e9-7c6b-4414-b01a-11c539908402 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:20.331219 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c2df5-83be-433b-a80b-8ee5f6335b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:20.332089 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c2df5-83be-433b-a80b-8ee5f6335b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:20.332369 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c2df5-83be-433b-a80b-8ee5f6335b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:20.332645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c2df5-83be-433b-a80b-8ee5f6335b1a admin admin] PATH_INFO: `/v3/projects/bf3e0af14dee4494830f22c3b25a58ec/users/957faa4fb5df4fa4ad24e3cbab677b64/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:20.348039 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c2df5-83be-433b-a80b-8ee5f6335b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3e0af14dee4494830f22c3b25a58ec, user_id=957faa4fb5df4fa4ad24e3cbab677b64, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:20.350840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c2df5-83be-433b-a80b-8ee5f6335b1a admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:20.446236 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1374/2726] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:11:20 2022] PUT /identity/v3/projects/bf3e0af14dee4494830f22c3b25a58ec/users/957faa4fb5df4fa4ad24e3cbab677b64/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:20.457569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d25de-21bf-4063-881c-39d4484c994b None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:20.457858 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d25de-21bf-4063-881c-39d4484c994b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:20.458164 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d25de-21bf-4063-881c-39d4484c994b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:20.484822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-e71d25de-21bf-4063-881c-39d4484c994b None None] MFA Rules not processed for user `957faa4fb5df4fa4ad24e3cbab677b64`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:20.486282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e71d25de-21bf-4063-881c-39d4484c994b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:20.553240 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1353/2727] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:20.557707 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c2df5-83be-433b-a80b-8ee5f6335b1a admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:20.598932 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:20.619472 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c2df5-83be-433b-a80b-8ee5f6335b1a admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:20.624402 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292c4a5-af08-46ba-8b93-05e766912fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:20.625064 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292c4a5-af08-46ba-8b93-05e766912fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:20.625424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292c4a5-af08-46ba-8b93-05e766912fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:20.625714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292c4a5-af08-46ba-8b93-05e766912fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:20.626490 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292c4a5-af08-46ba-8b93-05e766912fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:20.629007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292c4a5-af08-46ba-8b93-05e766912fb1 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:20.736503 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1375/2728] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:11:20 2022] POST /identity/v3/projects => generated 369 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:11:20.741511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d25de-21bf-4063-881c-39d4484c994b None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:20.753386 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d25de-21bf-4063-881c-39d4484c994b None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:20.809471 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371b254-447d-4e37-8288-a08f9bcd8b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:20.810055 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371b254-447d-4e37-8288-a08f9bcd8b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:20.810345 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371b254-447d-4e37-8288-a08f9bcd8b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:20.810626 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371b254-447d-4e37-8288-a08f9bcd8b92 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:20.811326 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371b254-447d-4e37-8288-a08f9bcd8b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:20.813253 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371b254-447d-4e37-8288-a08f9bcd8b92 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:20.822340 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:20.913181 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1354/2729] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:11:20 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:11:20.916997 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292c4a5-af08-46ba-8b93-05e766912fb1 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:20.928024 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292c4a5-af08-46ba-8b93-05e766912fb1 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:20.932799 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870bb6c-1dc8-490d-b4ba-b3433cf5e8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:20.933486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870bb6c-1dc8-490d-b4ba-b3433cf5e8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:20.933779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870bb6c-1dc8-490d-b4ba-b3433cf5e8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:20.934061 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870bb6c-1dc8-490d-b4ba-b3433cf5e8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:20.934790 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870bb6c-1dc8-490d-b4ba-b3433cf5e8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:20.936390 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870bb6c-1dc8-490d-b4ba-b3433cf5e8c2 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:20.947497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1376/2730] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:11:20.951610 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371b254-447d-4e37-8288-a08f9bcd8b92 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:20.962236 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371b254-447d-4e37-8288-a08f9bcd8b92 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:20.967467 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c4ba9-ea17-4693-8cd3-7f12e1f9b231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:20.968355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c4ba9-ea17-4693-8cd3-7f12e1f9b231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:20.968637 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c4ba9-ea17-4693-8cd3-7f12e1f9b231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:20.968909 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c4ba9-ea17-4693-8cd3-7f12e1f9b231 admin admin] PATH_INFO: `/v3/projects/4323e647fa8e4ff6a64f508ec3983a73/users/a5320ed9ac214d05a0c644ada311f515/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:20.984497 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c4ba9-ea17-4693-8cd3-7f12e1f9b231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4323e647fa8e4ff6a64f508ec3983a73, user_id=a5320ed9ac214d05a0c644ada311f515, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:20.988054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c4ba9-ea17-4693-8cd3-7f12e1f9b231 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:21.057459 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1355/2731] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:11:20 2022] PUT /identity/v3/projects/4323e647fa8e4ff6a64f508ec3983a73/users/a5320ed9ac214d05a0c644ada311f515/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:21.061615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870bb6c-1dc8-490d-b4ba-b3433cf5e8c2 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:21.071644 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870bb6c-1dc8-490d-b4ba-b3433cf5e8c2 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:21.127711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1171037-70e4-40d8-a65c-e81d9d1e845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:21.128424 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1171037-70e4-40d8-a65c-e81d9d1e845b admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:21.128713 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1171037-70e4-40d8-a65c-e81d9d1e845b admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:21.128993 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1171037-70e4-40d8-a65c-e81d9d1e845b admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:21.129762 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1171037-70e4-40d8-a65c-e81d9d1e845b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:21.131362 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1171037-70e4-40d8-a65c-e81d9d1e845b admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:21.140981 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1377/2732] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:11:21.145194 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c4ba9-ea17-4693-8cd3-7f12e1f9b231 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:21.155519 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c4ba9-ea17-4693-8cd3-7f12e1f9b231 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:21.160744 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d143d-dcbd-445b-9bd5-2c6939d71286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:21.161668 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d143d-dcbd-445b-9bd5-2c6939d71286 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:21.161959 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d143d-dcbd-445b-9bd5-2c6939d71286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:21.162272 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d143d-dcbd-445b-9bd5-2c6939d71286 admin admin] PATH_INFO: `/v3/projects/4323e647fa8e4ff6a64f508ec3983a73/users/a5320ed9ac214d05a0c644ada311f515/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:21.164250 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d143d-dcbd-445b-9bd5-2c6939d71286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4323e647fa8e4ff6a64f508ec3983a73, user_id=a5320ed9ac214d05a0c644ada311f515, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:21.166914 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d143d-dcbd-445b-9bd5-2c6939d71286 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:21.177559 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1356/2733] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:11:21 2022] PUT /identity/v3/projects/4323e647fa8e4ff6a64f508ec3983a73/users/a5320ed9ac214d05a0c644ada311f515/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:21.187355 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f32f70-f018-4b1c-9aad-54b38392130f None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:21.187648 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f32f70-f018-4b1c-9aad-54b38392130f None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:21.187929 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f32f70-f018-4b1c-9aad-54b38392130f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:21.213714 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-05f32f70-f018-4b1c-9aad-54b38392130f None None] MFA Rules not processed for user `a5320ed9ac214d05a0c644ada311f515`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:21.214922 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-05f32f70-f018-4b1c-9aad-54b38392130f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:21.282101 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1378/2734] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:21 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:21.293792 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d143d-dcbd-445b-9bd5-2c6939d71286 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:21.295561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-5e3d143d-dcbd-445b-9bd5-2c6939d71286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:21.353892 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d143d-dcbd-445b-9bd5-2c6939d71286 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:21.357659 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b266b-89fc-4c06-a3f9-a4084ebe53c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:21.358302 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b266b-89fc-4c06-a3f9-a4084ebe53c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:21.358585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b266b-89fc-4c06-a3f9-a4084ebe53c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:21.358861 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b266b-89fc-4c06-a3f9-a4084ebe53c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:21.367766 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b266b-89fc-4c06-a3f9-a4084ebe53c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:21.369470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b266b-89fc-4c06-a3f9-a4084ebe53c3 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:21.378918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1357/2735] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:21 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:21.503496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f32f70-f018-4b1c-9aad-54b38392130f None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:21.505000 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-05f32f70-f018-4b1c-9aad-54b38392130f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:21.517241 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f32f70-f018-4b1c-9aad-54b38392130f None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:21.521509 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0720f4-9799-470a-a5d1-a4efe51e3dff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:21.522179 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0720f4-9799-470a-a5d1-a4efe51e3dff service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:21.522476 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0720f4-9799-470a-a5d1-a4efe51e3dff service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:21.522759 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0720f4-9799-470a-a5d1-a4efe51e3dff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:21.554555 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:21.579224 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0720f4-9799-470a-a5d1-a4efe51e3dff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:21.581263 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0720f4-9799-470a-a5d1-a4efe51e3dff service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:21.590108 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1379/2736] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:26.493394 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b266b-89fc-4c06-a3f9-a4084ebe53c3 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:26.556971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b266b-89fc-4c06-a3f9-a4084ebe53c3 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:26.561545 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3849978-327f-4ed4-8181-7396642479f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:26.562436 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3849978-327f-4ed4-8181-7396642479f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:26.562751 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3849978-327f-4ed4-8181-7396642479f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:26.563032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3849978-327f-4ed4-8181-7396642479f1 admin admin] PATH_INFO: `/v3/users/957faa4fb5df4fa4ad24e3cbab677b64` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:26.564220 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3849978-327f-4ed4-8181-7396642479f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=957faa4fb5df4fa4ad24e3cbab677b64)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:26.566195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3849978-327f-4ed4-8181-7396642479f1 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:26.737809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b3849978-327f-4ed4-8181-7396642479f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957faa4fb5df4fa4ad24e3cbab677b64'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:26.738242 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b3849978-327f-4ed4-8181-7396642479f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957faa4fb5df4fa4ad24e3cbab677b64'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:26.745973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b3849978-327f-4ed4-8181-7396642479f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957faa4fb5df4fa4ad24e3cbab677b64'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:26.746726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b3849978-327f-4ed4-8181-7396642479f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957faa4fb5df4fa4ad24e3cbab677b64'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:26.750465 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:26.840472 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-b3849978-327f-4ed4-8181-7396642479f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957faa4fb5df4fa4ad24e3cbab677b64'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:26.858879 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1358/2737] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:11:26 2022] DELETE /identity/v3/users/957faa4fb5df4fa4ad24e3cbab677b64 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:26.863457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34677a-2664-42d2-af6b-04ff13ced120 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:26.863931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34677a-2664-42d2-af6b-04ff13ced120 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:26.864187 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34677a-2664-42d2-af6b-04ff13ced120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:26.881553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-6b34677a-2664-42d2-af6b-04ff13ced120 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:26.882766 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6b34677a-2664-42d2-af6b-04ff13ced120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:26.941593 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1380/2738] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:26.951282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3849978-327f-4ed4-8181-7396642479f1 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:26.952714 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b3849978-327f-4ed4-8181-7396642479f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:27.011059 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3849978-327f-4ed4-8181-7396642479f1 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:27.014625 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16daf97-be7e-47ea-ac90-cc5f9c7b4413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:27.015276 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16daf97-be7e-47ea-ac90-cc5f9c7b4413 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:27.015563 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16daf97-be7e-47ea-ac90-cc5f9c7b4413 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:27.015840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16daf97-be7e-47ea-ac90-cc5f9c7b4413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:27.025277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16daf97-be7e-47ea-ac90-cc5f9c7b4413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:27.026696 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16daf97-be7e-47ea-ac90-cc5f9c7b4413 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:27.036334 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1359/2739] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:27.451673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34677a-2664-42d2-af6b-04ff13ced120 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:27.451673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6b34677a-2664-42d2-af6b-04ff13ced120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:27.463194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34677a-2664-42d2-af6b-04ff13ced120 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:27.468138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:27.469040 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:27.469362 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:27.469646 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8 admin admin] PATH_INFO: `/v3/projects/bf3e0af14dee4494830f22c3b25a58ec` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:27.470854 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3e0af14dee4494830f22c3b25a58ec)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:27.472772 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:27.584236 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3e0af14dee4494830f22c3b25a58ec', 'request_id': 'req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:27.590480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3e0af14dee4494830f22c3b25a58ec', 'request_id': 'req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:27.596106 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3e0af14dee4494830f22c3b25a58ec', 'request_id': 'req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:27.651333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8 admin admin] The token cache is being invalidate because project bf3e0af14dee4494830f22c3b25a58ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:11:27.651624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:27.652244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:27.653821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1381/2740] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:11:27 2022] DELETE /identity/v3/projects/bf3e0af14dee4494830f22c3b25a58ec => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:27.657878 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16daf97-be7e-47ea-ac90-cc5f9c7b4413 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:27.667992 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16daf97-be7e-47ea-ac90-cc5f9c7b4413 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:27.723602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09e185-442c-41e0-b091-7d7084bd353c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:27.724488 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e185-442c-41e0-b091-7d7084bd353c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:27.724776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e185-442c-41e0-b091-7d7084bd353c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:27.725086 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e185-442c-41e0-b091-7d7084bd353c admin admin] PATH_INFO: `/v3/users/a5320ed9ac214d05a0c644ada311f515` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:27.726402 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09e185-442c-41e0-b091-7d7084bd353c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5320ed9ac214d05a0c644ada311f515)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:27.728370 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09e185-442c-41e0-b091-7d7084bd353c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:27.928950 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6f09e185-442c-41e0-b091-7d7084bd353c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5320ed9ac214d05a0c644ada311f515'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:27.929589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6f09e185-442c-41e0-b091-7d7084bd353c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5320ed9ac214d05a0c644ada311f515'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:27.936613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6f09e185-442c-41e0-b091-7d7084bd353c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5320ed9ac214d05a0c644ada311f515'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:27.937291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6f09e185-442c-41e0-b091-7d7084bd353c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5320ed9ac214d05a0c644ada311f515'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:28.006430 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6f09e185-442c-41e0-b091-7d7084bd353c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5320ed9ac214d05a0c644ada311f515'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:28.020866 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:28.025096 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1360/2741] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:11:27 2022] DELETE /identity/v3/users/a5320ed9ac214d05a0c644ada311f515 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:28.449656 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:28.453207 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:28.466592 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac52b7a-dc1c-49f2-bf0e-2e403f670cf8 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:28.517596 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:28.524864 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d370b-5acf-4e0c-b29a-8017a4caec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:28.525801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d370b-5acf-4e0c-b29a-8017a4caec62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:28.526075 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d370b-5acf-4e0c-b29a-8017a4caec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:28.526359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d370b-5acf-4e0c-b29a-8017a4caec62 admin admin] PATH_INFO: `/v3/projects/4323e647fa8e4ff6a64f508ec3983a73` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:28.527553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d370b-5acf-4e0c-b29a-8017a4caec62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4323e647fa8e4ff6a64f508ec3983a73)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:28.529488 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d370b-5acf-4e0c-b29a-8017a4caec62 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:28.672984 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ce6d370b-5acf-4e0c-b29a-8017a4caec62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4323e647fa8e4ff6a64f508ec3983a73', 'request_id': 'req-ce6d370b-5acf-4e0c-b29a-8017a4caec62'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:28.679143 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ce6d370b-5acf-4e0c-b29a-8017a4caec62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4323e647fa8e4ff6a64f508ec3983a73', 'request_id': 'req-ce6d370b-5acf-4e0c-b29a-8017a4caec62'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:28.684522 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ce6d370b-5acf-4e0c-b29a-8017a4caec62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4323e647fa8e4ff6a64f508ec3983a73', 'request_id': 'req-ce6d370b-5acf-4e0c-b29a-8017a4caec62'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:28.761181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ce6d370b-5acf-4e0c-b29a-8017a4caec62 admin admin] The token cache is being invalidate because project 4323e647fa8e4ff6a64f508ec3983a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:11:28.761510 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ce6d370b-5acf-4e0c-b29a-8017a4caec62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:28.762215 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-ce6d370b-5acf-4e0c-b29a-8017a4caec62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:28.763770 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1382/2742] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:11:28 2022] DELETE /identity/v3/projects/4323e647fa8e4ff6a64f508ec3983a73 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:28.768562 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec1a69-7319-4ee9-8b76-7f02f3105fac None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:28.769111 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec1a69-7319-4ee9-8b76-7f02f3105fac None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:28.769830 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec1a69-7319-4ee9-8b76-7f02f3105fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:28.788113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-b5ec1a69-7319-4ee9-8b76-7f02f3105fac None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:28.789733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b5ec1a69-7319-4ee9-8b76-7f02f3105fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:28.853180 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1361/2743] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:28.860885 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48c78e-23a1-4d8f-bef6-452c29f38724 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:28.861228 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48c78e-23a1-4d8f-bef6-452c29f38724 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:28.861600 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48c78e-23a1-4d8f-bef6-452c29f38724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:28.882212 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-3e48c78e-23a1-4d8f-bef6-452c29f38724 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:28.883439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-3e48c78e-23a1-4d8f-bef6-452c29f38724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:28.891617 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1383/2744] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:28.895867 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec1a69-7319-4ee9-8b76-7f02f3105fac None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:28.905789 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec1a69-7319-4ee9-8b76-7f02f3105fac None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:28.910737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f8483-fdfb-4d23-8316-0fa6950660e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:28.911405 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f8483-fdfb-4d23-8316-0fa6950660e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:28.911695 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f8483-fdfb-4d23-8316-0fa6950660e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:28.911981 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f8483-fdfb-4d23-8316-0fa6950660e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:28.912745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f8483-fdfb-4d23-8316-0fa6950660e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:11:28.913063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f8483-fdfb-4d23-8316-0fa6950660e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:28.914691 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f8483-fdfb-4d23-8316-0fa6950660e0 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:28.927098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1362/2745] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:11:28.931335 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48c78e-23a1-4d8f-bef6-452c29f38724 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:28.940744 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48c78e-23a1-4d8f-bef6-452c29f38724 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:28.946114 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711772c-c9c1-4b06-bbb2-c393d31186aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:28.946768 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711772c-c9c1-4b06-bbb2-c393d31186aa admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:28.947058 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711772c-c9c1-4b06-bbb2-c393d31186aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:28.947441 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711772c-c9c1-4b06-bbb2-c393d31186aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:28.948136 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711772c-c9c1-4b06-bbb2-c393d31186aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:28.950073 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711772c-c9c1-4b06-bbb2-c393d31186aa admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:29.082438 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1384/2746] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:11:28 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:11:29.086407 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f8483-fdfb-4d23-8316-0fa6950660e0 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:29.096336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f8483-fdfb-4d23-8316-0fa6950660e0 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:29.152863 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3bb1c-b560-424c-bcbe-5d6114dcec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:29.153574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3bb1c-b560-424c-bcbe-5d6114dcec3a admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:29.153866 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3bb1c-b560-424c-bcbe-5d6114dcec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:29.154147 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3bb1c-b560-424c-bcbe-5d6114dcec3a admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:29.154848 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3bb1c-b560-424c-bcbe-5d6114dcec3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:29.156754 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3bb1c-b560-424c-bcbe-5d6114dcec3a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:29.281921 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1363/2747] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:11:29 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:11:29.286499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711772c-c9c1-4b06-bbb2-c393d31186aa admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:29.296719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711772c-c9c1-4b06-bbb2-c393d31186aa admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:29.302004 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb0d27-f0b1-49cb-9bc7-dfab20339ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:29.302663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb0d27-f0b1-49cb-9bc7-dfab20339ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:29.302956 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb0d27-f0b1-49cb-9bc7-dfab20339ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:29.303232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb0d27-f0b1-49cb-9bc7-dfab20339ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:29.303964 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb0d27-f0b1-49cb-9bc7-dfab20339ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:29.305612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb0d27-f0b1-49cb-9bc7-dfab20339ddc admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:29.315818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1385/2748] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:11:29.319748 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3bb1c-b560-424c-bcbe-5d6114dcec3a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:29.329731 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3bb1c-b560-424c-bcbe-5d6114dcec3a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:29.334363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25321c89-2ab5-42aa-a252-00e5271a0d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:29.334968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321c89-2ab5-42aa-a252-00e5271a0d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:29.335255 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321c89-2ab5-42aa-a252-00e5271a0d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:29.335537 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321c89-2ab5-42aa-a252-00e5271a0d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:29.336264 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25321c89-2ab5-42aa-a252-00e5271a0d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:29.337899 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25321c89-2ab5-42aa-a252-00e5271a0d6f admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:29.348232 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1364/2749] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:11:29.352153 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb0d27-f0b1-49cb-9bc7-dfab20339ddc admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:29.361911 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb0d27-f0b1-49cb-9bc7-dfab20339ddc admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:29.367093 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ab50d-238a-4302-bf31-6e6b3a8c7798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:29.367959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ab50d-238a-4302-bf31-6e6b3a8c7798 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:29.368246 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ab50d-238a-4302-bf31-6e6b3a8c7798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:29.368525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ab50d-238a-4302-bf31-6e6b3a8c7798 admin admin] PATH_INFO: `/v3/projects/89858984f3da439b9d34728bbb05469d/users/05a2d4a26e574d9fbac2183c9533f9b1/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:29.383250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ab50d-238a-4302-bf31-6e6b3a8c7798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89858984f3da439b9d34728bbb05469d, user_id=05a2d4a26e574d9fbac2183c9533f9b1, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:29.386028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ab50d-238a-4302-bf31-6e6b3a8c7798 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:29.451839 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1386/2750] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:11:29 2022] PUT /identity/v3/projects/89858984f3da439b9d34728bbb05469d/users/05a2d4a26e574d9fbac2183c9533f9b1/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:29.463145 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b3d49-a8dc-4f4e-a89e-327717add45a None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:29.463462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b3d49-a8dc-4f4e-a89e-327717add45a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:29.463752 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b3d49-a8dc-4f4e-a89e-327717add45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:29.491243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-ee7b3d49-a8dc-4f4e-a89e-327717add45a None None] MFA Rules not processed for user `05a2d4a26e574d9fbac2183c9533f9b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:29.492456 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ee7b3d49-a8dc-4f4e-a89e-327717add45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:29.547622 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:29.556895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1365/2751] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:29.561518 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ab50d-238a-4302-bf31-6e6b3a8c7798 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:29.623091 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ab50d-238a-4302-bf31-6e6b3a8c7798 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:29.627712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def74b49-274f-4c19-9fb4-a88187f38e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:29.628367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def74b49-274f-4c19-9fb4-a88187f38e52 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:29.628683 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def74b49-274f-4c19-9fb4-a88187f38e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:29.628967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def74b49-274f-4c19-9fb4-a88187f38e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:29.629862 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def74b49-274f-4c19-9fb4-a88187f38e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:29.631773 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def74b49-274f-4c19-9fb4-a88187f38e52 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:29.762437 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1387/2752] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:11:29 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:11:29.766585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b3d49-a8dc-4f4e-a89e-327717add45a None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:29.778316 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b3d49-a8dc-4f4e-a89e-327717add45a None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:29.835391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f629f-3834-4d72-baf7-bf8aaf573a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:29.836062 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f629f-3834-4d72-baf7-bf8aaf573a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:29.836354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f629f-3834-4d72-baf7-bf8aaf573a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:29.836638 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f629f-3834-4d72-baf7-bf8aaf573a1d admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:29.837387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f629f-3834-4d72-baf7-bf8aaf573a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:29.839411 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f629f-3834-4d72-baf7-bf8aaf573a1d admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:29.937929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1366/2753] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:11:29 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:11:29.943541 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def74b49-274f-4c19-9fb4-a88187f38e52 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:29.953080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def74b49-274f-4c19-9fb4-a88187f38e52 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:29.958557 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefdf7f-5b63-4b36-96b8-ca8f2b72e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:29.959274 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefdf7f-5b63-4b36-96b8-ca8f2b72e795 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:29.959565 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefdf7f-5b63-4b36-96b8-ca8f2b72e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:29.959858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefdf7f-5b63-4b36-96b8-ca8f2b72e795 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:29.960586 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefdf7f-5b63-4b36-96b8-ca8f2b72e795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:29.963002 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefdf7f-5b63-4b36-96b8-ca8f2b72e795 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:29.964663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:29.979799 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1388/2754] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:11:29.980686 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f629f-3834-4d72-baf7-bf8aaf573a1d admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:29.991028 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f629f-3834-4d72-baf7-bf8aaf573a1d admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:29.995997 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd703be-73d4-48a9-b5e8-4b9119d192c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:29.996667 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd703be-73d4-48a9-b5e8-4b9119d192c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:29.996956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd703be-73d4-48a9-b5e8-4b9119d192c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:29.997281 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd703be-73d4-48a9-b5e8-4b9119d192c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:29.998048 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd703be-73d4-48a9-b5e8-4b9119d192c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:29.999632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd703be-73d4-48a9-b5e8-4b9119d192c5 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:30.010940 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1367/2755] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:11:30.014979 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefdf7f-5b63-4b36-96b8-ca8f2b72e795 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:30.025431 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefdf7f-5b63-4b36-96b8-ca8f2b72e795 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:30.030237 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1b48c-7ae1-4030-923e-79afabefed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:30.031092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1b48c-7ae1-4030-923e-79afabefed1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:30.031379 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1b48c-7ae1-4030-923e-79afabefed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:30.031657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1b48c-7ae1-4030-923e-79afabefed1c admin admin] PATH_INFO: `/v3/projects/d41c463630f24f9cbc61d02f79710626/users/711198e0bead418bbf56d1b675544d58/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:30.046277 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1b48c-7ae1-4030-923e-79afabefed1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41c463630f24f9cbc61d02f79710626, user_id=711198e0bead418bbf56d1b675544d58, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:30.049001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1b48c-7ae1-4030-923e-79afabefed1c admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:30.104333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1389/2756] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:11:30 2022] PUT /identity/v3/projects/d41c463630f24f9cbc61d02f79710626/users/711198e0bead418bbf56d1b675544d58/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:30.114588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4a760-8704-40a2-9c9d-b8aecc05338e None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:30.114881 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4a760-8704-40a2-9c9d-b8aecc05338e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:30.115159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4a760-8704-40a2-9c9d-b8aecc05338e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:30.142051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-faa4a760-8704-40a2-9c9d-b8aecc05338e None None] MFA Rules not processed for user `711198e0bead418bbf56d1b675544d58`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:30.143690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-faa4a760-8704-40a2-9c9d-b8aecc05338e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:30.232113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1368/2757] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:11:30.232417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1b48c-7ae1-4030-923e-79afabefed1c admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:30.288268 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1b48c-7ae1-4030-923e-79afabefed1c admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:30.293059 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30abe3-626c-406e-8aba-85cd83caa521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:30.293744 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30abe3-626c-406e-8aba-85cd83caa521 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:30.294028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30abe3-626c-406e-8aba-85cd83caa521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:30.294306 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30abe3-626c-406e-8aba-85cd83caa521 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:30.295019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30abe3-626c-406e-8aba-85cd83caa521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:30.296897 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30abe3-626c-406e-8aba-85cd83caa521 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:30.391027 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1390/2758] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:11:30 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:11:30.395102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4a760-8704-40a2-9c9d-b8aecc05338e None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:30.405990 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4a760-8704-40a2-9c9d-b8aecc05338e None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:30.463188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b934b2e-616d-4ba6-99d1-b0061ce9d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:30.463854 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b934b2e-616d-4ba6-99d1-b0061ce9d6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:30.464144 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b934b2e-616d-4ba6-99d1-b0061ce9d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:30.464421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b934b2e-616d-4ba6-99d1-b0061ce9d6a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:30.465114 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b934b2e-616d-4ba6-99d1-b0061ce9d6a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:30.467185 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b934b2e-616d-4ba6-99d1-b0061ce9d6a2 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:30.475530 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:30.566294 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1369/2759] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:11:30 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:11:30.570727 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30abe3-626c-406e-8aba-85cd83caa521 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:30.580926 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30abe3-626c-406e-8aba-85cd83caa521 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:30.586594 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c65a72-9a5d-4874-b3b2-f5f4f86d6ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:30.587479 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c65a72-9a5d-4874-b3b2-f5f4f86d6ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:30.587851 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c65a72-9a5d-4874-b3b2-f5f4f86d6ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:30.588132 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c65a72-9a5d-4874-b3b2-f5f4f86d6ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:30.588860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c65a72-9a5d-4874-b3b2-f5f4f86d6ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:30.590866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c65a72-9a5d-4874-b3b2-f5f4f86d6ca4 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:30.601660 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1391/2760] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:11:30.605799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b934b2e-616d-4ba6-99d1-b0061ce9d6a2 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:30.616321 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b934b2e-616d-4ba6-99d1-b0061ce9d6a2 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:30.621291 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7642eb-92b0-4ce0-82d0-8d8670741703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:30.622169 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7642eb-92b0-4ce0-82d0-8d8670741703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:30.622460 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7642eb-92b0-4ce0-82d0-8d8670741703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:30.622743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7642eb-92b0-4ce0-82d0-8d8670741703 admin admin] PATH_INFO: `/v3/projects/40a599de73d4485f8ef8abedd0dd6ccc/users/3a21cfd23aea4bc7b166d47da67aef22/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:30.639084 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7642eb-92b0-4ce0-82d0-8d8670741703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a599de73d4485f8ef8abedd0dd6ccc, user_id=3a21cfd23aea4bc7b166d47da67aef22, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:30.641780 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7642eb-92b0-4ce0-82d0-8d8670741703 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:30.706608 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1370/2761] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:11:30 2022] PUT /identity/v3/projects/40a599de73d4485f8ef8abedd0dd6ccc/users/3a21cfd23aea4bc7b166d47da67aef22/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:30.710493 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c65a72-9a5d-4874-b3b2-f5f4f86d6ca4 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:30.721008 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c65a72-9a5d-4874-b3b2-f5f4f86d6ca4 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:30.776289 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa547e-b1b3-4c06-851d-7e717edc29bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:30.776953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa547e-b1b3-4c06-851d-7e717edc29bd admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:30.777272 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa547e-b1b3-4c06-851d-7e717edc29bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:30.777599 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa547e-b1b3-4c06-851d-7e717edc29bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:30.778336 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa547e-b1b3-4c06-851d-7e717edc29bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:30.779917 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa547e-b1b3-4c06-851d-7e717edc29bd admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:30.790029 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1392/2762] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:11:30.794168 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7642eb-92b0-4ce0-82d0-8d8670741703 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:30.805060 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7642eb-92b0-4ce0-82d0-8d8670741703 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:30.809995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b6457-029d-41a9-ab38-dd6f3e70156f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:30.810886 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b6457-029d-41a9-ab38-dd6f3e70156f admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:30.811173 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b6457-029d-41a9-ab38-dd6f3e70156f admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:30.811454 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b6457-029d-41a9-ab38-dd6f3e70156f admin admin] PATH_INFO: `/v3/projects/40a599de73d4485f8ef8abedd0dd6ccc/users/3a21cfd23aea4bc7b166d47da67aef22/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:30.813442 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b6457-029d-41a9-ab38-dd6f3e70156f admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a599de73d4485f8ef8abedd0dd6ccc, user_id=3a21cfd23aea4bc7b166d47da67aef22, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:30.816052 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b6457-029d-41a9-ab38-dd6f3e70156f admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:30.826957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1371/2763] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:11:30 2022] PUT /identity/v3/projects/40a599de73d4485f8ef8abedd0dd6ccc/users/3a21cfd23aea4bc7b166d47da67aef22/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:30.837959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be94d0e-0a24-4062-8505-3aa7c955b8fb None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:30.838254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be94d0e-0a24-4062-8505-3aa7c955b8fb None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:30.838534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be94d0e-0a24-4062-8505-3aa7c955b8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:30.865157 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-2be94d0e-0a24-4062-8505-3aa7c955b8fb None None] MFA Rules not processed for user `3a21cfd23aea4bc7b166d47da67aef22`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:30.866331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2be94d0e-0a24-4062-8505-3aa7c955b8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:30.895648 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:30.933324 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1393/2764] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:30.944339 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b6457-029d-41a9-ab38-dd6f3e70156f admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:30.946066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-529b6457-029d-41a9-ab38-dd6f3e70156f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:31.003680 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b6457-029d-41a9-ab38-dd6f3e70156f admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:31.007897 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd8b70-fc80-4381-8920-77086d33e95b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:31.008595 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd8b70-fc80-4381-8920-77086d33e95b service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:31.008876 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd8b70-fc80-4381-8920-77086d33e95b service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:31.009175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd8b70-fc80-4381-8920-77086d33e95b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:31.018153 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd8b70-fc80-4381-8920-77086d33e95b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:31.019569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd8b70-fc80-4381-8920-77086d33e95b service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:31.030117 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1372/2765] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:31.137861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be94d0e-0a24-4062-8505-3aa7c955b8fb None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:31.139255 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2be94d0e-0a24-4062-8505-3aa7c955b8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:31.151794 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be94d0e-0a24-4062-8505-3aa7c955b8fb None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:31.157305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5b76a-a5d1-4210-a003-2b8b1975cf71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:31.157955 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5b76a-a5d1-4210-a003-2b8b1975cf71 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:31.158242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5b76a-a5d1-4210-a003-2b8b1975cf71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:31.158525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5b76a-a5d1-4210-a003-2b8b1975cf71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:31.214885 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5b76a-a5d1-4210-a003-2b8b1975cf71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:31.216333 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5b76a-a5d1-4210-a003-2b8b1975cf71 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:31.225891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1394/2766] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:35.187024 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd8b70-fc80-4381-8920-77086d33e95b service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:35.252257 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd8b70-fc80-4381-8920-77086d33e95b service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:35.256769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17b2f4-3797-4c2b-8c1e-f4504420a05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:35.257708 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17b2f4-3797-4c2b-8c1e-f4504420a05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:35.257998 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17b2f4-3797-4c2b-8c1e-f4504420a05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:35.258275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17b2f4-3797-4c2b-8c1e-f4504420a05a admin admin] PATH_INFO: `/v3/users/05a2d4a26e574d9fbac2183c9533f9b1` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:35.259499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17b2f4-3797-4c2b-8c1e-f4504420a05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a2d4a26e574d9fbac2183c9533f9b1)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:35.261462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17b2f4-3797-4c2b-8c1e-f4504420a05a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:35.452277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-3c17b2f4-3797-4c2b-8c1e-f4504420a05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a2d4a26e574d9fbac2183c9533f9b1'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:35.452950 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-3c17b2f4-3797-4c2b-8c1e-f4504420a05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a2d4a26e574d9fbac2183c9533f9b1'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:35.462243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-3c17b2f4-3797-4c2b-8c1e-f4504420a05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a2d4a26e574d9fbac2183c9533f9b1'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:35.464670 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-3c17b2f4-3797-4c2b-8c1e-f4504420a05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a2d4a26e574d9fbac2183c9533f9b1'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:35.467098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:35.541786 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-3c17b2f4-3797-4c2b-8c1e-f4504420a05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a2d4a26e574d9fbac2183c9533f9b1'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:35.560174 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1373/2767] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:11:35 2022] DELETE /identity/v3/users/05a2d4a26e574d9fbac2183c9533f9b1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:35.564860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9668c1-1dda-41d6-a18b-b7fc321e5cc4 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:35.565412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9668c1-1dda-41d6-a18b-b7fc321e5cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:35.565513 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9668c1-1dda-41d6-a18b-b7fc321e5cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:35.585493 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-df9668c1-1dda-41d6-a18b-b7fc321e5cc4 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:35.586711 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-df9668c1-1dda-41d6-a18b-b7fc321e5cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:35.649583 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1395/2768] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:35.659211 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17b2f4-3797-4c2b-8c1e-f4504420a05a admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:35.660623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3c17b2f4-3797-4c2b-8c1e-f4504420a05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:35.717594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17b2f4-3797-4c2b-8c1e-f4504420a05a admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:35.721249 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34381236-702f-46db-9394-8ded141932ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:35.721896 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34381236-702f-46db-9394-8ded141932ce service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:35.722185 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34381236-702f-46db-9394-8ded141932ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:35.722466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34381236-702f-46db-9394-8ded141932ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:35.731758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34381236-702f-46db-9394-8ded141932ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:35.733051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34381236-702f-46db-9394-8ded141932ce service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:35.743484 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1374/2769] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:36.187111 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9668c1-1dda-41d6-a18b-b7fc321e5cc4 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:36.187386 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-df9668c1-1dda-41d6-a18b-b7fc321e5cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:36.202194 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9668c1-1dda-41d6-a18b-b7fc321e5cc4 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:36.206892 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f06835-5e37-4544-9526-470f7b5858d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:36.208286 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f06835-5e37-4544-9526-470f7b5858d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:36.208580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f06835-5e37-4544-9526-470f7b5858d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:36.209058 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f06835-5e37-4544-9526-470f7b5858d9 admin admin] PATH_INFO: `/v3/projects/89858984f3da439b9d34728bbb05469d` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:36.210417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f06835-5e37-4544-9526-470f7b5858d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89858984f3da439b9d34728bbb05469d)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:36.212338 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f06835-5e37-4544-9526-470f7b5858d9 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:36.304406 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34381236-702f-46db-9394-8ded141932ce service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:36.313006 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34381236-702f-46db-9394-8ded141932ce service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:36.316576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3048a-fe3b-47b3-b8a5-9ebd48744438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:36.317310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3048a-fe3b-47b3-b8a5-9ebd48744438 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:36.317594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3048a-fe3b-47b3-b8a5-9ebd48744438 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:36.317870 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3048a-fe3b-47b3-b8a5-9ebd48744438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:36.319920 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a7d3048a-fe3b-47b3-b8a5-9ebd48744438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:36.368737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-f7f06835-5e37-4544-9526-470f7b5858d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89858984f3da439b9d34728bbb05469d', 'request_id': 'req-f7f06835-5e37-4544-9526-470f7b5858d9'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:36.375959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-f7f06835-5e37-4544-9526-470f7b5858d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89858984f3da439b9d34728bbb05469d', 'request_id': 'req-f7f06835-5e37-4544-9526-470f7b5858d9'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:36.381895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:36.382410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3048a-fe3b-47b3-b8a5-9ebd48744438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:36.383661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-f7f06835-5e37-4544-9526-470f7b5858d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89858984f3da439b9d34728bbb05469d', 'request_id': 'req-f7f06835-5e37-4544-9526-470f7b5858d9'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:36.383812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3048a-fe3b-47b3-b8a5-9ebd48744438 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:36.393188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1375/2770] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:11:36.457580 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-f7f06835-5e37-4544-9526-470f7b5858d9 admin admin] The token cache is being invalidate because project 89858984f3da439b9d34728bbb05469d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:11:36.466655 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-f7f06835-5e37-4544-9526-470f7b5858d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:36.466655 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-f7f06835-5e37-4544-9526-470f7b5858d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:36.466655 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1396/2771] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:11:36 2022] DELETE /identity/v3/projects/89858984f3da439b9d34728bbb05469d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:36.466962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3048a-fe3b-47b3-b8a5-9ebd48744438 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:36.476752 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3048a-fe3b-47b3-b8a5-9ebd48744438 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:36.533493 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0f185-32ed-4534-ad12-52553f5dcfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:36.534371 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0f185-32ed-4534-ad12-52553f5dcfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:36.534653 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0f185-32ed-4534-ad12-52553f5dcfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:36.534925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0f185-32ed-4534-ad12-52553f5dcfaf admin admin] PATH_INFO: `/v3/users/711198e0bead418bbf56d1b675544d58` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:36.536141 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0f185-32ed-4534-ad12-52553f5dcfaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=711198e0bead418bbf56d1b675544d58)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:36.538856 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0f185-32ed-4534-ad12-52553f5dcfaf admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:36.560190 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:36.788280 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-53e0f185-32ed-4534-ad12-52553f5dcfaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '711198e0bead418bbf56d1b675544d58'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:36.788973 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-53e0f185-32ed-4534-ad12-52553f5dcfaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '711198e0bead418bbf56d1b675544d58'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:36.796128 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-53e0f185-32ed-4534-ad12-52553f5dcfaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '711198e0bead418bbf56d1b675544d58'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:36.796810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-53e0f185-32ed-4534-ad12-52553f5dcfaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '711198e0bead418bbf56d1b675544d58'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:36.875120 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-53e0f185-32ed-4534-ad12-52553f5dcfaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '711198e0bead418bbf56d1b675544d58'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:36.894215 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1376/2772] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:11:36 2022] DELETE /identity/v3/users/711198e0bead418bbf56d1b675544d58 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:37.472258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f06835-5e37-4544-9526-470f7b5858d9 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:37.472258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-f7f06835-5e37-4544-9526-470f7b5858d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:37.497872 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f06835-5e37-4544-9526-470f7b5858d9 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:37.578014 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:37.579084 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:37.579409 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:37.579705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d admin admin] PATH_INFO: `/v3/projects/d41c463630f24f9cbc61d02f79710626` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:37.580936 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41c463630f24f9cbc61d02f79710626)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:37.582985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:37.719998 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41c463630f24f9cbc61d02f79710626', 'request_id': 'req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:37.726825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41c463630f24f9cbc61d02f79710626', 'request_id': 'req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:37.736198 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41c463630f24f9cbc61d02f79710626', 'request_id': 'req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:37.837524 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d admin admin] The token cache is being invalidate because project d41c463630f24f9cbc61d02f79710626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:11:37.838062 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:37.838996 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:37.840866 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1397/2773] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:11:37 2022] DELETE /identity/v3/projects/d41c463630f24f9cbc61d02f79710626 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:37.846550 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0f185-32ed-4534-ad12-52553f5dcfaf admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:37.848051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-53e0f185-32ed-4534-ad12-52553f5dcfaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:37.861599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0f185-32ed-4534-ad12-52553f5dcfaf admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:37.934120 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d13d36-582b-47ad-962a-a64b06e84403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:37.935243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d13d36-582b-47ad-962a-a64b06e84403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:37.935597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d13d36-582b-47ad-962a-a64b06e84403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:37.935948 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d13d36-582b-47ad-962a-a64b06e84403 admin admin] PATH_INFO: `/v3/users/3a21cfd23aea4bc7b166d47da67aef22` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:37.937423 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d13d36-582b-47ad-962a-a64b06e84403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a21cfd23aea4bc7b166d47da67aef22)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:37.939462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d13d36-582b-47ad-962a-a64b06e84403 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:38.117964 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-25d13d36-582b-47ad-962a-a64b06e84403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a21cfd23aea4bc7b166d47da67aef22'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:38.118578 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-25d13d36-582b-47ad-962a-a64b06e84403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a21cfd23aea4bc7b166d47da67aef22'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:38.126202 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-25d13d36-582b-47ad-962a-a64b06e84403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a21cfd23aea4bc7b166d47da67aef22'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:38.126888 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-25d13d36-582b-47ad-962a-a64b06e84403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a21cfd23aea4bc7b166d47da67aef22'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:38.187681 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-25d13d36-582b-47ad-962a-a64b06e84403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a21cfd23aea4bc7b166d47da67aef22'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:38.213902 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1377/2774] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:11:37 2022] DELETE /identity/v3/users/3a21cfd23aea4bc7b166d47da67aef22 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:11:38.619370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:38.621544 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:38.636936 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4624ac-dd95-4dc6-a1ca-826291e31c6d admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:38.711517 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cde6f-48a2-47c6-b3f5-b81f34e9638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:38.712383 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cde6f-48a2-47c6-b3f5-b81f34e9638e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:38.712669 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cde6f-48a2-47c6-b3f5-b81f34e9638e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:38.712949 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cde6f-48a2-47c6-b3f5-b81f34e9638e admin admin] PATH_INFO: `/v3/projects/40a599de73d4485f8ef8abedd0dd6ccc` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:38.714164 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cde6f-48a2-47c6-b3f5-b81f34e9638e admin admin] RBAC: Authorizing `identity:delete_project(project_id=40a599de73d4485f8ef8abedd0dd6ccc)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:38.716072 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cde6f-48a2-47c6-b3f5-b81f34e9638e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:38.739868 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:38.870066 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-363cde6f-48a2-47c6-b3f5-b81f34e9638e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40a599de73d4485f8ef8abedd0dd6ccc', 'request_id': 'req-363cde6f-48a2-47c6-b3f5-b81f34e9638e'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:38.876531 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-363cde6f-48a2-47c6-b3f5-b81f34e9638e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40a599de73d4485f8ef8abedd0dd6ccc', 'request_id': 'req-363cde6f-48a2-47c6-b3f5-b81f34e9638e'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:38.882988 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-363cde6f-48a2-47c6-b3f5-b81f34e9638e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40a599de73d4485f8ef8abedd0dd6ccc', 'request_id': 'req-363cde6f-48a2-47c6-b3f5-b81f34e9638e'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:38.960871 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-363cde6f-48a2-47c6-b3f5-b81f34e9638e admin admin] The token cache is being invalidate because project 40a599de73d4485f8ef8abedd0dd6ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:11:38.961195 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-363cde6f-48a2-47c6-b3f5-b81f34e9638e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:38.961880 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-363cde6f-48a2-47c6-b3f5-b81f34e9638e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:38.963473 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1398/2775] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:11:38 2022] DELETE /identity/v3/projects/40a599de73d4485f8ef8abedd0dd6ccc => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:38.970623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb315f-62ad-4ca5-8211-57b93d7e64bb None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:38.971212 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb315f-62ad-4ca5-8211-57b93d7e64bb None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:38.971212 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb315f-62ad-4ca5-8211-57b93d7e64bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:38.993811 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-48cb315f-62ad-4ca5-8211-57b93d7e64bb None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:38.995274 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-48cb315f-62ad-4ca5-8211-57b93d7e64bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:39.008048 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:39.058961 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1378/2776] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:39.067637 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552ce6d-3009-4b7a-8b5e-8c59c7ee9e9d None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:39.067952 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552ce6d-3009-4b7a-8b5e-8c59c7ee9e9d None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:39.068235 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552ce6d-3009-4b7a-8b5e-8c59c7ee9e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:39.087310 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-2552ce6d-3009-4b7a-8b5e-8c59c7ee9e9d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:39.088596 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2552ce6d-3009-4b7a-8b5e-8c59c7ee9e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:39.097572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1399/2777] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:39.102175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb315f-62ad-4ca5-8211-57b93d7e64bb None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:39.112278 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb315f-62ad-4ca5-8211-57b93d7e64bb None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:39.117956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcece4-2aee-4211-9dd1-5bbc46daaae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:39.118710 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcece4-2aee-4211-9dd1-5bbc46daaae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:39.119198 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcece4-2aee-4211-9dd1-5bbc46daaae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:39.120470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dcece4-2aee-4211-9dd1-5bbc46daaae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:39.120805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcece4-2aee-4211-9dd1-5bbc46daaae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:11:39.121122 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcece4-2aee-4211-9dd1-5bbc46daaae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:39.122797 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dcece4-2aee-4211-9dd1-5bbc46daaae3 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:39.136738 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1379/2778] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:11:39.141096 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552ce6d-3009-4b7a-8b5e-8c59c7ee9e9d None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:39.151173 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552ce6d-3009-4b7a-8b5e-8c59c7ee9e9d None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:39.156585 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38ef8e-f1d4-4fdb-91ed-bde48b9c4c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:39.157701 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38ef8e-f1d4-4fdb-91ed-bde48b9c4c4f admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:39.157951 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38ef8e-f1d4-4fdb-91ed-bde48b9c4c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:39.158227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38ef8e-f1d4-4fdb-91ed-bde48b9c4c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:39.158952 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38ef8e-f1d4-4fdb-91ed-bde48b9c4c4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:39.160829 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38ef8e-f1d4-4fdb-91ed-bde48b9c4c4f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:39.286978 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1400/2779] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:11:39 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:11:39.292066 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcece4-2aee-4211-9dd1-5bbc46daaae3 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:39.302553 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dcece4-2aee-4211-9dd1-5bbc46daaae3 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:39.372279 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2b606-9d07-4479-9a28-54a1c522310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:39.372968 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2b606-9d07-4479-9a28-54a1c522310c admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:39.373298 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2b606-9d07-4479-9a28-54a1c522310c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:39.373577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2b606-9d07-4479-9a28-54a1c522310c admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:39.374289 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2b606-9d07-4479-9a28-54a1c522310c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:39.376219 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2b606-9d07-4479-9a28-54a1c522310c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:39.490955 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1380/2780] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:11:39 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:11:39.495636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38ef8e-f1d4-4fdb-91ed-bde48b9c4c4f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:39.507414 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38ef8e-f1d4-4fdb-91ed-bde48b9c4c4f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:39.513279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edcd94-e241-4158-827f-49caf13e0711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:39.513960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edcd94-e241-4158-827f-49caf13e0711 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:39.514457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edcd94-e241-4158-827f-49caf13e0711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:39.514749 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edcd94-e241-4158-827f-49caf13e0711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:39.515490 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edcd94-e241-4158-827f-49caf13e0711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:39.517094 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edcd94-e241-4158-827f-49caf13e0711 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:39.528780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1401/2781] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:11:39.532732 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2b606-9d07-4479-9a28-54a1c522310c admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:39.543569 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2b606-9d07-4479-9a28-54a1c522310c admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:39.548586 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f815d-f219-421a-8770-476011e6c51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:39.549218 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f815d-f219-421a-8770-476011e6c51e admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:39.549528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f815d-f219-421a-8770-476011e6c51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:39.549798 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f815d-f219-421a-8770-476011e6c51e admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:39.550536 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f815d-f219-421a-8770-476011e6c51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:39.552129 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f815d-f219-421a-8770-476011e6c51e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:39.563309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1381/2782] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:11:39.567266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edcd94-e241-4158-827f-49caf13e0711 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:39.577422 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edcd94-e241-4158-827f-49caf13e0711 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:39.582395 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ccea2-b467-468c-99a5-81fc920deacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:39.583334 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ccea2-b467-468c-99a5-81fc920deacd admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:39.583643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ccea2-b467-468c-99a5-81fc920deacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:39.583905 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ccea2-b467-468c-99a5-81fc920deacd admin admin] PATH_INFO: `/v3/projects/4e80b2bb9a15451093c3e8e70fc0e089/users/5ea010630f9c427da61b8b087a15980b/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:39.601034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ccea2-b467-468c-99a5-81fc920deacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e80b2bb9a15451093c3e8e70fc0e089, user_id=5ea010630f9c427da61b8b087a15980b, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:39.603810 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ccea2-b467-468c-99a5-81fc920deacd admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:39.671793 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1402/2783] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:11:39 2022] PUT /identity/v3/projects/4e80b2bb9a15451093c3e8e70fc0e089/users/5ea010630f9c427da61b8b087a15980b/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:39.685101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41cdef-c828-4523-afd2-c6fcdaa5fed8 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:39.685452 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41cdef-c828-4523-afd2-c6fcdaa5fed8 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:39.685743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41cdef-c828-4523-afd2-c6fcdaa5fed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:39.717429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-7c41cdef-c828-4523-afd2-c6fcdaa5fed8 None None] MFA Rules not processed for user `5ea010630f9c427da61b8b087a15980b`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:39.718842 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-7c41cdef-c828-4523-afd2-c6fcdaa5fed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:39.797993 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1382/2784] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:39.799097 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ccea2-b467-468c-99a5-81fc920deacd admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:39.872822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ccea2-b467-468c-99a5-81fc920deacd admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:39.878090 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07a40b-5ae3-461a-b0f3-1cf02e284b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:39.878855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07a40b-5ae3-461a-b0f3-1cf02e284b77 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:39.879189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07a40b-5ae3-461a-b0f3-1cf02e284b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:39.879479 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07a40b-5ae3-461a-b0f3-1cf02e284b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:39.880250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07a40b-5ae3-461a-b0f3-1cf02e284b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:39.882803 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07a40b-5ae3-461a-b0f3-1cf02e284b77 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:39.996041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1403/2785] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:11:39 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:11:40.000292 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41cdef-c828-4523-afd2-c6fcdaa5fed8 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:40.012453 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41cdef-c828-4523-afd2-c6fcdaa5fed8 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:40.024503 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:40.075672 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ffec9-786d-4b56-9941-c443875bfa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:40.087049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ffec9-786d-4b56-9941-c443875bfa66 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:40.087049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ffec9-786d-4b56-9941-c443875bfa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:40.087049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ffec9-786d-4b56-9941-c443875bfa66 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:40.087049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ffec9-786d-4b56-9941-c443875bfa66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:40.087049 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ffec9-786d-4b56-9941-c443875bfa66 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:40.230236 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1383/2786] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:11:39 2022] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:11:40.234232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07a40b-5ae3-461a-b0f3-1cf02e284b77 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:40.245556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07a40b-5ae3-461a-b0f3-1cf02e284b77 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:40.250249 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd51c1f-cc10-450c-b72c-b99047c292f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:40.250907 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd51c1f-cc10-450c-b72c-b99047c292f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:40.251212 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd51c1f-cc10-450c-b72c-b99047c292f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:40.251494 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd51c1f-cc10-450c-b72c-b99047c292f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:40.252224 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd51c1f-cc10-450c-b72c-b99047c292f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:40.253884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd51c1f-cc10-450c-b72c-b99047c292f3 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:40.267127 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1404/2787] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:11:40.271282 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ffec9-786d-4b56-9941-c443875bfa66 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:40.284483 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ffec9-786d-4b56-9941-c443875bfa66 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:40.287425 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c454f7f-d69b-4708-92d4-90d54132d4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:40.288384 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c454f7f-d69b-4708-92d4-90d54132d4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:40.288734 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c454f7f-d69b-4708-92d4-90d54132d4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:40.289018 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c454f7f-d69b-4708-92d4-90d54132d4cd admin admin] PATH_INFO: `/v3/projects/51fce21de5bd42fc9faa7127e4f94f18/users/56f7aecc289c42108bfdcebcca1dff24/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:40.313953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c454f7f-d69b-4708-92d4-90d54132d4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=51fce21de5bd42fc9faa7127e4f94f18, user_id=56f7aecc289c42108bfdcebcca1dff24, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:40.316767 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c454f7f-d69b-4708-92d4-90d54132d4cd admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:40.407511 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1384/2788] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:11:40 2022] PUT /identity/v3/projects/51fce21de5bd42fc9faa7127e4f94f18/users/56f7aecc289c42108bfdcebcca1dff24/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:40.411373 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd51c1f-cc10-450c-b72c-b99047c292f3 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:40.422629 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd51c1f-cc10-450c-b72c-b99047c292f3 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:40.441847 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:40.483015 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc8f3c-69a5-41e9-a7b9-f77c70544f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:40.483673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc8f3c-69a5-41e9-a7b9-f77c70544f5a admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:40.484113 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc8f3c-69a5-41e9-a7b9-f77c70544f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:40.484397 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc8f3c-69a5-41e9-a7b9-f77c70544f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:40.485958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc8f3c-69a5-41e9-a7b9-f77c70544f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:40.488071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc8f3c-69a5-41e9-a7b9-f77c70544f5a admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:40.500611 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1405/2789] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:11:40.506701 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c454f7f-d69b-4708-92d4-90d54132d4cd admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:40.517508 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c454f7f-d69b-4708-92d4-90d54132d4cd admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:40.522547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83412c71-f6b4-4761-880f-0ffe75ecd752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:40.523974 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412c71-f6b4-4761-880f-0ffe75ecd752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:40.523974 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412c71-f6b4-4761-880f-0ffe75ecd752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:40.524188 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83412c71-f6b4-4761-880f-0ffe75ecd752 admin admin] PATH_INFO: `/v3/projects/51fce21de5bd42fc9faa7127e4f94f18/users/56f7aecc289c42108bfdcebcca1dff24/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:40.526207 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83412c71-f6b4-4761-880f-0ffe75ecd752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51fce21de5bd42fc9faa7127e4f94f18, user_id=56f7aecc289c42108bfdcebcca1dff24, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:40.528851 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83412c71-f6b4-4761-880f-0ffe75ecd752 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:40.544613 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1385/2790] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:11:40 2022] PUT /identity/v3/projects/51fce21de5bd42fc9faa7127e4f94f18/users/56f7aecc289c42108bfdcebcca1dff24/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:40.622959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3177e1-828e-4389-8fc7-7f74408e7be7 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:40.623233 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3177e1-828e-4389-8fc7-7f74408e7be7 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:40.623571 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3177e1-828e-4389-8fc7-7f74408e7be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:40.653442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-fb3177e1-828e-4389-8fc7-7f74408e7be7 None None] MFA Rules not processed for user `56f7aecc289c42108bfdcebcca1dff24`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:40.654821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fb3177e1-828e-4389-8fc7-7f74408e7be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:40.733120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1406/2791] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:11:40.746622 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83412c71-f6b4-4761-880f-0ffe75ecd752 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:40.749034 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-83412c71-f6b4-4761-880f-0ffe75ecd752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:40.822561 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83412c71-f6b4-4761-880f-0ffe75ecd752 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:40.832494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2ffed-84da-4c22-9f9c-113b8e005e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:40.832494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2ffed-84da-4c22-9f9c-113b8e005e9d service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:40.832494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2ffed-84da-4c22-9f9c-113b8e005e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:40.832494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2ffed-84da-4c22-9f9c-113b8e005e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:40.910621 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2ffed-84da-4c22-9f9c-113b8e005e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:40.912123 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2ffed-84da-4c22-9f9c-113b8e005e9d service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:40.922736 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1386/2792] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:11:42.870615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3177e1-828e-4389-8fc7-7f74408e7be7 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:42.872220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fb3177e1-828e-4389-8fc7-7f74408e7be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:42.940129 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3177e1-828e-4389-8fc7-7f74408e7be7 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:42.947339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb894863-7518-45ee-8272-07dc09ac472a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:42.947339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb894863-7518-45ee-8272-07dc09ac472a service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:42.947339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb894863-7518-45ee-8272-07dc09ac472a service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:42.947339 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb894863-7518-45ee-8272-07dc09ac472a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:42.948102 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fb894863-7518-45ee-8272-07dc09ac472a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:43.027381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=100 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:43.027381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb894863-7518-45ee-8272-07dc09ac472a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:43.027381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb894863-7518-45ee-8272-07dc09ac472a service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:43.035155 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1407/2793] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:11:46.839432 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2ffed-84da-4c22-9f9c-113b8e005e9d service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:46.848689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2ffed-84da-4c22-9f9c-113b8e005e9d service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:46.852558 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe859c-f0da-47e1-9e5c-ce7e4bd19b00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:46.853269 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe859c-f0da-47e1-9e5c-ce7e4bd19b00 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:46.853698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe859c-f0da-47e1-9e5c-ce7e4bd19b00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:46.853859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe859c-f0da-47e1-9e5c-ce7e4bd19b00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:46.865398 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe859c-f0da-47e1-9e5c-ce7e4bd19b00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:46.868187 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe859c-f0da-47e1-9e5c-ce7e4bd19b00 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:46.879912 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1387/2794] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:47.747001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb894863-7518-45ee-8272-07dc09ac472a service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:47.749211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fb894863-7518-45ee-8272-07dc09ac472a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:47.912365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb894863-7518-45ee-8272-07dc09ac472a service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:47.918852 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8085f-999a-48c4-bd86-beed28725ba8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534035b2e8cf4f769e3dbbaabc0f6ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:47.919823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8085f-999a-48c4-bd86-beed28725ba8 service placement] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:47.920278 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8085f-999a-48c4-bd86-beed28725ba8 service placement] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:47.920488 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8085f-999a-48c4-bd86-beed28725ba8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:47.922401 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fda8085f-999a-48c4-bd86-beed28725ba8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:47.934995 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8085f-999a-48c4-bd86-beed28725ba8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:47.936861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8085f-999a-48c4-bd86-beed28725ba8 service placement] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:47.948923 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1408/2795] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:11:52.480470 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe859c-f0da-47e1-9e5c-ce7e4bd19b00 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:52.482195 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-acbe859c-f0da-47e1-9e5c-ce7e4bd19b00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:52.500985 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe859c-f0da-47e1-9e5c-ce7e4bd19b00 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:52.507385 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97aafc-1bad-4561-b96c-c8e8d6423ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:52.508485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97aafc-1bad-4561-b96c-c8e8d6423ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:52.508872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97aafc-1bad-4561-b96c-c8e8d6423ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:52.509256 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97aafc-1bad-4561-b96c-c8e8d6423ff5 admin admin] PATH_INFO: `/v3/users/6b06ec61408148a5980c70241965ea29` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:52.511319 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97aafc-1bad-4561-b96c-c8e8d6423ff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b06ec61408148a5980c70241965ea29)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:52.513712 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97aafc-1bad-4561-b96c-c8e8d6423ff5 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:52.518052 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:53.022309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ea97aafc-1bad-4561-b96c-c8e8d6423ff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b06ec61408148a5980c70241965ea29'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:53.022977 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ea97aafc-1bad-4561-b96c-c8e8d6423ff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b06ec61408148a5980c70241965ea29'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:53.030626 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ea97aafc-1bad-4561-b96c-c8e8d6423ff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b06ec61408148a5980c70241965ea29'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:53.031330 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ea97aafc-1bad-4561-b96c-c8e8d6423ff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b06ec61408148a5980c70241965ea29'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:53.177504 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-ea97aafc-1bad-4561-b96c-c8e8d6423ff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b06ec61408148a5980c70241965ea29'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:53.198958 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1388/2796] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:11:52 2022] DELETE /identity/v3/users/6b06ec61408148a5980c70241965ea29 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:53.638009 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8085f-999a-48c4-bd86-beed28725ba8 service placement] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:53.652797 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8085f-999a-48c4-bd86-beed28725ba8 service placement] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:53.723755 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97aafc-1bad-4561-b96c-c8e8d6423ff5 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:53.726518 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-ea97aafc-1bad-4561-b96c-c8e8d6423ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:53.736638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:53.739147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:53.741642 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:53.741642 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e admin admin] PATH_INFO: `/v3/projects/4ff6280dd30948d7bbe20b324aea2220` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:53.741642 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ff6280dd30948d7bbe20b324aea2220)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:53.743264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:53.812920 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97aafc-1bad-4561-b96c-c8e8d6423ff5 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:53.817757 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11f3de-6108-489d-bde6-c922fd6c4ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:53.818646 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f3de-6108-489d-bde6-c922fd6c4ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:53.818972 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f3de-6108-489d-bde6-c922fd6c4ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:53.819290 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f3de-6108-489d-bde6-c922fd6c4ec9 admin admin] PATH_INFO: `/v3/users/5ea010630f9c427da61b8b087a15980b` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:53.820547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11f3de-6108-489d-bde6-c922fd6c4ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea010630f9c427da61b8b087a15980b)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:53.822481 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11f3de-6108-489d-bde6-c922fd6c4ec9 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:54.042314 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ff6280dd30948d7bbe20b324aea2220', 'request_id': 'req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:54.049989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ff6280dd30948d7bbe20b324aea2220', 'request_id': 'req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:54.056347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ff6280dd30948d7bbe20b324aea2220', 'request_id': 'req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:54.284166 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-9c11f3de-6108-489d-bde6-c922fd6c4ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea010630f9c427da61b8b087a15980b'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:54.284833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-9c11f3de-6108-489d-bde6-c922fd6c4ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea010630f9c427da61b8b087a15980b'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:54.291980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-9c11f3de-6108-489d-bde6-c922fd6c4ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea010630f9c427da61b8b087a15980b'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:54.292621 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-9c11f3de-6108-489d-bde6-c922fd6c4ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea010630f9c427da61b8b087a15980b'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:54.336281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e admin admin] The token cache is being invalidate because project 4ff6280dd30948d7bbe20b324aea2220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:11:54.346471 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:54.346471 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:54.346471 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1409/2797] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:11:53 2022] DELETE /identity/v3/projects/4ff6280dd30948d7bbe20b324aea2220 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:54.346471 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:54.346471 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:54.357099 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:54.415730 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23189ec3-6b5d-4823-9cf4-fb9cd9ed027e admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:54.421013 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd54c9-954b-4fe3-aaf0-b97cdb9b25db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:54.422003 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd54c9-954b-4fe3-aaf0-b97cdb9b25db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:54.422211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd54c9-954b-4fe3-aaf0-b97cdb9b25db admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:54.422572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd54c9-954b-4fe3-aaf0-b97cdb9b25db admin admin] PATH_INFO: `/v3/users/528abb9df2cb401abbd9fa372a1d3d2c` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:54.423859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd54c9-954b-4fe3-aaf0-b97cdb9b25db admin admin] RBAC: Authorizing `identity:delete_user(user_id=528abb9df2cb401abbd9fa372a1d3d2c)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:54.425827 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd54c9-954b-4fe3-aaf0-b97cdb9b25db admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:54.469782 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-9c11f3de-6108-489d-bde6-c922fd6c4ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea010630f9c427da61b8b087a15980b'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:54.492833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:54.498950 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1389/2798] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:11:53 2022] DELETE /identity/v3/users/5ea010630f9c427da61b8b087a15980b => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:54.503649 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2e50e-baae-40e2-82ad-111059d53027 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:54.503946 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2e50e-baae-40e2-82ad-111059d53027 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:54.504228 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2e50e-baae-40e2-82ad-111059d53027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:54.522204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-1fb2e50e-baae-40e2-82ad-111059d53027 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:54.523408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-1fb2e50e-baae-40e2-82ad-111059d53027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:54.582332 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1390/2799] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:11:54.592925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2e50e-baae-40e2-82ad-111059d53027 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:54.594348 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-1fb2e50e-baae-40e2-82ad-111059d53027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:54.656365 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2e50e-baae-40e2-82ad-111059d53027 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:54.660489 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d8284-be78-4a44-89df-2d81b5d264a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:54.661238 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d8284-be78-4a44-89df-2d81b5d264a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:54.661598 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d8284-be78-4a44-89df-2d81b5d264a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:54.661884 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d8284-be78-4a44-89df-2d81b5d264a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:54.672309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d8284-be78-4a44-89df-2d81b5d264a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:54.673999 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d8284-be78-4a44-89df-2d81b5d264a1 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:54.685056 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1391/2800] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 15:11:54.704776 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-cffd54c9-954b-4fe3-aaf0-b97cdb9b25db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '528abb9df2cb401abbd9fa372a1d3d2c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:54.713370 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-cffd54c9-954b-4fe3-aaf0-b97cdb9b25db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '528abb9df2cb401abbd9fa372a1d3d2c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:54.714129 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-cffd54c9-954b-4fe3-aaf0-b97cdb9b25db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '528abb9df2cb401abbd9fa372a1d3d2c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:54.728161 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-cffd54c9-954b-4fe3-aaf0-b97cdb9b25db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '528abb9df2cb401abbd9fa372a1d3d2c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:54.728988 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-cffd54c9-954b-4fe3-aaf0-b97cdb9b25db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '528abb9df2cb401abbd9fa372a1d3d2c'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:54.849081 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1410/2801] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:11:54 2022] DELETE /identity/v3/users/528abb9df2cb401abbd9fa372a1d3d2c => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:11:55.212596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d8284-be78-4a44-89df-2d81b5d264a1 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:55.222798 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d8284-be78-4a44-89df-2d81b5d264a1 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:55.280661 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddfedc-b807-427d-a8de-fe03d3bc8db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:55.281557 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddfedc-b807-427d-a8de-fe03d3bc8db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:55.281840 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddfedc-b807-427d-a8de-fe03d3bc8db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:55.282119 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddfedc-b807-427d-a8de-fe03d3bc8db9 admin admin] PATH_INFO: `/v3/projects/6117241ac90e41989bcd261bdb33f078` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:55.283317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ddfedc-b807-427d-a8de-fe03d3bc8db9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6117241ac90e41989bcd261bdb33f078)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:55.285214 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ddfedc-b807-427d-a8de-fe03d3bc8db9 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:55.514100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd54c9-954b-4fe3-aaf0-b97cdb9b25db admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:55.514100 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-cffd54c9-954b-4fe3-aaf0-b97cdb9b25db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:55.519436 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd54c9-954b-4fe3-aaf0-b97cdb9b25db admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:55.524726 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f18d7-461d-4f9a-a72d-40839600ad84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:55.525769 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f18d7-461d-4f9a-a72d-40839600ad84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:55.526171 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f18d7-461d-4f9a-a72d-40839600ad84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:55.526522 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f18d7-461d-4f9a-a72d-40839600ad84 admin admin] PATH_INFO: `/v3/projects/4e80b2bb9a15451093c3e8e70fc0e089` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:55.527908 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f18d7-461d-4f9a-a72d-40839600ad84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e80b2bb9a15451093c3e8e70fc0e089)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:55.530025 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f18d7-461d-4f9a-a72d-40839600ad84 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:55.638639 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-09ddfedc-b807-427d-a8de-fe03d3bc8db9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6117241ac90e41989bcd261bdb33f078', 'request_id': 'req-09ddfedc-b807-427d-a8de-fe03d3bc8db9'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:55.645633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-09ddfedc-b807-427d-a8de-fe03d3bc8db9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6117241ac90e41989bcd261bdb33f078', 'request_id': 'req-09ddfedc-b807-427d-a8de-fe03d3bc8db9'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:55.651685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-09ddfedc-b807-427d-a8de-fe03d3bc8db9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6117241ac90e41989bcd261bdb33f078', 'request_id': 'req-09ddfedc-b807-427d-a8de-fe03d3bc8db9'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:55.697028 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-304f18d7-461d-4f9a-a72d-40839600ad84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e80b2bb9a15451093c3e8e70fc0e089', 'request_id': 'req-304f18d7-461d-4f9a-a72d-40839600ad84'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:55.703300 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-304f18d7-461d-4f9a-a72d-40839600ad84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e80b2bb9a15451093c3e8e70fc0e089', 'request_id': 'req-304f18d7-461d-4f9a-a72d-40839600ad84'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:55.708824 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-304f18d7-461d-4f9a-a72d-40839600ad84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e80b2bb9a15451093c3e8e70fc0e089', 'request_id': 'req-304f18d7-461d-4f9a-a72d-40839600ad84'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:55.828652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-09ddfedc-b807-427d-a8de-fe03d3bc8db9 admin admin] The token cache is being invalidate because project 6117241ac90e41989bcd261bdb33f078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:11:55.828910 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-09ddfedc-b807-427d-a8de-fe03d3bc8db9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:55.829593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-09ddfedc-b807-427d-a8de-fe03d3bc8db9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:55.831147 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1392/2802] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:11:55 2022] DELETE /identity/v3/projects/6117241ac90e41989bcd261bdb33f078 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:55.927951 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-304f18d7-461d-4f9a-a72d-40839600ad84 admin admin] The token cache is being invalidate because project 4e80b2bb9a15451093c3e8e70fc0e089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:11:55.928457 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-304f18d7-461d-4f9a-a72d-40839600ad84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:55.929198 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-304f18d7-461d-4f9a-a72d-40839600ad84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:55.930860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1411/2803] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:11:55 2022] DELETE /identity/v3/projects/4e80b2bb9a15451093c3e8e70fc0e089 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:11:55.935833 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddfedc-b807-427d-a8de-fe03d3bc8db9 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:55.937362 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-09ddfedc-b807-427d-a8de-fe03d3bc8db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:56.016890 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddfedc-b807-427d-a8de-fe03d3bc8db9 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:56.082535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132ca01-f8d2-45e8-a940-2f7bd508c26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:56.083701 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132ca01-f8d2-45e8-a940-2f7bd508c26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:56.083850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132ca01-f8d2-45e8-a940-2f7bd508c26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:56.084243 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132ca01-f8d2-45e8-a940-2f7bd508c26a admin admin] PATH_INFO: `/v3/users/56f7aecc289c42108bfdcebcca1dff24` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:56.086092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132ca01-f8d2-45e8-a940-2f7bd508c26a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f7aecc289c42108bfdcebcca1dff24)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:56.088067 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132ca01-f8d2-45e8-a940-2f7bd508c26a admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:56.194487 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:56.432964 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-a132ca01-f8d2-45e8-a940-2f7bd508c26a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f7aecc289c42108bfdcebcca1dff24'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:56.433887 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-a132ca01-f8d2-45e8-a940-2f7bd508c26a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f7aecc289c42108bfdcebcca1dff24'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:56.442094 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-a132ca01-f8d2-45e8-a940-2f7bd508c26a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f7aecc289c42108bfdcebcca1dff24'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:56.442837 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-a132ca01-f8d2-45e8-a940-2f7bd508c26a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f7aecc289c42108bfdcebcca1dff24'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:56.611220 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-a132ca01-f8d2-45e8-a940-2f7bd508c26a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f7aecc289c42108bfdcebcca1dff24'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:56.633621 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1393/2804] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:11:55 2022] DELETE /identity/v3/users/56f7aecc289c42108bfdcebcca1dff24 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:11:57.367957 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:57.421884 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f18d7-461d-4f9a-a72d-40839600ad84 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:57.427168 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-304f18d7-461d-4f9a-a72d-40839600ad84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:57.440764 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f18d7-461d-4f9a-a72d-40839600ad84 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:57.450491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:57.534533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff727a-8f88-41da-b6c1-504cdd1af0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:57.535501 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff727a-8f88-41da-b6c1-504cdd1af0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:57.535801 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff727a-8f88-41da-b6c1-504cdd1af0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:57.536548 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff727a-8f88-41da-b6c1-504cdd1af0cd admin admin] PATH_INFO: `/v3/projects/51fce21de5bd42fc9faa7127e4f94f18` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:57.542783 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff727a-8f88-41da-b6c1-504cdd1af0cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=51fce21de5bd42fc9faa7127e4f94f18)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:57.543218 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff727a-8f88-41da-b6c1-504cdd1af0cd admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:57.695575 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-47ff727a-8f88-41da-b6c1-504cdd1af0cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51fce21de5bd42fc9faa7127e4f94f18', 'request_id': 'req-47ff727a-8f88-41da-b6c1-504cdd1af0cd'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:57.703688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-47ff727a-8f88-41da-b6c1-504cdd1af0cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51fce21de5bd42fc9faa7127e4f94f18', 'request_id': 'req-47ff727a-8f88-41da-b6c1-504cdd1af0cd'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:57.714598 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-47ff727a-8f88-41da-b6c1-504cdd1af0cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51fce21de5bd42fc9faa7127e4f94f18', 'request_id': 'req-47ff727a-8f88-41da-b6c1-504cdd1af0cd'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:57.873452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-47ff727a-8f88-41da-b6c1-504cdd1af0cd admin admin] The token cache is being invalidate because project 51fce21de5bd42fc9faa7127e4f94f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:11:57.873452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-47ff727a-8f88-41da-b6c1-504cdd1af0cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:57.873452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-47ff727a-8f88-41da-b6c1-504cdd1af0cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:11:57.873452 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1412/2805] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:11:57 2022] DELETE /identity/v3/projects/51fce21de5bd42fc9faa7127e4f94f18 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:11:59.602618 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71270d81-7bb9-46e8-b33b-7c6eb9654517 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:59.603115 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71270d81-7bb9-46e8-b33b-7c6eb9654517 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:59.603254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71270d81-7bb9-46e8-b33b-7c6eb9654517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:59.620852 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-71270d81-7bb9-46e8-b33b-7c6eb9654517 None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:11:59.622094 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-71270d81-7bb9-46e8-b33b-7c6eb9654517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:59.678515 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1394/2806] 10.222.0.23 () {58 vars in 967 bytes} [Thu Jun 16 15:11:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:11:59.700765 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff727a-8f88-41da-b6c1-504cdd1af0cd admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:11:59.703023 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-47ff727a-8f88-41da-b6c1-504cdd1af0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:11:59.791094 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff727a-8f88-41da-b6c1-504cdd1af0cd admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:11:59.796270 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23ec58-8e9b-44b0-be66-cebcd96b096c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:11:59.796915 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23ec58-8e9b-44b0-be66-cebcd96b096c service swift] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:11:59.797236 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23ec58-8e9b-44b0-be66-cebcd96b096c service swift] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:11:59.797525 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23ec58-8e9b-44b0-be66-cebcd96b096c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:11:59.805716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23ec58-8e9b-44b0-be66-cebcd96b096c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:11:59.807314 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23ec58-8e9b-44b0-be66-cebcd96b096c service swift] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:11:59.815413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1413/2807] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 15:11:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:12:03.832717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042f96b-0e01-4a2d-860f-43e056a48bc6 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:12:03.833312 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042f96b-0e01-4a2d-860f-43e056a48bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:12:03.833528 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042f96b-0e01-4a2d-860f-43e056a48bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:12:03.857154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-6042f96b-0e01-4a2d-860f-43e056a48bc6 None None] MFA Rules not processed for user `5de52e11ee064c20bf56071dbf84f03e`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:12:03.858485 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-6042f96b-0e01-4a2d-860f-43e056a48bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:12:03.941891 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1395/2808] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:12:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:12:06.252069 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23ec58-8e9b-44b0-be66-cebcd96b096c service swift] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:12:06.253624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-9e23ec58-8e9b-44b0-be66-cebcd96b096c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:12:06.291350 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:06.326645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23ec58-8e9b-44b0-be66-cebcd96b096c service swift] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:12:06.332057 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3117e-9557-4399-ad94-fe215c717da4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534035b2e8cf4f769e3dbbaabc0f6ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:12:06.332715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3117e-9557-4399-ad94-fe215c717da4 service placement] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:12:06.333000 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3117e-9557-4399-ad94-fe215c717da4 service placement] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:12:06.333330 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3117e-9557-4399-ad94-fe215c717da4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:12:06.335913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-97a3117e-9557-4399-ad94-fe215c717da4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:12:06.349651 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3117e-9557-4399-ad94-fe215c717da4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:12:06.353188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3117e-9557-4399-ad94-fe215c717da4 service placement] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:12:06.363283 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1414/2809] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:12:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:12:09.993379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042f96b-0e01-4a2d-860f-43e056a48bc6 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:12:09.995312 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-6042f96b-0e01-4a2d-860f-43e056a48bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:12:10.074633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042f96b-0e01-4a2d-860f-43e056a48bc6 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:12:10.079352 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9e7a7-9731-47c4-a4cf-7bf050ac4042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:12:10.080247 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9e7a7-9731-47c4-a4cf-7bf050ac4042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:12:10.080539 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9e7a7-9731-47c4-a4cf-7bf050ac4042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:12:10.081654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9e7a7-9731-47c4-a4cf-7bf050ac4042 admin admin] PATH_INFO: `/v3/users/2aeab8c9fcff4c628b22faac07686d27` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:12:10.083391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9e7a7-9731-47c4-a4cf-7bf050ac4042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aeab8c9fcff4c628b22faac07686d27)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:12:10.085923 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9e7a7-9731-47c4-a4cf-7bf050ac4042 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:12:10.331969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-dad9e7a7-9731-47c4-a4cf-7bf050ac4042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aeab8c9fcff4c628b22faac07686d27'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:10.332623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-dad9e7a7-9731-47c4-a4cf-7bf050ac4042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aeab8c9fcff4c628b22faac07686d27'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:10.334662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:10.340827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-dad9e7a7-9731-47c4-a4cf-7bf050ac4042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aeab8c9fcff4c628b22faac07686d27'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:10.341593 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-dad9e7a7-9731-47c4-a4cf-7bf050ac4042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aeab8c9fcff4c628b22faac07686d27'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:10.474223 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-dad9e7a7-9731-47c4-a4cf-7bf050ac4042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aeab8c9fcff4c628b22faac07686d27'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:10.493637 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1396/2810] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:12:09 2022] DELETE /identity/v3/users/2aeab8c9fcff4c628b22faac07686d27 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:12:10.797855 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3117e-9557-4399-ad94-fe215c717da4 service placement] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:12:10.811087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3117e-9557-4399-ad94-fe215c717da4 service placement] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:12:10.870876 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:12:10.871989 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:12:10.872275 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:12:10.872553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d admin admin] PATH_INFO: `/v3/projects/1ca6d692ea7d4829ba46086df5911f51` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:12:10.873768 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca6d692ea7d4829ba46086df5911f51)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:12:10.875667 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:12:11.066224 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca6d692ea7d4829ba46086df5911f51', 'request_id': 'req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:11.073059 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca6d692ea7d4829ba46086df5911f51', 'request_id': 'req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:11.078604 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca6d692ea7d4829ba46086df5911f51', 'request_id': 'req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:11.153628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d admin admin] The token cache is being invalidate because project 1ca6d692ea7d4829ba46086df5911f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:12:11.153977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:11.154659 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:11.156434 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1415/2811] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:12:10 2022] DELETE /identity/v3/projects/1ca6d692ea7d4829ba46086df5911f51 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:12:11.160684 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9e7a7-9731-47c4-a4cf-7bf050ac4042 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:12:11.162176 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-dad9e7a7-9731-47c4-a4cf-7bf050ac4042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:12:11.176254 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9e7a7-9731-47c4-a4cf-7bf050ac4042 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:12:11.236336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6a355-7da0-4d4a-8a2f-cbf617a96875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:12:11.237253 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6a355-7da0-4d4a-8a2f-cbf617a96875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:12:11.237543 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6a355-7da0-4d4a-8a2f-cbf617a96875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:12:11.237827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6a355-7da0-4d4a-8a2f-cbf617a96875 admin admin] PATH_INFO: `/v3/users/1d42e9d282ca416b8ac3d79dafe1948d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:12:11.239032 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6a355-7da0-4d4a-8a2f-cbf617a96875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d42e9d282ca416b8ac3d79dafe1948d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:12:11.240969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6a355-7da0-4d4a-8a2f-cbf617a96875 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:12:11.453799 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-47c6a355-7da0-4d4a-8a2f-cbf617a96875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d42e9d282ca416b8ac3d79dafe1948d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:11.454471 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-47c6a355-7da0-4d4a-8a2f-cbf617a96875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d42e9d282ca416b8ac3d79dafe1948d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:11.461696 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-47c6a355-7da0-4d4a-8a2f-cbf617a96875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d42e9d282ca416b8ac3d79dafe1948d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:11.463292 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-47c6a355-7da0-4d4a-8a2f-cbf617a96875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d42e9d282ca416b8ac3d79dafe1948d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:11.539472 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-47c6a355-7da0-4d4a-8a2f-cbf617a96875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d42e9d282ca416b8ac3d79dafe1948d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:11.558856 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1397/2812] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:12:11 2022] DELETE /identity/v3/users/1d42e9d282ca416b8ac3d79dafe1948d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:12:11.839351 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:12:11.841095 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:12:11.859045 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dbcd5-edeb-431a-aad4-e75bc7cbb95d admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:12:11.915287 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:11.927747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1224d66-bf55-47af-9739-988ef3bad144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:12:11.928652 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1224d66-bf55-47af-9739-988ef3bad144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:12:11.928937 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1224d66-bf55-47af-9739-988ef3bad144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:12:11.929243 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1224d66-bf55-47af-9739-988ef3bad144 admin admin] PATH_INFO: `/v3/projects/247699d49f264936ac196ebddb679099` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:12:11.930482 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1224d66-bf55-47af-9739-988ef3bad144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=247699d49f264936ac196ebddb679099)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:12:11.932430 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1224d66-bf55-47af-9739-988ef3bad144 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:12:12.072400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a1224d66-bf55-47af-9739-988ef3bad144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247699d49f264936ac196ebddb679099', 'request_id': 'req-a1224d66-bf55-47af-9739-988ef3bad144'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:12.080607 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a1224d66-bf55-47af-9739-988ef3bad144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247699d49f264936ac196ebddb679099', 'request_id': 'req-a1224d66-bf55-47af-9739-988ef3bad144'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:12.088001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a1224d66-bf55-47af-9739-988ef3bad144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247699d49f264936ac196ebddb679099', 'request_id': 'req-a1224d66-bf55-47af-9739-988ef3bad144'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:12.207448 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a1224d66-bf55-47af-9739-988ef3bad144 admin admin] The token cache is being invalidate because project 247699d49f264936ac196ebddb679099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:12:12.207738 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a1224d66-bf55-47af-9739-988ef3bad144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:12.208435 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a1224d66-bf55-47af-9739-988ef3bad144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:12:12.210622 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1416/2813] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:12:11 2022] DELETE /identity/v3/projects/247699d49f264936ac196ebddb679099 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:12:21.555019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=64,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:22.204073 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:20.164996 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6a355-7da0-4d4a-8a2f-cbf617a96875 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:20.166525 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-47c6a355-7da0-4d4a-8a2f-cbf617a96875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:20.223346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6a355-7da0-4d4a-8a2f-cbf617a96875 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:20.279443 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afaba8-3233-489f-8baa-14ff6f54cc5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:20.280463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afaba8-3233-489f-8baa-14ff6f54cc5d service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:20.280947 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afaba8-3233-489f-8baa-14ff6f54cc5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:20.281451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afaba8-3233-489f-8baa-14ff6f54cc5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:20.283956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f2afaba8-3233-489f-8baa-14ff6f54cc5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:20.361652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afaba8-3233-489f-8baa-14ff6f54cc5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:20.363083 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afaba8-3233-489f-8baa-14ff6f54cc5d service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:20.374729 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1398/2814] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:13:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:13:23.889505 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1224d66-bf55-47af-9739-988ef3bad144 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:23.891158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a1224d66-bf55-47af-9739-988ef3bad144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:23.904960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1224d66-bf55-47af-9739-988ef3bad144 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:23.909012 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fc247-bca2-4bf4-aac5-61bd5d6395cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:23.909676 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fc247-bca2-4bf4-aac5-61bd5d6395cc service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:23.909959 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fc247-bca2-4bf4-aac5-61bd5d6395cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:23.910232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fc247-bca2-4bf4-aac5-61bd5d6395cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:23.911947 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-d44fc247-bca2-4bf4-aac5-61bd5d6395cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:23.931191 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44fc247-bca2-4bf4-aac5-61bd5d6395cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:23.932636 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44fc247-bca2-4bf4-aac5-61bd5d6395cc service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:23.943554 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1417/2815] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:13:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:13:25.856104 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef91fce-cbb1-46c5-9698-c9abba6762d7 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:25.856602 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef91fce-cbb1-46c5-9698-c9abba6762d7 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:25.856715 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef91fce-cbb1-46c5-9698-c9abba6762d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:25.877689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-3ef91fce-cbb1-46c5-9698-c9abba6762d7 None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:13:25.878950 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3ef91fce-cbb1-46c5-9698-c9abba6762d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:25.936432 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1399/2816] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 16 15:13:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:13:26.059946 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fc247-bca2-4bf4-aac5-61bd5d6395cc service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:26.061489 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-d44fc247-bca2-4bf4-aac5-61bd5d6395cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:26.133697 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fc247-bca2-4bf4-aac5-61bd5d6395cc service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:26.138705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21c657-8fb8-4fa0-a5bb-0f1fd5fa0e62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:26.139354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21c657-8fb8-4fa0-a5bb-0f1fd5fa0e62 service swift] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:26.139643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21c657-8fb8-4fa0-a5bb-0f1fd5fa0e62 service swift] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:26.139985 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21c657-8fb8-4fa0-a5bb-0f1fd5fa0e62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:26.150134 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21c657-8fb8-4fa0-a5bb-0f1fd5fa0e62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:26.151734 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21c657-8fb8-4fa0-a5bb-0f1fd5fa0e62 service swift] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:26.160296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1418/2817] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 15:13:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:13:35.931547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=99 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:36.157491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=38 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:49.463462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a8cea-db80-4297-89a5-dae60adc8b0f None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:49.463953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a8cea-db80-4297-89a5-dae60adc8b0f None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:49.464069 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a8cea-db80-4297-89a5-dae60adc8b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:49.482148 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-f51a8cea-db80-4297-89a5-dae60adc8b0f None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:13:49.483812 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f51a8cea-db80-4297-89a5-dae60adc8b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:49.490410 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1400/2818] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 16 15:13:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:13:49.502258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21c657-8fb8-4fa0-a5bb-0f1fd5fa0e62 service swift] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:49.514163 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21c657-8fb8-4fa0-a5bb-0f1fd5fa0e62 service swift] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:49.519214 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e4614-a07b-4100-a0c2-7b3c0bf0ad57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:49.519858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e4614-a07b-4100-a0c2-7b3c0bf0ad57 service swift] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:49.520149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e4614-a07b-4100-a0c2-7b3c0bf0ad57 service swift] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:49.520432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e4614-a07b-4100-a0c2-7b3c0bf0ad57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:49.530031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e4614-a07b-4100-a0c2-7b3c0bf0ad57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:49.534840 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e4614-a07b-4100-a0c2-7b3c0bf0ad57 service swift] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:49.540613 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1419/2819] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 15:13:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 15:13:54.638380 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a8cea-db80-4297-89a5-dae60adc8b0f None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:13:54.639805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f51a8cea-db80-4297-89a5-dae60adc8b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:54.658063 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a8cea-db80-4297-89a5-dae60adc8b0f None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:13:54.664364 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b29a6-7e12-460c-afb0-6fe72c250b88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:13:54.665962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b29a6-7e12-460c-afb0-6fe72c250b88 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:13:54.666257 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b29a6-7e12-460c-afb0-6fe72c250b88 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:13:54.666534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b29a6-7e12-460c-afb0-6fe72c250b88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:13:54.668369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-bb0b29a6-7e12-460c-afb0-6fe72c250b88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:13:54.732865 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b29a6-7e12-460c-afb0-6fe72c250b88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:13:54.734477 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b29a6-7e12-460c-afb0-6fe72c250b88 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:13:54.743922 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1401/2820] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:13:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:13:59.536619 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=6 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:04.475779 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e4614-a07b-4100-a0c2-7b3c0bf0ad57 service swift] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:04.477292 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-1b1e4614-a07b-4100-a0c2-7b3c0bf0ad57 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:04.489737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e4614-a07b-4100-a0c2-7b3c0bf0ad57 service swift] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:04.493211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242b0b-d694-4138-a093-efd99580f5bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:04.493895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242b0b-d694-4138-a093-efd99580f5bc service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:04.494134 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242b0b-d694-4138-a093-efd99580f5bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:04.494412 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242b0b-d694-4138-a093-efd99580f5bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:04.496234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4d242b0b-d694-4138-a093-efd99580f5bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:04.505628 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242b0b-d694-4138-a093-efd99580f5bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:04.507031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242b0b-d694-4138-a093-efd99580f5bc service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:04.518282 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1420/2821] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:14:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:14:04.739522 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=31 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:06.305633 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525d717-c200-4c87-9bb0-618c7f86ad80 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:06.306197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525d717-c200-4c87-9bb0-618c7f86ad80 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:06.306197 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525d717-c200-4c87-9bb0-618c7f86ad80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:06.323054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-3525d717-c200-4c87-9bb0-618c7f86ad80 None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:14:06.324769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3525d717-c200-4c87-9bb0-618c7f86ad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:06.331943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1402/2822] 10.222.0.23 () {58 vars in 967 bytes} [Thu Jun 16 15:14:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:14:06.345015 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242b0b-d694-4138-a093-efd99580f5bc service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:06.357241 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242b0b-d694-4138-a093-efd99580f5bc service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:06.362106 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678eb05-f213-4e24-a0fd-7336dead32bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:06.362740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678eb05-f213-4e24-a0fd-7336dead32bb service swift] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:06.363022 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678eb05-f213-4e24-a0fd-7336dead32bb service swift] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:06.363302 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678eb05-f213-4e24-a0fd-7336dead32bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:06.371516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678eb05-f213-4e24-a0fd-7336dead32bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:06.373078 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678eb05-f213-4e24-a0fd-7336dead32bb service swift] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:06.380828 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1421/2823] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 15:14:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:14:16.318246 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:16.377719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=12 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:49.357547 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525d717-c200-4c87-9bb0-618c7f86ad80 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:49.372054 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525d717-c200-4c87-9bb0-618c7f86ad80 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:49.382029 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed19ba-6f73-4b0f-ab56-de3bbd8952a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:49.382706 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed19ba-6f73-4b0f-ab56-de3bbd8952a3 service nova] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:49.383023 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed19ba-6f73-4b0f-ab56-de3bbd8952a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:49.383300 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed19ba-6f73-4b0f-ab56-de3bbd8952a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:49.385355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-bbed19ba-6f73-4b0f-ab56-de3bbd8952a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:49.400169 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed19ba-6f73-4b0f-ab56-de3bbd8952a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:49.402658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed19ba-6f73-4b0f-ab56-de3bbd8952a3 service nova] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:49.415913 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1403/2824] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:14:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:14:56.301094 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678eb05-f213-4e24-a0fd-7336dead32bb service swift] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:56.311347 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678eb05-f213-4e24-a0fd-7336dead32bb service swift] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:56.315004 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47707a-c0e7-4702-a785-159c5c8550a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:56.315641 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47707a-c0e7-4702-a785-159c5c8550a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:56.315930 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47707a-c0e7-4702-a785-159c5c8550a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:56.316211 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47707a-c0e7-4702-a785-159c5c8550a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:56.318013 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-bf47707a-c0e7-4702-a785-159c5c8550a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:56.382050 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47707a-c0e7-4702-a785-159c5c8550a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:56.389125 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47707a-c0e7-4702-a785-159c5c8550a3 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:14:56.393239 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1422/2825] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:14:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:14:59.409952 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=6 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:14:59.907512 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed19ba-6f73-4b0f-ab56-de3bbd8952a3 service nova] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:14:59.909046 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-bbed19ba-6f73-4b0f-ab56-de3bbd8952a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:14:59.925074 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed19ba-6f73-4b0f-ab56-de3bbd8952a3 service nova] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:14:59.929694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86773cdf-3bb5-4028-ba1d-55f12159d063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:14:59.930571 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86773cdf-3bb5-4028-ba1d-55f12159d063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:14:59.930859 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86773cdf-3bb5-4028-ba1d-55f12159d063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:14:59.931139 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86773cdf-3bb5-4028-ba1d-55f12159d063 admin admin] PATH_INFO: `/v3/users/5de52e11ee064c20bf56071dbf84f03e` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:14:59.932367 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86773cdf-3bb5-4028-ba1d-55f12159d063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de52e11ee064c20bf56071dbf84f03e)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:14:59.934354 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86773cdf-3bb5-4028-ba1d-55f12159d063 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:00.095481 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-86773cdf-3bb5-4028-ba1d-55f12159d063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de52e11ee064c20bf56071dbf84f03e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:00.096101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-86773cdf-3bb5-4028-ba1d-55f12159d063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de52e11ee064c20bf56071dbf84f03e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:00.103264 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-86773cdf-3bb5-4028-ba1d-55f12159d063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de52e11ee064c20bf56071dbf84f03e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:00.103980 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-86773cdf-3bb5-4028-ba1d-55f12159d063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de52e11ee064c20bf56071dbf84f03e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:00.186294 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-86773cdf-3bb5-4028-ba1d-55f12159d063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de52e11ee064c20bf56071dbf84f03e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:00.204648 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1404/2826] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:14:59 2022] DELETE /identity/v3/users/5de52e11ee064c20bf56071dbf84f03e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:00.462480 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47707a-c0e7-4702-a785-159c5c8550a3 service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:00.476056 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47707a-c0e7-4702-a785-159c5c8550a3 service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:00.542010 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc072f30-cb34-4fb2-ab64-ea7b10149a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:00.542881 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072f30-cb34-4fb2-ab64-ea7b10149a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:00.543234 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072f30-cb34-4fb2-ab64-ea7b10149a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:00.543496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072f30-cb34-4fb2-ab64-ea7b10149a1f admin admin] PATH_INFO: `/v3/projects/0acc0b546a5e47fd9c072c46cdce690e` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:00.544677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc072f30-cb34-4fb2-ab64-ea7b10149a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acc0b546a5e47fd9c072c46cdce690e)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:00.546621 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc072f30-cb34-4fb2-ab64-ea7b10149a1f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:00.647553 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dc072f30-cb34-4fb2-ab64-ea7b10149a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acc0b546a5e47fd9c072c46cdce690e', 'request_id': 'req-dc072f30-cb34-4fb2-ab64-ea7b10149a1f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:00.654019 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dc072f30-cb34-4fb2-ab64-ea7b10149a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acc0b546a5e47fd9c072c46cdce690e', 'request_id': 'req-dc072f30-cb34-4fb2-ab64-ea7b10149a1f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:00.659474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dc072f30-cb34-4fb2-ab64-ea7b10149a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acc0b546a5e47fd9c072c46cdce690e', 'request_id': 'req-dc072f30-cb34-4fb2-ab64-ea7b10149a1f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:00.723456 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dc072f30-cb34-4fb2-ab64-ea7b10149a1f admin admin] The token cache is being invalidate because project 0acc0b546a5e47fd9c072c46cdce690e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:15:00.723685 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dc072f30-cb34-4fb2-ab64-ea7b10149a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:00.724319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dc072f30-cb34-4fb2-ab64-ea7b10149a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:00.725903 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1423/2827] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:15:00 2022] DELETE /identity/v3/projects/0acc0b546a5e47fd9c072c46cdce690e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:00.731488 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dcdf9-e4ea-4fac-b028-f5a0336c3fec None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:00.731987 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dcdf9-e4ea-4fac-b028-f5a0336c3fec None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:00.732115 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dcdf9-e4ea-4fac-b028-f5a0336c3fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:00.760265 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-f93dcdf9-e4ea-4fac-b028-f5a0336c3fec None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:00.761552 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f93dcdf9-e4ea-4fac-b028-f5a0336c3fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:00.853689 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1405/2828] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:00.862085 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81784df-51c9-48bc-a387-ae175661afdb None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:00.862381 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81784df-51c9-48bc-a387-ae175661afdb None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:00.862662 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81784df-51c9-48bc-a387-ae175661afdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:00.870833 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:00.881487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-a81784df-51c9-48bc-a387-ae175661afdb None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:00.882702 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a81784df-51c9-48bc-a387-ae175661afdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:00.890904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1424/2829] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:00.895253 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dcdf9-e4ea-4fac-b028-f5a0336c3fec None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:00.906776 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dcdf9-e4ea-4fac-b028-f5a0336c3fec None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:00.911487 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884dc75-da37-429d-a1e7-a94d118ddcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:00.912154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884dc75-da37-429d-a1e7-a94d118ddcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:00.912445 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884dc75-da37-429d-a1e7-a94d118ddcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:00.912727 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884dc75-da37-429d-a1e7-a94d118ddcb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:00.913509 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884dc75-da37-429d-a1e7-a94d118ddcb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:15:00.913824 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884dc75-da37-429d-a1e7-a94d118ddcb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:00.915426 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884dc75-da37-429d-a1e7-a94d118ddcb9 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:00.927891 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1406/2830] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:15:00.932160 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81784df-51c9-48bc-a387-ae175661afdb None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:00.941336 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81784df-51c9-48bc-a387-ae175661afdb None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:00.946032 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b02ef-33d8-42af-8927-417e54d2eda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:00.946693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b02ef-33d8-42af-8927-417e54d2eda2 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:00.946974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b02ef-33d8-42af-8927-417e54d2eda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:00.947250 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b02ef-33d8-42af-8927-417e54d2eda2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:00.947948 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b02ef-33d8-42af-8927-417e54d2eda2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:00.949910 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b02ef-33d8-42af-8927-417e54d2eda2 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:01.037170 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1425/2831] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:15:00 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:15:01.040449 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884dc75-da37-429d-a1e7-a94d118ddcb9 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:01.051210 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884dc75-da37-429d-a1e7-a94d118ddcb9 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:01.063655 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:01.109816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1f8d3-5940-45a0-92b7-7f4c3981ade8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:01.110499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1f8d3-5940-45a0-92b7-7f4c3981ade8 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:01.110811 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1f8d3-5940-45a0-92b7-7f4c3981ade8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:01.111097 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1f8d3-5940-45a0-92b7-7f4c3981ade8 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:01.111805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1f8d3-5940-45a0-92b7-7f4c3981ade8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:01.113758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1f8d3-5940-45a0-92b7-7f4c3981ade8 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:01.195877 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1407/2832] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:15:01 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:15:01.199961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b02ef-33d8-42af-8927-417e54d2eda2 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:01.210432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b02ef-33d8-42af-8927-417e54d2eda2 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:01.215717 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d4ffd-bd0d-412e-8e56-62b65b93dbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:01.216376 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d4ffd-bd0d-412e-8e56-62b65b93dbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:01.216666 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d4ffd-bd0d-412e-8e56-62b65b93dbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:01.216950 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d4ffd-bd0d-412e-8e56-62b65b93dbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:01.217822 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d4ffd-bd0d-412e-8e56-62b65b93dbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:01.219434 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13d4ffd-bd0d-412e-8e56-62b65b93dbe3 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:01.230605 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1426/2833] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:15:01.234439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1f8d3-5940-45a0-92b7-7f4c3981ade8 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:01.244835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1f8d3-5940-45a0-92b7-7f4c3981ade8 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:01.249503 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f71b0-f242-4a4a-b1ca-7f0c2ec7d437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:01.250159 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f71b0-f242-4a4a-b1ca-7f0c2ec7d437 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:01.250444 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f71b0-f242-4a4a-b1ca-7f0c2ec7d437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:01.250722 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f71b0-f242-4a4a-b1ca-7f0c2ec7d437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:01.251451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f71b0-f242-4a4a-b1ca-7f0c2ec7d437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:01.253170 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f71b0-f242-4a4a-b1ca-7f0c2ec7d437 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:01.263657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1408/2834] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:15:01.267608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d4ffd-bd0d-412e-8e56-62b65b93dbe3 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:01.278263 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d4ffd-bd0d-412e-8e56-62b65b93dbe3 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:01.282888 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ec13d-04bf-484f-9153-c8dae94b7faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:01.283770 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ec13d-04bf-484f-9153-c8dae94b7faa admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:01.284057 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ec13d-04bf-484f-9153-c8dae94b7faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:01.284334 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ec13d-04bf-484f-9153-c8dae94b7faa admin admin] PATH_INFO: `/v3/projects/85d7b287024a4e6eaa699d57eb7427fb/users/f9038b639abd4f93a358faa55c72fd9e/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:01.298807 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ec13d-04bf-484f-9153-c8dae94b7faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d7b287024a4e6eaa699d57eb7427fb, user_id=f9038b639abd4f93a358faa55c72fd9e, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:01.301497 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ec13d-04bf-484f-9153-c8dae94b7faa admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:01.370230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1427/2835] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:15:01 2022] PUT /identity/v3/projects/85d7b287024a4e6eaa699d57eb7427fb/users/f9038b639abd4f93a358faa55c72fd9e/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:01.381306 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2580f-406c-4f68-a7aa-72f7c0212e5e None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:01.381607 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2580f-406c-4f68-a7aa-72f7c0212e5e None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:01.381895 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2580f-406c-4f68-a7aa-72f7c0212e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:01.411388 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-f5f2580f-406c-4f68-a7aa-72f7c0212e5e None None] MFA Rules not processed for user `f9038b639abd4f93a358faa55c72fd9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:01.412604 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f5f2580f-406c-4f68-a7aa-72f7c0212e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:01.476694 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1409/2836] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:01.481227 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ec13d-04bf-484f-9153-c8dae94b7faa admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:01.543856 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ec13d-04bf-484f-9153-c8dae94b7faa admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:01.548547 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e16f1-d16c-4c0f-8a77-1003feb75db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:01.549230 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e16f1-d16c-4c0f-8a77-1003feb75db6 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:01.549521 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e16f1-d16c-4c0f-8a77-1003feb75db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:01.549798 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e16f1-d16c-4c0f-8a77-1003feb75db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:01.550491 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e16f1-d16c-4c0f-8a77-1003feb75db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:01.552378 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e16f1-d16c-4c0f-8a77-1003feb75db6 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:01.679165 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1428/2837] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:15:01 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:15:01.681409 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2580f-406c-4f68-a7aa-72f7c0212e5e None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:01.692526 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2580f-406c-4f68-a7aa-72f7c0212e5e None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:01.749992 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6659b71-b194-42b7-b87c-49559955d466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:01.750664 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6659b71-b194-42b7-b87c-49559955d466 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:01.750872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6659b71-b194-42b7-b87c-49559955d466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:01.751156 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6659b71-b194-42b7-b87c-49559955d466 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:01.751850 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6659b71-b194-42b7-b87c-49559955d466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:01.753855 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6659b71-b194-42b7-b87c-49559955d466 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:01.858912 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1410/2838] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:15:01 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:15:01.862860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e16f1-d16c-4c0f-8a77-1003feb75db6 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:01.873742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e16f1-d16c-4c0f-8a77-1003feb75db6 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:01.879136 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b56ac-2cec-402e-a0f4-42c3c626da8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:01.879136 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b56ac-2cec-402e-a0f4-42c3c626da8d admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:01.879359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b56ac-2cec-402e-a0f4-42c3c626da8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:01.879633 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b56ac-2cec-402e-a0f4-42c3c626da8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:01.880350 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b56ac-2cec-402e-a0f4-42c3c626da8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:01.881967 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b56ac-2cec-402e-a0f4-42c3c626da8d admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:01.892951 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1429/2839] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:15:01.897124 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6659b71-b194-42b7-b87c-49559955d466 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:01.907596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6659b71-b194-42b7-b87c-49559955d466 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:01.912275 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebb6a2-bfc5-41ce-9c8e-772f72a15ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:01.913223 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebb6a2-bfc5-41ce-9c8e-772f72a15ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:01.913518 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebb6a2-bfc5-41ce-9c8e-772f72a15ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:01.913803 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebb6a2-bfc5-41ce-9c8e-772f72a15ab2 admin admin] PATH_INFO: `/v3/projects/af1d880c3baf4802b23b2cca5d1b0724/users/9ca5e82ab10f4300bd2eea38598bd55c/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:01.927204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:01.930285 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebb6a2-bfc5-41ce-9c8e-772f72a15ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1d880c3baf4802b23b2cca5d1b0724, user_id=9ca5e82ab10f4300bd2eea38598bd55c, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:01.937201 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebb6a2-bfc5-41ce-9c8e-772f72a15ab2 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:02.013845 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1411/2840] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:15:01 2022] PUT /identity/v3/projects/af1d880c3baf4802b23b2cca5d1b0724/users/9ca5e82ab10f4300bd2eea38598bd55c/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:02.017780 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b56ac-2cec-402e-a0f4-42c3c626da8d admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:02.027901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b56ac-2cec-402e-a0f4-42c3c626da8d admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:02.084382 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a6ebe-1fc5-4145-b584-785fb8b0799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:02.085034 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6ebe-1fc5-4145-b584-785fb8b0799a admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:02.085359 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6ebe-1fc5-4145-b584-785fb8b0799a admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:02.085645 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a6ebe-1fc5-4145-b584-785fb8b0799a admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:02.086367 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a6ebe-1fc5-4145-b584-785fb8b0799a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:02.087952 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a6ebe-1fc5-4145-b584-785fb8b0799a admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:02.097995 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1430/2841] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:15:02.102098 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebb6a2-bfc5-41ce-9c8e-772f72a15ab2 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:02.113109 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebb6a2-bfc5-41ce-9c8e-772f72a15ab2 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:02.117836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f450c4-ac74-462e-a7bc-cc85032a51cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:02.118978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f450c4-ac74-462e-a7bc-cc85032a51cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:02.119268 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f450c4-ac74-462e-a7bc-cc85032a51cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:02.120190 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f450c4-ac74-462e-a7bc-cc85032a51cd admin admin] PATH_INFO: `/v3/projects/af1d880c3baf4802b23b2cca5d1b0724/users/9ca5e82ab10f4300bd2eea38598bd55c/roles/c865040abd6c4b099381557da21c471d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:02.122217 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f450c4-ac74-462e-a7bc-cc85032a51cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1d880c3baf4802b23b2cca5d1b0724, user_id=9ca5e82ab10f4300bd2eea38598bd55c, role_id=c865040abd6c4b099381557da21c471d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:02.124843 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f450c4-ac74-462e-a7bc-cc85032a51cd admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:02.135378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1412/2842] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:15:02 2022] PUT /identity/v3/projects/af1d880c3baf4802b23b2cca5d1b0724/users/9ca5e82ab10f4300bd2eea38598bd55c/roles/c865040abd6c4b099381557da21c471d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:15:02.145622 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d484646-c9e9-4d76-8298-898fdf684665 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:02.145913 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d484646-c9e9-4d76-8298-898fdf684665 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:02.146189 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d484646-c9e9-4d76-8298-898fdf684665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:02.164920 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:02.172830 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-1d484646-c9e9-4d76-8298-898fdf684665 None None] MFA Rules not processed for user `9ca5e82ab10f4300bd2eea38598bd55c`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:02.176702 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-1d484646-c9e9-4d76-8298-898fdf684665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:02.240506 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1431/2843] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:02.253126 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f450c4-ac74-462e-a7bc-cc85032a51cd admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:02.254925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e0f450c4-ac74-462e-a7bc-cc85032a51cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:02.328563 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f450c4-ac74-462e-a7bc-cc85032a51cd admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:02.332013 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec0119-a259-4336-8539-d4deabe1d665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:02.332733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec0119-a259-4336-8539-d4deabe1d665 service cinder] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:02.333021 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec0119-a259-4336-8539-d4deabe1d665 service cinder] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:02.333369 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec0119-a259-4336-8539-d4deabe1d665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:02.342873 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec0119-a259-4336-8539-d4deabe1d665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:02.349623 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec0119-a259-4336-8539-d4deabe1d665 service cinder] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:02.354253 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1413/2844] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:02.473462 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d484646-c9e9-4d76-8298-898fdf684665 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:02.483643 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d484646-c9e9-4d76-8298-898fdf684665 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:02.487417 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547c5bf-33a7-4688-9e6a-10545e5fa2a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:02.488167 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c5bf-33a7-4688-9e6a-10545e5fa2a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:02.488461 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c5bf-33a7-4688-9e6a-10545e5fa2a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:02.488742 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c5bf-33a7-4688-9e6a-10545e5fa2a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:02.545458 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547c5bf-33a7-4688-9e6a-10545e5fa2a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:02.546999 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547c5bf-33a7-4688-9e6a-10545e5fa2a7 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:02.555904 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1432/2845] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:02.995405 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec0119-a259-4336-8539-d4deabe1d665 service cinder] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:03.068819 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec0119-a259-4336-8539-d4deabe1d665 service cinder] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:03.073956 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bf114-ebf6-45bb-af79-5204554eee9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:03.074861 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bf114-ebf6-45bb-af79-5204554eee9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:03.075151 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bf114-ebf6-45bb-af79-5204554eee9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:03.075438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bf114-ebf6-45bb-af79-5204554eee9e admin admin] PATH_INFO: `/v3/users/f9038b639abd4f93a358faa55c72fd9e` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:03.076634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bf114-ebf6-45bb-af79-5204554eee9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9038b639abd4f93a358faa55c72fd9e)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:03.078579 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bf114-ebf6-45bb-af79-5204554eee9e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:03.277468 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6d6bf114-ebf6-45bb-af79-5204554eee9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9038b639abd4f93a358faa55c72fd9e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:03.278129 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6d6bf114-ebf6-45bb-af79-5204554eee9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9038b639abd4f93a358faa55c72fd9e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:03.285051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6d6bf114-ebf6-45bb-af79-5204554eee9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9038b639abd4f93a358faa55c72fd9e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:03.285709 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6d6bf114-ebf6-45bb-af79-5204554eee9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9038b639abd4f93a358faa55c72fd9e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:03.346460 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6d6bf114-ebf6-45bb-af79-5204554eee9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9038b639abd4f93a358faa55c72fd9e'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:03.351168 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:03.364295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1414/2846] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:15:02 2022] DELETE /identity/v3/users/f9038b639abd4f93a358faa55c72fd9e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:15:03.369080 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad5d0e-6edf-4454-845e-9bba9981dae0 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:03.369901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad5d0e-6edf-4454-845e-9bba9981dae0 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:03.370179 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad5d0e-6edf-4454-845e-9bba9981dae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:03.397719 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-fcad5d0e-6edf-4454-845e-9bba9981dae0 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:03.398974 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fcad5d0e-6edf-4454-845e-9bba9981dae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:03.458364 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1433/2847] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:03.467907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bf114-ebf6-45bb-af79-5204554eee9e admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:03.469314 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-6d6bf114-ebf6-45bb-af79-5204554eee9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:03.547737 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bf114-ebf6-45bb-af79-5204554eee9e admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:03.551661 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe55be0-2631-42b8-b9f0-d98ed9f71c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:03.552309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe55be0-2631-42b8-b9f0-d98ed9f71c96 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:03.552595 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe55be0-2631-42b8-b9f0-d98ed9f71c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:03.552872 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe55be0-2631-42b8-b9f0-d98ed9f71c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:03.562358 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe55be0-2631-42b8-b9f0-d98ed9f71c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:03.563775 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe55be0-2631-42b8-b9f0-d98ed9f71c96 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:03.573204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1415/2848] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:03.988598 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad5d0e-6edf-4454-845e-9bba9981dae0 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:03.990386 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-fcad5d0e-6edf-4454-845e-9bba9981dae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:04.003127 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad5d0e-6edf-4454-845e-9bba9981dae0 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:04.008066 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:04.008994 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:04.009315 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:04.009612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e admin admin] PATH_INFO: `/v3/projects/85d7b287024a4e6eaa699d57eb7427fb` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:04.010919 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d7b287024a4e6eaa699d57eb7427fb)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:04.012849 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:04.038411 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:04.144895 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d7b287024a4e6eaa699d57eb7427fb', 'request_id': 'req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:04.151733 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d7b287024a4e6eaa699d57eb7427fb', 'request_id': 'req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:04.157356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d7b287024a4e6eaa699d57eb7427fb', 'request_id': 'req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:04.235512 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e admin admin] The token cache is being invalidate because project 85d7b287024a4e6eaa699d57eb7427fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:15:04.235812 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:04.236442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:04.238014 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1434/2849] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:15:03 2022] DELETE /identity/v3/projects/85d7b287024a4e6eaa699d57eb7427fb => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:04.242344 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe55be0-2631-42b8-b9f0-d98ed9f71c96 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:04.252588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe55be0-2631-42b8-b9f0-d98ed9f71c96 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:04.308448 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5b5da-b238-468a-8565-afac4efa0f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:04.309374 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5b5da-b238-468a-8565-afac4efa0f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:04.309658 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5b5da-b238-468a-8565-afac4efa0f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:04.309931 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5b5da-b238-468a-8565-afac4efa0f9b admin admin] PATH_INFO: `/v3/users/9ca5e82ab10f4300bd2eea38598bd55c` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:04.311104 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5b5da-b238-468a-8565-afac4efa0f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca5e82ab10f4300bd2eea38598bd55c)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:04.313037 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5b5da-b238-468a-8565-afac4efa0f9b admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:04.489741 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bbe5b5da-b238-468a-8565-afac4efa0f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca5e82ab10f4300bd2eea38598bd55c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:04.490408 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bbe5b5da-b238-468a-8565-afac4efa0f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca5e82ab10f4300bd2eea38598bd55c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:04.497741 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bbe5b5da-b238-468a-8565-afac4efa0f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca5e82ab10f4300bd2eea38598bd55c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:04.498383 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bbe5b5da-b238-468a-8565-afac4efa0f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca5e82ab10f4300bd2eea38598bd55c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:04.563506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bbe5b5da-b238-468a-8565-afac4efa0f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca5e82ab10f4300bd2eea38598bd55c'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:04.569479 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:04.583493 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1416/2850] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:15:04 2022] DELETE /identity/v3/users/9ca5e82ab10f4300bd2eea38598bd55c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:05.022138 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:05.023615 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:05.039305 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a0b24-75dd-4bb6-ae34-f5dc7b14404e admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:05.096377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54f117-ee1a-4172-92ea-3be43c4d6c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:05.097281 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54f117-ee1a-4172-92ea-3be43c4d6c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:05.097572 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54f117-ee1a-4172-92ea-3be43c4d6c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:05.097856 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54f117-ee1a-4172-92ea-3be43c4d6c3f admin admin] PATH_INFO: `/v3/projects/af1d880c3baf4802b23b2cca5d1b0724` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:05.099042 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54f117-ee1a-4172-92ea-3be43c4d6c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af1d880c3baf4802b23b2cca5d1b0724)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:05.100980 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54f117-ee1a-4172-92ea-3be43c4d6c3f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:05.215597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b54f117-ee1a-4172-92ea-3be43c4d6c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af1d880c3baf4802b23b2cca5d1b0724', 'request_id': 'req-5b54f117-ee1a-4172-92ea-3be43c4d6c3f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:05.221740 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b54f117-ee1a-4172-92ea-3be43c4d6c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af1d880c3baf4802b23b2cca5d1b0724', 'request_id': 'req-5b54f117-ee1a-4172-92ea-3be43c4d6c3f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:05.227225 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b54f117-ee1a-4172-92ea-3be43c4d6c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af1d880c3baf4802b23b2cca5d1b0724', 'request_id': 'req-5b54f117-ee1a-4172-92ea-3be43c4d6c3f'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:05.305159 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b54f117-ee1a-4172-92ea-3be43c4d6c3f admin admin] The token cache is being invalidate because project af1d880c3baf4802b23b2cca5d1b0724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:15:05.305392 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b54f117-ee1a-4172-92ea-3be43c4d6c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:05.306012 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-5b54f117-ee1a-4172-92ea-3be43c4d6c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:05.307633 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1435/2851] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:15:05 2022] DELETE /identity/v3/projects/af1d880c3baf4802b23b2cca5d1b0724 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:05.313002 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a36bee-8a63-44ad-a60c-d0a8a1d39925 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:05.313505 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a36bee-8a63-44ad-a60c-d0a8a1d39925 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:05.316083 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a36bee-8a63-44ad-a60c-d0a8a1d39925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:05.352333 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-c2a36bee-8a63-44ad-a60c-d0a8a1d39925 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:05.353588 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c2a36bee-8a63-44ad-a60c-d0a8a1d39925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:05.415073 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1417/2852] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:05.422619 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c694e10-4893-4430-8fcf-639ef52b45e9 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:05.422911 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c694e10-4893-4430-8fcf-639ef52b45e9 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:05.423188 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c694e10-4893-4430-8fcf-639ef52b45e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:05.442709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-6c694e10-4893-4430-8fcf-639ef52b45e9 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:05.443932 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-6c694e10-4893-4430-8fcf-639ef52b45e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:05.452439 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1436/2853] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:05.456632 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a36bee-8a63-44ad-a60c-d0a8a1d39925 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:05.466174 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a36bee-8a63-44ad-a60c-d0a8a1d39925 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:05.471092 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aee13-0340-4886-af25-10416864d54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:05.471740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aee13-0340-4886-af25-10416864d54d admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:05.472027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aee13-0340-4886-af25-10416864d54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:05.472307 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61aee13-0340-4886-af25-10416864d54d admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:05.473030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61aee13-0340-4886-af25-10416864d54d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:15:05.473376 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61aee13-0340-4886-af25-10416864d54d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:05.474970 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61aee13-0340-4886-af25-10416864d54d admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:05.486733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1418/2854] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:15:05.490914 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c694e10-4893-4430-8fcf-639ef52b45e9 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:05.500909 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c694e10-4893-4430-8fcf-639ef52b45e9 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:05.505655 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f88470-34f3-4da5-a2cb-f49baa80ee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:05.506304 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f88470-34f3-4da5-a2cb-f49baa80ee85 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:05.506624 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f88470-34f3-4da5-a2cb-f49baa80ee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:05.506910 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f88470-34f3-4da5-a2cb-f49baa80ee85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:05.507705 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f88470-34f3-4da5-a2cb-f49baa80ee85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:05.509639 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f88470-34f3-4da5-a2cb-f49baa80ee85 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:05.596918 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1437/2855] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:15:05 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:15:05.600983 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aee13-0340-4886-af25-10416864d54d admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:05.611115 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61aee13-0340-4886-af25-10416864d54d admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:05.667767 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1bf7f-a086-4600-949c-a4ae2f95fe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:05.668433 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1bf7f-a086-4600-949c-a4ae2f95fe75 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:05.668717 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1bf7f-a086-4600-949c-a4ae2f95fe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:05.668995 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1bf7f-a086-4600-949c-a4ae2f95fe75 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:05.669720 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1bf7f-a086-4600-949c-a4ae2f95fe75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:05.671630 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1bf7f-a086-4600-949c-a4ae2f95fe75 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:05.762110 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1419/2856] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:15:05 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:15:05.766187 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f88470-34f3-4da5-a2cb-f49baa80ee85 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:05.776774 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f88470-34f3-4da5-a2cb-f49baa80ee85 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:05.781595 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ec249-9f44-48a8-a0f7-7f16f540907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:05.782248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ec249-9f44-48a8-a0f7-7f16f540907f admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:05.782533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ec249-9f44-48a8-a0f7-7f16f540907f admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:05.782838 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ec249-9f44-48a8-a0f7-7f16f540907f admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:05.783561 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ec249-9f44-48a8-a0f7-7f16f540907f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:05.785258 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ec249-9f44-48a8-a0f7-7f16f540907f admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:05.796244 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1438/2857] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:15:05.800113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1bf7f-a086-4600-949c-a4ae2f95fe75 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:05.810716 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1bf7f-a086-4600-949c-a4ae2f95fe75 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:05.815652 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d06c7-9c09-4602-b465-d5d4461c2007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:05.816361 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d06c7-9c09-4602-b465-d5d4461c2007 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:05.816654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d06c7-9c09-4602-b465-d5d4461c2007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:05.816937 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d06c7-9c09-4602-b465-d5d4461c2007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:05.817767 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d06c7-9c09-4602-b465-d5d4461c2007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:05.819318 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d06c7-9c09-4602-b465-d5d4461c2007 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:05.829462 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1420/2858] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:15:05.833507 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ec249-9f44-48a8-a0f7-7f16f540907f admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:05.838731 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:05.844149 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ec249-9f44-48a8-a0f7-7f16f540907f admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:05.849371 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c99e2-b18d-4f77-995f-57dbcc28fbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:05.849688 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c99e2-b18d-4f77-995f-57dbcc28fbb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:05.849977 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c99e2-b18d-4f77-995f-57dbcc28fbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:05.850253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c99e2-b18d-4f77-995f-57dbcc28fbb6 admin admin] PATH_INFO: `/v3/projects/b889d8979af645449d0c723dea91499c/users/b455eb233a054f26acde819ae49d3a17/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:05.864991 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c99e2-b18d-4f77-995f-57dbcc28fbb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b889d8979af645449d0c723dea91499c, user_id=b455eb233a054f26acde819ae49d3a17, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:05.868118 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c99e2-b18d-4f77-995f-57dbcc28fbb6 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:05.976861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1439/2859] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:15:05 2022] PUT /identity/v3/projects/b889d8979af645449d0c723dea91499c/users/b455eb233a054f26acde819ae49d3a17/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:05.988726 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aee5a-0335-4583-831a-88c598e4b44a None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:05.989043 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aee5a-0335-4583-831a-88c598e4b44a None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:05.989364 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aee5a-0335-4583-831a-88c598e4b44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:06.016881 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-d32aee5a-0335-4583-831a-88c598e4b44a None None] MFA Rules not processed for user `b455eb233a054f26acde819ae49d3a17`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:06.018264 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d32aee5a-0335-4583-831a-88c598e4b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:06.048577 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:06.089591 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1421/2860] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:06.100894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c99e2-b18d-4f77-995f-57dbcc28fbb6 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:06.102654 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-641c99e2-b18d-4f77-995f-57dbcc28fbb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:06.161017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c99e2-b18d-4f77-995f-57dbcc28fbb6 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:06.164747 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976d12f-2a54-441e-b7f4-9a5f6834302d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:06.165474 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976d12f-2a54-441e-b7f4-9a5f6834302d service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:06.165759 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976d12f-2a54-441e-b7f4-9a5f6834302d service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:06.166041 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976d12f-2a54-441e-b7f4-9a5f6834302d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:06.174978 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976d12f-2a54-441e-b7f4-9a5f6834302d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:06.176400 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976d12f-2a54-441e-b7f4-9a5f6834302d service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:06.185304 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1440/2861] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:06.204612 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aee5a-0335-4583-831a-88c598e4b44a None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:06.266967 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aee5a-0335-4583-831a-88c598e4b44a None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:06.271534 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb36947-c248-4afa-bc39-510d75cf5a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:06.272403 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb36947-c248-4afa-bc39-510d75cf5a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:06.272690 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb36947-c248-4afa-bc39-510d75cf5a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:06.272974 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb36947-c248-4afa-bc39-510d75cf5a5f admin admin] PATH_INFO: `/v3/users/b455eb233a054f26acde819ae49d3a17` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:06.274221 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb36947-c248-4afa-bc39-510d75cf5a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b455eb233a054f26acde819ae49d3a17)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:06.276114 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb36947-c248-4afa-bc39-510d75cf5a5f admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:06.485118 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6eb36947-c248-4afa-bc39-510d75cf5a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b455eb233a054f26acde819ae49d3a17'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:06.485844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6eb36947-c248-4afa-bc39-510d75cf5a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b455eb233a054f26acde819ae49d3a17'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:06.492672 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6eb36947-c248-4afa-bc39-510d75cf5a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b455eb233a054f26acde819ae49d3a17'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:06.493713 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6eb36947-c248-4afa-bc39-510d75cf5a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b455eb233a054f26acde819ae49d3a17'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:06.561434 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-6eb36947-c248-4afa-bc39-510d75cf5a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b455eb233a054f26acde819ae49d3a17'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:06.579532 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1422/2862] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:15:06 2022] DELETE /identity/v3/users/b455eb233a054f26acde819ae49d3a17 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:06.584223 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361defda-a4a8-47da-b430-3c49df01da8b None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:06.584494 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361defda-a4a8-47da-b430-3c49df01da8b None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:06.584885 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361defda-a4a8-47da-b430-3c49df01da8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:06.602444 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-361defda-a4a8-47da-b430-3c49df01da8b None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:06.603675 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-361defda-a4a8-47da-b430-3c49df01da8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:06.664220 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1441/2863] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:06.673846 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb36947-c248-4afa-bc39-510d75cf5a5f admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:06.675237 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-6eb36947-c248-4afa-bc39-510d75cf5a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:06.726050 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:06.731252 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb36947-c248-4afa-bc39-510d75cf5a5f admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:06.734938 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8906b8-760b-4dab-9ba0-25af9d96bb10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:06.735634 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8906b8-760b-4dab-9ba0-25af9d96bb10 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:06.735871 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8906b8-760b-4dab-9ba0-25af9d96bb10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:06.736151 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8906b8-760b-4dab-9ba0-25af9d96bb10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:06.745387 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8906b8-760b-4dab-9ba0-25af9d96bb10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:06.746816 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8906b8-760b-4dab-9ba0-25af9d96bb10 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:06.756770 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1423/2864] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:07.176401 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361defda-a4a8-47da-b430-3c49df01da8b None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:07.181437 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-361defda-a4a8-47da-b430-3c49df01da8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:07.192064 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361defda-a4a8-47da-b430-3c49df01da8b None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:07.196887 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1bac1-8edb-478e-9b3f-64b3d86212c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:07.197791 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1bac1-8edb-478e-9b3f-64b3d86212c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:07.199340 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1bac1-8edb-478e-9b3f-64b3d86212c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:07.199631 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1bac1-8edb-478e-9b3f-64b3d86212c2 admin admin] PATH_INFO: `/v3/projects/b889d8979af645449d0c723dea91499c` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:07.201248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1bac1-8edb-478e-9b3f-64b3d86212c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b889d8979af645449d0c723dea91499c)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:07.203392 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1bac1-8edb-478e-9b3f-64b3d86212c2 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:07.299117 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dcf1bac1-8edb-478e-9b3f-64b3d86212c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b889d8979af645449d0c723dea91499c', 'request_id': 'req-dcf1bac1-8edb-478e-9b3f-64b3d86212c2'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:07.305707 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dcf1bac1-8edb-478e-9b3f-64b3d86212c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b889d8979af645449d0c723dea91499c', 'request_id': 'req-dcf1bac1-8edb-478e-9b3f-64b3d86212c2'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:07.312427 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dcf1bac1-8edb-478e-9b3f-64b3d86212c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b889d8979af645449d0c723dea91499c', 'request_id': 'req-dcf1bac1-8edb-478e-9b3f-64b3d86212c2'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:07.406828 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dcf1bac1-8edb-478e-9b3f-64b3d86212c2 admin admin] The token cache is being invalidate because project b889d8979af645449d0c723dea91499c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:15:07.407120 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dcf1bac1-8edb-478e-9b3f-64b3d86212c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:07.407785 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-dcf1bac1-8edb-478e-9b3f-64b3d86212c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:07.409434 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1442/2865] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:15:07 2022] DELETE /identity/v3/projects/b889d8979af645449d0c723dea91499c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:07.414338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aed74d-c423-476a-9136-febca225cb5d None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:07.414639 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aed74d-c423-476a-9136-febca225cb5d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:07.414929 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aed74d-c423-476a-9136-febca225cb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:07.433471 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-f4aed74d-c423-476a-9136-febca225cb5d None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:07.436860 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f4aed74d-c423-476a-9136-febca225cb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:07.494747 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1424/2866] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:07.502953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8718cc-d9fb-4cd5-ba4a-6ec5a7e46df7 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:07.503248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8718cc-d9fb-4cd5-ba4a-6ec5a7e46df7 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:07.503533 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8718cc-d9fb-4cd5-ba4a-6ec5a7e46df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:07.510735 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:07.521558 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-2b8718cc-d9fb-4cd5-ba4a-6ec5a7e46df7 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:07.522821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-2b8718cc-d9fb-4cd5-ba4a-6ec5a7e46df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:07.530737 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1443/2867] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:07.537111 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aed74d-c423-476a-9136-febca225cb5d None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:07.546999 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aed74d-c423-476a-9136-febca225cb5d None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:07.551589 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc6221-fd18-4c14-bf04-8c2ae11fef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:07.552206 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc6221-fd18-4c14-bf04-8c2ae11fef18 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:07.552491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc6221-fd18-4c14-bf04-8c2ae11fef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:07.552771 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc6221-fd18-4c14-bf04-8c2ae11fef18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:07.553599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc6221-fd18-4c14-bf04-8c2ae11fef18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:15:07.553907 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc6221-fd18-4c14-bf04-8c2ae11fef18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:07.555501 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc6221-fd18-4c14-bf04-8c2ae11fef18 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:07.567466 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1425/2868] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 15:15:07.571633 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8718cc-d9fb-4cd5-ba4a-6ec5a7e46df7 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:07.581238 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8718cc-d9fb-4cd5-ba4a-6ec5a7e46df7 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:07.586007 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2ee68-f512-4c27-b44c-02aa920b4c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:07.586661 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2ee68-f512-4c27-b44c-02aa920b4c54 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:07.586953 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2ee68-f512-4c27-b44c-02aa920b4c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:07.587236 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2ee68-f512-4c27-b44c-02aa920b4c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:07.587925 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2ee68-f512-4c27-b44c-02aa920b4c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:07.590413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2ee68-f512-4c27-b44c-02aa920b4c54 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:07.667709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1444/2869] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:15:07 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:15:07.672051 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc6221-fd18-4c14-bf04-8c2ae11fef18 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:07.682208 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc6221-fd18-4c14-bf04-8c2ae11fef18 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:07.739624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aba02-f4f3-46ae-8b7c-69534f5e7c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:07.740295 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aba02-f4f3-46ae-8b7c-69534f5e7c7f admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:07.740580 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aba02-f4f3-46ae-8b7c-69534f5e7c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:07.740864 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aba02-f4f3-46ae-8b7c-69534f5e7c7f admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:07.741599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5aba02-f4f3-46ae-8b7c-69534f5e7c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:07.743745 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5aba02-f4f3-46ae-8b7c-69534f5e7c7f admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:07.808270 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1426/2870] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:15:07 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:15:07.812162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2ee68-f512-4c27-b44c-02aa920b4c54 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:07.822588 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2ee68-f512-4c27-b44c-02aa920b4c54 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:07.827534 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27277fb4-aa3f-4b9d-80a3-76d81d859394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:07.828253 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27277fb4-aa3f-4b9d-80a3-76d81d859394 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:07.828538 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27277fb4-aa3f-4b9d-80a3-76d81d859394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:07.828815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27277fb4-aa3f-4b9d-80a3-76d81d859394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:07.829592 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27277fb4-aa3f-4b9d-80a3-76d81d859394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:07.831296 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27277fb4-aa3f-4b9d-80a3-76d81d859394 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:07.841961 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1445/2871] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:15:07.845953 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aba02-f4f3-46ae-8b7c-69534f5e7c7f admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:07.856677 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aba02-f4f3-46ae-8b7c-69534f5e7c7f admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:07.861365 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3f4f4-0ad7-4ad5-9ede-f6c6a1b33f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:07.862019 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3f4f4-0ad7-4ad5-9ede-f6c6a1b33f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:07.862309 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3f4f4-0ad7-4ad5-9ede-f6c6a1b33f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:07.862615 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3f4f4-0ad7-4ad5-9ede-f6c6a1b33f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:07.863346 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3f4f4-0ad7-4ad5-9ede-f6c6a1b33f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:07.864925 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3f4f4-0ad7-4ad5-9ede-f6c6a1b33f75 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:07.875030 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1427/2872] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:15:07.879008 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27277fb4-aa3f-4b9d-80a3-76d81d859394 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:07.888816 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27277fb4-aa3f-4b9d-80a3-76d81d859394 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:07.893454 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b02b4-a106-4383-ad89-b2333d8cb962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:07.894322 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b02b4-a106-4383-ad89-b2333d8cb962 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:07.894614 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b02b4-a106-4383-ad89-b2333d8cb962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:07.894897 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b02b4-a106-4383-ad89-b2333d8cb962 admin admin] PATH_INFO: `/v3/projects/ef949f3ab2a84b97b70877a78bd64be4/users/bdd80ffabcca4ca2b8100911c35cde98/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:07.909771 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b02b4-a106-4383-ad89-b2333d8cb962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef949f3ab2a84b97b70877a78bd64be4, user_id=bdd80ffabcca4ca2b8100911c35cde98, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:07.912408 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b02b4-a106-4383-ad89-b2333d8cb962 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:07.986843 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1446/2873] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:15:07 2022] PUT /identity/v3/projects/ef949f3ab2a84b97b70877a78bd64be4/users/bdd80ffabcca4ca2b8100911c35cde98/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:07.998718 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ee94f-56a8-4563-a70a-7e7a592fc4ed None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:07.999014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ee94f-56a8-4563-a70a-7e7a592fc4ed None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:07.999299 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ee94f-56a8-4563-a70a-7e7a592fc4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:08.025769 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-c86ee94f-56a8-4563-a70a-7e7a592fc4ed None None] MFA Rules not processed for user `bdd80ffabcca4ca2b8100911c35cde98`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:08.027580 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c86ee94f-56a8-4563-a70a-7e7a592fc4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:08.071355 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:08.092701 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1428/2874] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:08.104421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b02b4-a106-4383-ad89-b2333d8cb962 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:08.106248 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-ed9b02b4-a106-4383-ad89-b2333d8cb962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:08.165960 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b02b4-a106-4383-ad89-b2333d8cb962 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:08.169673 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597186ef-b496-41b0-9eba-06b4ebfd5cf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:08.170329 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597186ef-b496-41b0-9eba-06b4ebfd5cf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:08.170618 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597186ef-b496-41b0-9eba-06b4ebfd5cf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:08.170901 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597186ef-b496-41b0-9eba-06b4ebfd5cf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:08.179266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597186ef-b496-41b0-9eba-06b4ebfd5cf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:08.180704 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597186ef-b496-41b0-9eba-06b4ebfd5cf9 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:08.189504 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1447/2875] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:18.157435 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=7 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:18.185448 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=51,keystone:INSERT=2 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:22.855517 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ee94f-56a8-4563-a70a-7e7a592fc4ed None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:22.917451 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ee94f-56a8-4563-a70a-7e7a592fc4ed None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:22.922037 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf768f17-d289-493e-9bde-080780a32a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:22.922921 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf768f17-d289-493e-9bde-080780a32a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:22.923209 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf768f17-d289-493e-9bde-080780a32a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:22.923491 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf768f17-d289-493e-9bde-080780a32a12 admin admin] PATH_INFO: `/v3/users/bdd80ffabcca4ca2b8100911c35cde98` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:22.924679 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf768f17-d289-493e-9bde-080780a32a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd80ffabcca4ca2b8100911c35cde98)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:22.926646 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf768f17-d289-493e-9bde-080780a32a12 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:23.122018 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bf768f17-d289-493e-9bde-080780a32a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd80ffabcca4ca2b8100911c35cde98'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:23.122656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bf768f17-d289-493e-9bde-080780a32a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd80ffabcca4ca2b8100911c35cde98'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:23.129917 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bf768f17-d289-493e-9bde-080780a32a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd80ffabcca4ca2b8100911c35cde98'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:23.130663 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bf768f17-d289-493e-9bde-080780a32a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd80ffabcca4ca2b8100911c35cde98'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:23.214062 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-bf768f17-d289-493e-9bde-080780a32a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd80ffabcca4ca2b8100911c35cde98'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:23.232899 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1429/2876] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:15:22 2022] DELETE /identity/v3/users/bdd80ffabcca4ca2b8100911c35cde98 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:23.237391 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b88398-7927-423e-b628-33b4dd492257 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:23.237894 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b88398-7927-423e-b628-33b4dd492257 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:23.237999 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b88398-7927-423e-b628-33b4dd492257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:23.255845 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-b5b88398-7927-423e-b628-33b4dd492257 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:23.257065 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b5b88398-7927-423e-b628-33b4dd492257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:23.315399 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1448/2877] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:23.327758 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf768f17-d289-493e-9bde-080780a32a12 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:23.329226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-bf768f17-d289-493e-9bde-080780a32a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:23.387499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf768f17-d289-493e-9bde-080780a32a12 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:23.391157 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9010eda-cbb0-478e-90d2-edba7b59dc1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:23.391805 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9010eda-cbb0-478e-90d2-edba7b59dc1c service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:23.392094 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9010eda-cbb0-478e-90d2-edba7b59dc1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:23.392378 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9010eda-cbb0-478e-90d2-edba7b59dc1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:23.401400 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9010eda-cbb0-478e-90d2-edba7b59dc1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:23.402823 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9010eda-cbb0-478e-90d2-edba7b59dc1c service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:23.412227 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1430/2878] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:23.814356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b88398-7927-423e-b628-33b4dd492257 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:23.815818 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-b5b88398-7927-423e-b628-33b4dd492257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:23.829578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b88398-7927-423e-b628-33b4dd492257 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:23.834415 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62046de5-94d1-4944-9bb5-01ae08804369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:23.835290 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046de5-94d1-4944-9bb5-01ae08804369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:23.835576 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046de5-94d1-4944-9bb5-01ae08804369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:23.835861 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046de5-94d1-4944-9bb5-01ae08804369 admin admin] PATH_INFO: `/v3/projects/ef949f3ab2a84b97b70877a78bd64be4` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:23.837074 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62046de5-94d1-4944-9bb5-01ae08804369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef949f3ab2a84b97b70877a78bd64be4)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:23.839071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62046de5-94d1-4944-9bb5-01ae08804369 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:23.961331 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-62046de5-94d1-4944-9bb5-01ae08804369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef949f3ab2a84b97b70877a78bd64be4', 'request_id': 'req-62046de5-94d1-4944-9bb5-01ae08804369'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:23.973597 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-62046de5-94d1-4944-9bb5-01ae08804369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef949f3ab2a84b97b70877a78bd64be4', 'request_id': 'req-62046de5-94d1-4944-9bb5-01ae08804369'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:23.980569 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-62046de5-94d1-4944-9bb5-01ae08804369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef949f3ab2a84b97b70877a78bd64be4', 'request_id': 'req-62046de5-94d1-4944-9bb5-01ae08804369'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:24.048352 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-62046de5-94d1-4944-9bb5-01ae08804369 admin admin] The token cache is being invalidate because project ef949f3ab2a84b97b70877a78bd64be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:15:24.048653 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-62046de5-94d1-4944-9bb5-01ae08804369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:24.049433 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-62046de5-94d1-4944-9bb5-01ae08804369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:15:24.051005 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1449/2879] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:15:23 2022] DELETE /identity/v3/projects/ef949f3ab2a84b97b70877a78bd64be4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:24.055943 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6ac43-1bef-4e6d-93b1-8aa327f54f44 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:24.056425 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6ac43-1bef-4e6d-93b1-8aa327f54f44 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:24.056800 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6ac43-1bef-4e6d-93b1-8aa327f54f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:24.085835 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-fab6ac43-1bef-4e6d-93b1-8aa327f54f44 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:24.087083 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-fab6ac43-1bef-4e6d-93b1-8aa327f54f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:24.095989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:24.145827 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1431/2880] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:24.154413 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96e540-d371-418f-bc51-b701c5e613e1 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:24.154738 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96e540-d371-418f-bc51-b701c5e613e1 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:24.155055 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96e540-d371-418f-bc51-b701c5e613e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:24.174008 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-cb96e540-d371-418f-bc51-b701c5e613e1 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:24.175224 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-cb96e540-d371-418f-bc51-b701c5e613e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:24.183231 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1450/2881] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:24.187601 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6ac43-1bef-4e6d-93b1-8aa327f54f44 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:24.197174 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6ac43-1bef-4e6d-93b1-8aa327f54f44 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:24.201971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492ebeb-4240-411d-8b22-f7ea1a9545c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:24.202806 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ebeb-4240-411d-8b22-f7ea1a9545c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:24.203535 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ebeb-4240-411d-8b22-f7ea1a9545c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:24.203783 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492ebeb-4240-411d-8b22-f7ea1a9545c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:24.204506 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492ebeb-4240-411d-8b22-f7ea1a9545c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:15:24.204817 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492ebeb-4240-411d-8b22-f7ea1a9545c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:24.206438 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492ebeb-4240-411d-8b22-f7ea1a9545c9 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:24.218468 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1432/2882] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:15:24.222820 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96e540-d371-418f-bc51-b701c5e613e1 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:24.232709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96e540-d371-418f-bc51-b701c5e613e1 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:24.237574 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d1f5f-3cd6-4eca-a38e-330fd528610a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:24.238235 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d1f5f-3cd6-4eca-a38e-330fd528610a admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:24.238526 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d1f5f-3cd6-4eca-a38e-330fd528610a admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:24.238809 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d1f5f-3cd6-4eca-a38e-330fd528610a admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:24.239499 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d1f5f-3cd6-4eca-a38e-330fd528610a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:24.241438 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d1f5f-3cd6-4eca-a38e-330fd528610a admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:24.314017 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1451/2883] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:15:24 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:15:24.318657 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492ebeb-4240-411d-8b22-f7ea1a9545c9 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:24.329083 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492ebeb-4240-411d-8b22-f7ea1a9545c9 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:24.388900 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb9932-8f2d-4891-89dd-5f1103a51a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:24.389624 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb9932-8f2d-4891-89dd-5f1103a51a00 admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:24.389916 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb9932-8f2d-4891-89dd-5f1103a51a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:24.390200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb9932-8f2d-4891-89dd-5f1103a51a00 admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:24.390906 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb9932-8f2d-4891-89dd-5f1103a51a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:24.392822 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb9932-8f2d-4891-89dd-5f1103a51a00 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:24.457810 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1433/2884] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:15:24 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 15:15:24.462112 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d1f5f-3cd6-4eca-a38e-330fd528610a admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:24.478201 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d1f5f-3cd6-4eca-a38e-330fd528610a admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:24.486226 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898860ee-0a1b-402d-b62b-2595979fbf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:24.488715 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898860ee-0a1b-402d-b62b-2595979fbf8c admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:24.489008 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898860ee-0a1b-402d-b62b-2595979fbf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:24.489321 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898860ee-0a1b-402d-b62b-2595979fbf8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:24.490071 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898860ee-0a1b-402d-b62b-2595979fbf8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:24.491689 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898860ee-0a1b-402d-b62b-2595979fbf8c admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:24.503242 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1452/2885] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:15:24.507357 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb9932-8f2d-4891-89dd-5f1103a51a00 admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:24.517831 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb9932-8f2d-4891-89dd-5f1103a51a00 admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:24.522499 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf3f31-bd5a-49f2-b3f9-15de0c10190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:24.523154 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf3f31-bd5a-49f2-b3f9-15de0c10190c admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:24.523447 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf3f31-bd5a-49f2-b3f9-15de0c10190c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:24.523733 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf3f31-bd5a-49f2-b3f9-15de0c10190c admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:24.524743 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf3f31-bd5a-49f2-b3f9-15de0c10190c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:24.527027 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf3f31-bd5a-49f2-b3f9-15de0c10190c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:24.537382 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1434/2886] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:15:24.541516 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898860ee-0a1b-402d-b62b-2595979fbf8c admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:24.551544 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898860ee-0a1b-402d-b62b-2595979fbf8c admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:24.556259 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd69cc-159f-4f3d-8ff1-5a265fe63cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:24.557126 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd69cc-159f-4f3d-8ff1-5a265fe63cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:24.557442 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd69cc-159f-4f3d-8ff1-5a265fe63cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:24.557717 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd69cc-159f-4f3d-8ff1-5a265fe63cb2 admin admin] PATH_INFO: `/v3/projects/97b8e4df0cf8451897eec1c4c06b9311/users/7556da1ba10345c3bb781820afc75c13/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:24.571681 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd69cc-159f-4f3d-8ff1-5a265fe63cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b8e4df0cf8451897eec1c4c06b9311, user_id=7556da1ba10345c3bb781820afc75c13, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:24.574997 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd69cc-159f-4f3d-8ff1-5a265fe63cb2 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:24.631455 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1453/2887] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:15:24 2022] PUT /identity/v3/projects/97b8e4df0cf8451897eec1c4c06b9311/users/7556da1ba10345c3bb781820afc75c13/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:15:24.637204 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbd487-8a82-4651-aa2c-f7253ec7549b None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:24.637504 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbd487-8a82-4651-aa2c-f7253ec7549b None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:24.637790 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbd487-8a82-4651-aa2c-f7253ec7549b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:24.656425 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-b2dbd487-8a82-4651-aa2c-f7253ec7549b None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:24.657662 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-b2dbd487-8a82-4651-aa2c-f7253ec7549b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:24.717226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1435/2888] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:24.726835 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd69cc-159f-4f3d-8ff1-5a265fe63cb2 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:24.728652 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-abbd69cc-159f-4f3d-8ff1-5a265fe63cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:24.750496 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:24.787657 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd69cc-159f-4f3d-8ff1-5a265fe63cb2 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:24.791308 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89967134-c77c-4b33-b943-6d4ebce4d424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:24.791995 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89967134-c77c-4b33-b943-6d4ebce4d424 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:24.792265 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89967134-c77c-4b33-b943-6d4ebce4d424 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:24.792544 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89967134-c77c-4b33-b943-6d4ebce4d424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:24.801555 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89967134-c77c-4b33-b943-6d4ebce4d424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:24.802982 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89967134-c77c-4b33-b943-6d4ebce4d424 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:24.812313 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1454/2889] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:25.927608 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4fb3a-60d0-4a5c-a0b2-39fc25fe9065 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:25.928162 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4fb3a-60d0-4a5c-a0b2-39fc25fe9065 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:25.928310 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4fb3a-60d0-4a5c-a0b2-39fc25fe9065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:25.957279 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-f9c4fb3a-60d0-4a5c-a0b2-39fc25fe9065 None None] MFA Rules not processed for user `7556da1ba10345c3bb781820afc75c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:25.958654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-f9c4fb3a-60d0-4a5c-a0b2-39fc25fe9065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:25.968685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:26.030826 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1436/2890] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:26.047309 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89967134-c77c-4b33-b943-6d4ebce4d424 service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:26.048728 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-89967134-c77c-4b33-b943-6d4ebce4d424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:26.105738 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89967134-c77c-4b33-b943-6d4ebce4d424 service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:26.109365 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca685bf-5244-44eb-91dc-e25ceda9da5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:26.110006 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca685bf-5244-44eb-91dc-e25ceda9da5d service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:26.110288 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca685bf-5244-44eb-91dc-e25ceda9da5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:26.110563 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca685bf-5244-44eb-91dc-e25ceda9da5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:26.119170 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca685bf-5244-44eb-91dc-e25ceda9da5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:26.120612 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca685bf-5244-44eb-91dc-e25ceda9da5d service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:26.129613 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1455/2891] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:27.949720 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29dea-585f-4f4e-89cb-a90e72d3daa3 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:27.950318 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29dea-585f-4f4e-89cb-a90e72d3daa3 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:27.950457 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29dea-585f-4f4e-89cb-a90e72d3daa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:27.968439 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-d5e29dea-585f-4f4e-89cb-a90e72d3daa3 None None] MFA Rules not processed for user `7556da1ba10345c3bb781820afc75c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:27.969693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d5e29dea-585f-4f4e-89cb-a90e72d3daa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:27.976477 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1437/2892] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:28.222736 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca685bf-5244-44eb-91dc-e25ceda9da5d service cinder] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:28.224162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-5ca685bf-5244-44eb-91dc-e25ceda9da5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:28.236486 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca685bf-5244-44eb-91dc-e25ceda9da5d service cinder] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:28.240196 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43123262-ded6-485f-a183-e21ecae9579e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:28.240839 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43123262-ded6-485f-a183-e21ecae9579e service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:28.241145 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43123262-ded6-485f-a183-e21ecae9579e service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:28.241438 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43123262-ded6-485f-a183-e21ecae9579e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:28.243577 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-43123262-ded6-485f-a183-e21ecae9579e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:28.254002 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43123262-ded6-485f-a183-e21ecae9579e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:28.255432 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43123262-ded6-485f-a183-e21ecae9579e service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:28.263870 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1456/2893] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:28.709010 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e29dea-585f-4f4e-89cb-a90e72d3daa3 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:28.712405 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-d5e29dea-585f-4f4e-89cb-a90e72d3daa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:28.783918 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e29dea-585f-4f4e-89cb-a90e72d3daa3 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:28.788923 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed9c2d-3bcc-4cc2-8473-bdce2ea1d360 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534035b2e8cf4f769e3dbbaabc0f6ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:28.789643 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed9c2d-3bcc-4cc2-8473-bdce2ea1d360 service placement] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:28.789931 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed9c2d-3bcc-4cc2-8473-bdce2ea1d360 service placement] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:28.790242 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed9c2d-3bcc-4cc2-8473-bdce2ea1d360 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:28.792637 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-3eed9c2d-3bcc-4cc2-8473-bdce2ea1d360 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:28.804175 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed9c2d-3bcc-4cc2-8473-bdce2ea1d360 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:28.805818 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed9c2d-3bcc-4cc2-8473-bdce2ea1d360 service placement] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:28.815723 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1438/2894] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:38.260384 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=49 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:38.553307 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43123262-ded6-485f-a183-e21ecae9579e service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:38.557319 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-43123262-ded6-485f-a183-e21ecae9579e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:38.630147 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43123262-ded6-485f-a183-e21ecae9579e service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:38.636299 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bf2e2-550a-4b36-abdc-a7caeac6cc09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c2f1c63a674e3195c490ab5ad1318f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:38.636944 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bf2e2-550a-4b36-abdc-a7caeac6cc09 service nova] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:38.637266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bf2e2-550a-4b36-abdc-a7caeac6cc09 service nova] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:38.637551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53bf2e2-550a-4b36-abdc-a7caeac6cc09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:38.639352 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-d53bf2e2-550a-4b36-abdc-a7caeac6cc09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:38.653716 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bf2e2-550a-4b36-abdc-a7caeac6cc09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:38.657396 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53bf2e2-550a-4b36-abdc-a7caeac6cc09 service nova] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:38.666506 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1457/2895] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:38.811494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=58 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:46.135268 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f9b72-0cde-4be4-be7d-4dcbd9f7cf1f None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:46.135844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f9b72-0cde-4be4-be7d-4dcbd9f7cf1f None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:46.135844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f9b72-0cde-4be4-be7d-4dcbd9f7cf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:46.154239 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-a36f9b72-0cde-4be4-be7d-4dcbd9f7cf1f None None] MFA Rules not processed for user `7556da1ba10345c3bb781820afc75c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:15:46.155656 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-a36f9b72-0cde-4be4-be7d-4dcbd9f7cf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:46.162607 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1439/2896] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:15:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:15:46.392863 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bf2e2-550a-4b36-abdc-a7caeac6cc09 service nova] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:15:46.402421 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53bf2e2-550a-4b36-abdc-a7caeac6cc09 service nova] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:15:46.406031 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d70f7-9f51-4583-9c3c-c1704ac63816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:15:46.406668 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d70f7-9f51-4583-9c3c-c1704ac63816 service neutron] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:15:46.406958 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d70f7-9f51-4583-9c3c-c1704ac63816 service neutron] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:15:46.407241 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d70f7-9f51-4583-9c3c-c1704ac63816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:15:46.409270 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-124d70f7-9f51-4583-9c3c-c1704ac63816 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:15:46.419275 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d70f7-9f51-4583-9c3c-c1704ac63816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:15:46.420709 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d70f7-9f51-4583-9c3c-c1704ac63816 service neutron] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:15:46.428816 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1458/2897] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:15:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:15:56.147962 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=3 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:15:56.425148 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=40 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:16:06.446000 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e6937-cf4a-49da-86ff-cdc47f820a55 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:06.446502 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e6937-cf4a-49da-86ff-cdc47f820a55 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:06.446651 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e6937-cf4a-49da-86ff-cdc47f820a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:06.466388 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-668e6937-cf4a-49da-86ff-cdc47f820a55 None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:16:06.467621 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-668e6937-cf4a-49da-86ff-cdc47f820a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:16:06.523964 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1440/2898] 10.222.0.23 () {58 vars in 1009 bytes} [Thu Jun 16 15:16:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:16:06.650944 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d70f7-9f51-4583-9c3c-c1704ac63816 service neutron] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:16:06.652556 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-124d70f7-9f51-4583-9c3c-c1704ac63816 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:16:06.721909 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d70f7-9f51-4583-9c3c-c1704ac63816 service neutron] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:16:06.727033 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ecc42-ca53-47d3-a3b4-f2bd381c218b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:16:06.727682 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ecc42-ca53-47d3-a3b4-f2bd381c218b service swift] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:06.727972 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ecc42-ca53-47d3-a3b4-f2bd381c218b service swift] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:06.728254 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ecc42-ca53-47d3-a3b4-f2bd381c218b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:06.736754 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ecc42-ca53-47d3-a3b4-f2bd381c218b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:16:06.738423 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ecc42-ca53-47d3-a3b4-f2bd381c218b service swift] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:16:06.747494 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1459/2899] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 15:16:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:16:16.516429 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=25 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:16:16.743517 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=32 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:16:23.069599 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55f22b-b632-426d-9909-9f61d4e88a1d None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:23.070077 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55f22b-b632-426d-9909-9f61d4e88a1d None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:23.070190 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55f22b-b632-426d-9909-9f61d4e88a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:23.127811 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-bd55f22b-b632-426d-9909-9f61d4e88a1d None None] MFA Rules not processed for user `c1e11e5614c64b87a892740f39e8fc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:16:23.129014 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-bd55f22b-b632-426d-9909-9f61d4e88a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:16:23.152698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1441/2900] 10.222.0.23 () {58 vars in 967 bytes} [Thu Jun 16 15:16:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:16:23.165008 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ecc42-ca53-47d3-a3b4-f2bd381c218b service swift] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:16:23.186150 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ecc42-ca53-47d3-a3b4-f2bd381c218b service swift] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:16:23.191699 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a1126-2021-4798-8c86-4325b4506a17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a952ee6a39e1453b80a8a8b787d0fdf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:16:23.192354 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a1126-2021-4798-8c86-4325b4506a17 service swift] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:23.192647 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a1126-2021-4798-8c86-4325b4506a17 service swift] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:23.192931 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a1126-2021-4798-8c86-4325b4506a17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:23.202589 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a1126-2021-4798-8c86-4325b4506a17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:16:23.208184 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a1126-2021-4798-8c86-4325b4506a17 service swift] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:16:23.212310 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1460/2901] 10.222.0.23 () {60 vars in 1384 bytes} [Thu Jun 16 15:16:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 15:16:26.132379 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55f22b-b632-426d-9909-9f61d4e88a1d None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:16:26.144740 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55f22b-b632-426d-9909-9f61d4e88a1d None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:16:26.151693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52886f8-04fc-4c15-b4ac-90776d5dcc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:16:26.152514 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52886f8-04fc-4c15-b4ac-90776d5dcc10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:26.152861 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52886f8-04fc-4c15-b4ac-90776d5dcc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:26.153184 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52886f8-04fc-4c15-b4ac-90776d5dcc10 admin admin] PATH_INFO: `/v3/users/7556da1ba10345c3bb781820afc75c13` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:26.154545 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52886f8-04fc-4c15-b4ac-90776d5dcc10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7556da1ba10345c3bb781820afc75c13)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:16:26.156574 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52886f8-04fc-4c15-b4ac-90776d5dcc10 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:16:26.337978 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-a52886f8-04fc-4c15-b4ac-90776d5dcc10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7556da1ba10345c3bb781820afc75c13'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:26.338553 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-a52886f8-04fc-4c15-b4ac-90776d5dcc10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7556da1ba10345c3bb781820afc75c13'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:26.346685 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-a52886f8-04fc-4c15-b4ac-90776d5dcc10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7556da1ba10345c3bb781820afc75c13'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:26.347463 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-a52886f8-04fc-4c15-b4ac-90776d5dcc10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7556da1ba10345c3bb781820afc75c13'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:26.403912 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-a52886f8-04fc-4c15-b4ac-90776d5dcc10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7556da1ba10345c3bb781820afc75c13'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:26.422292 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1442/2902] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:16:26 2022] DELETE /identity/v3/users/7556da1ba10345c3bb781820afc75c13 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:16:26.667860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a1126-2021-4798-8c86-4325b4506a17 service swift] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:16:26.678594 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a1126-2021-4798-8c86-4325b4506a17 service swift] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:16:26.738160 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b05512-b419-43fe-ba3c-e93e36a3118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:16:26.739115 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05512-b419-43fe-ba3c-e93e36a3118d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:26.739410 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05512-b419-43fe-ba3c-e93e36a3118d admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:26.739693 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05512-b419-43fe-ba3c-e93e36a3118d admin admin] PATH_INFO: `/v3/projects/97b8e4df0cf8451897eec1c4c06b9311` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:26.741158 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b05512-b419-43fe-ba3c-e93e36a3118d admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b8e4df0cf8451897eec1c4c06b9311)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:16:26.743092 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b05512-b419-43fe-ba3c-e93e36a3118d admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:16:26.855677 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-79b05512-b419-43fe-ba3c-e93e36a3118d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b8e4df0cf8451897eec1c4c06b9311', 'request_id': 'req-79b05512-b419-43fe-ba3c-e93e36a3118d'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:26.861891 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-79b05512-b419-43fe-ba3c-e93e36a3118d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b8e4df0cf8451897eec1c4c06b9311', 'request_id': 'req-79b05512-b419-43fe-ba3c-e93e36a3118d'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:26.868134 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-79b05512-b419-43fe-ba3c-e93e36a3118d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b8e4df0cf8451897eec1c4c06b9311', 'request_id': 'req-79b05512-b419-43fe-ba3c-e93e36a3118d'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:26.940232 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-79b05512-b419-43fe-ba3c-e93e36a3118d admin admin] The token cache is being invalidate because project 97b8e4df0cf8451897eec1c4c06b9311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:16:26.944564 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-79b05512-b419-43fe-ba3c-e93e36a3118d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:26.944564 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-79b05512-b419-43fe-ba3c-e93e36a3118d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:26.944564 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1461/2903] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:16:26 2022] DELETE /identity/v3/projects/97b8e4df0cf8451897eec1c4c06b9311 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:16:26.949579 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad5747-3789-4b2f-be13-48b71fdf09c7 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:26.949903 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad5747-3789-4b2f-be13-48b71fdf09c7 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:26.950373 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad5747-3789-4b2f-be13-48b71fdf09c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:26.968421 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-c8ad5747-3789-4b2f-be13-48b71fdf09c7 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:16:26.969670 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c8ad5747-3789-4b2f-be13-48b71fdf09c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:16:27.034719 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1443/2904] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:16:27.043363 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c1878-99e7-4467-9509-8144021e65d3 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:27.043658 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c1878-99e7-4467-9509-8144021e65d3 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:27.043945 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c1878-99e7-4467-9509-8144021e65d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:27.062279 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-d34c1878-99e7-4467-9509-8144021e65d3 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:16:27.063487 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-d34c1878-99e7-4467-9509-8144021e65d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:16:27.071418 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1462/2905] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 15:16:27.076399 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad5747-3789-4b2f-be13-48b71fdf09c7 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:16:27.086338 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad5747-3789-4b2f-be13-48b71fdf09c7 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:16:27.091585 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab24763-a1da-46c0-a980-8c691af0880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:16:27.092361 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab24763-a1da-46c0-a980-8c691af0880c admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:27.092654 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab24763-a1da-46c0-a980-8c691af0880c admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:27.092934 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab24763-a1da-46c0-a980-8c691af0880c admin admin] PATH_INFO: `/v3/domains` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:27.093693 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab24763-a1da-46c0-a980-8c691af0880c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 15:16:27.094008 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab24763-a1da-46c0-a980-8c691af0880c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:16:27.095597 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab24763-a1da-46c0-a980-8c691af0880c admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:16:27.108031 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1444/2906] 10.222.0.23 () {58 vars in 1152 bytes} [Thu Jun 16 15:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 15:16:27.112276 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c1878-99e7-4467-9509-8144021e65d3 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:16:27.121712 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c1878-99e7-4467-9509-8144021e65d3 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:16:27.126419 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3abbc-767b-454a-9418-5dd2e9644033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:16:27.127066 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3abbc-767b-454a-9418-5dd2e9644033 admin admin] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:27.127356 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3abbc-767b-454a-9418-5dd2e9644033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:27.127639 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3abbc-767b-454a-9418-5dd2e9644033 admin admin] PATH_INFO: `/v3/projects` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:27.128377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3abbc-767b-454a-9418-5dd2e9644033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:16:27.130328 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3abbc-767b-454a-9418-5dd2e9644033 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:16:27.217020 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1463/2907] 10.222.0.23 () {60 vars in 1152 bytes} [Thu Jun 16 15:16:27 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:16:27.221226 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab24763-a1da-46c0-a980-8c691af0880c admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:16:27.227728 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:16:27.232324 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab24763-a1da-46c0-a980-8c691af0880c admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:16:27.287628 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4dffe-ab58-4891-9e73-c9d474b0644e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:16:27.288292 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4dffe-ab58-4891-9e73-c9d474b0644e admin admin] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:27.288575 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4dffe-ab58-4891-9e73-c9d474b0644e admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:27.288849 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4dffe-ab58-4891-9e73-c9d474b0644e admin admin] PATH_INFO: `/v3/users` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:27.289594 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4dffe-ab58-4891-9e73-c9d474b0644e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:16:27.292335 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4dffe-ab58-4891-9e73-c9d474b0644e admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:16:27.386971 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1445/2908] 10.222.0.23 () {60 vars in 1143 bytes} [Thu Jun 16 15:16:27 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 15:16:27.391266 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3abbc-767b-454a-9418-5dd2e9644033 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:16:27.402264 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3abbc-767b-454a-9418-5dd2e9644033 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:16:27.406941 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103212ac-d3c0-484b-aceb-9dcc7eee8d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:16:27.407648 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103212ac-d3c0-484b-aceb-9dcc7eee8d98 admin admin] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:27.407914 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103212ac-d3c0-484b-aceb-9dcc7eee8d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:27.408199 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103212ac-d3c0-484b-aceb-9dcc7eee8d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:27.408929 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103212ac-d3c0-484b-aceb-9dcc7eee8d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:16:27.410578 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103212ac-d3c0-484b-aceb-9dcc7eee8d98 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:16:27.420892 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1464/2909] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:16:27.424765 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4dffe-ab58-4891-9e73-c9d474b0644e admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:16:27.434753 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4dffe-ab58-4891-9e73-c9d474b0644e admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:16:27.439436 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4d7f7-576a-41a3-bcac-f0bf7b5c09c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:16:27.440120 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4d7f7-576a-41a3-bcac-f0bf7b5c09c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:27.440415 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4d7f7-576a-41a3-bcac-f0bf7b5c09c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:27.440698 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4d7f7-576a-41a3-bcac-f0bf7b5c09c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:27.441576 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4d7f7-576a-41a3-bcac-f0bf7b5c09c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:16:27.443200 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a4d7f7-576a-41a3-bcac-f0bf7b5c09c2 admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:16:27.453596 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1446/2910] 10.222.0.23 () {58 vars in 1121 bytes} [Thu Jun 16 15:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 15:16:27.457860 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103212ac-d3c0-484b-aceb-9dcc7eee8d98 admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:16:27.468468 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103212ac-d3c0-484b-aceb-9dcc7eee8d98 admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:16:27.473162 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae407e6-0fda-4d92-bea4-802c5ae51fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:16:27.474049 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae407e6-0fda-4d92-bea4-802c5ae51fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:27.474330 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae407e6-0fda-4d92-bea4-802c5ae51fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:27.474608 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae407e6-0fda-4d92-bea4-802c5ae51fdf admin admin] PATH_INFO: `/v3/projects/2fbac8b3aa5e470883183887bea36a48/users/791d4623c8d94a95899b3682741e503d/roles/6832f9f0b207495a9a247504bcb6b49f` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:27.489000 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae407e6-0fda-4d92-bea4-802c5ae51fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbac8b3aa5e470883183887bea36a48, user_id=791d4623c8d94a95899b3682741e503d, role_id=6832f9f0b207495a9a247504bcb6b49f)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:16:27.491944 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae407e6-0fda-4d92-bea4-802c5ae51fdf admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:16:27.557588 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1465/2911] 10.222.0.23 () {60 vars in 1482 bytes} [Thu Jun 16 15:16:27 2022] PUT /identity/v3/projects/2fbac8b3aa5e470883183887bea36a48/users/791d4623c8d94a95899b3682741e503d/roles/6832f9f0b207495a9a247504bcb6b49f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 15:16:27.617304 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050950d-81de-4b41-bb22-760f0229a417 None None] REQUEST_METHOD: `POST` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:27.617604 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050950d-81de-4b41-bb22-760f0229a417 None None] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:27.617917 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050950d-81de-4b41-bb22-760f0229a417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:27.644989 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.auth.core [None req-c050950d-81de-4b41-bb22-760f0229a417 None None] MFA Rules not processed for user `791d4623c8d94a95899b3682741e503d`. Rule list: `[]` (Enabled: `True`). {{(pid=80273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:16:27.646248 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-c050950d-81de-4b41-bb22-760f0229a417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:16:27.709893 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1447/2912] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:16:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:16:27.723181 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae407e6-0fda-4d92-bea4-802c5ae51fdf admin admin] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:16:27.724823 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-4ae407e6-0fda-4d92-bea4-802c5ae51fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:16:27.729726 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:16:27.806825 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae407e6-0fda-4d92-bea4-802c5ae51fdf admin admin] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:16:27.812949 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bda28-8f58-4ba6-a6b0-ca5f6745eaa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30309e7760004bd795c22dcb55d4ff99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:16:27.814551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bda28-8f58-4ba6-a6b0-ca5f6745eaa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:27.814551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bda28-8f58-4ba6-a6b0-ca5f6745eaa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:27.814551 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bda28-8f58-4ba6-a6b0-ca5f6745eaa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:27.824859 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bda28-8f58-4ba6-a6b0-ca5f6745eaa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:16:27.826348 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bda28-8f58-4ba6-a6b0-ca5f6745eaa2 service cinder] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:16:27.835638 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1466/2913] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:16:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:16:27.864932 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050950d-81de-4b41-bb22-760f0229a417 None None] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:16:27.929756 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050950d-81de-4b41-bb22-760f0229a417 None None] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:16:27.935192 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f3d2-b135-4357-a99a-ec45bfa44fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:16:27.936101 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f3d2-b135-4357-a99a-ec45bfa44fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:27.936363 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f3d2-b135-4357-a99a-ec45bfa44fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:27.938102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2f3d2-b135-4357-a99a-ec45bfa44fae admin admin] PATH_INFO: `/v3/users/791d4623c8d94a95899b3682741e503d` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:27.938102 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2f3d2-b135-4357-a99a-ec45bfa44fae admin admin] RBAC: Authorizing `identity:delete_user(user_id=791d4623c8d94a95899b3682741e503d)` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:16:27.940113 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2f3d2-b135-4357-a99a-ec45bfa44fae admin admin] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:16:27.955260 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:16:28.215414 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e2a2f3d2-b135-4357-a99a-ec45bfa44fae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '791d4623c8d94a95899b3682741e503d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:28.216336 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e2a2f3d2-b135-4357-a99a-ec45bfa44fae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '791d4623c8d94a95899b3682741e503d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:28.226161 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e2a2f3d2-b135-4357-a99a-ec45bfa44fae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '791d4623c8d94a95899b3682741e503d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:28.227149 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e2a2f3d2-b135-4357-a99a-ec45bfa44fae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '791d4623c8d94a95899b3682741e503d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:28.290803 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.notifications [None req-e2a2f3d2-b135-4357-a99a-ec45bfa44fae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '791d4623c8d94a95899b3682741e503d'} {{(pid=80273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:28.309440 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1448/2914] 10.222.0.23 () {58 vars in 1223 bytes} [Thu Jun 16 15:16:27 2022] DELETE /identity/v3/users/791d4623c8d94a95899b3682741e503d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:16:28.314087 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25306ad3-038c-4a62-8f8e-0f5fb9655292 None None] REQUEST_METHOD: `POST` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:28.314458 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25306ad3-038c-4a62-8f8e-0f5fb9655292 None None] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:28.314815 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25306ad3-038c-4a62-8f8e-0f5fb9655292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:28.331724 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.auth.core [None req-25306ad3-038c-4a62-8f8e-0f5fb9655292 None None] MFA Rules not processed for user `7bd0a21fa70d4ea3afe606ec912fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=80274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 15:16:28.334368 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-25306ad3-038c-4a62-8f8e-0f5fb9655292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:16:28.391001 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1467/2915] 10.222.0.23 () {58 vars in 957 bytes} [Thu Jun 16 15:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 15:16:28.401003 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f3d2-b135-4357-a99a-ec45bfa44fae admin admin] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:16:28.402503 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-e2a2f3d2-b135-4357-a99a-ec45bfa44fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:16:28.459328 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2f3d2-b135-4357-a99a-ec45bfa44fae admin admin] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:16:28.462951 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ed0ec-cfed-45d5-92e6-d0912ae13661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db3b603ceffb43bc99684e0d2319e3ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:16:28.463635 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed0ec-cfed-45d5-92e6-d0912ae13661 service neutron] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:28.463927 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed0ec-cfed-45d5-92e6-d0912ae13661 service neutron] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:28.464207 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed0ec-cfed-45d5-92e6-d0912ae13661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:28.473277 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ed0ec-cfed-45d5-92e6-d0912ae13661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:16:28.474844 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ed0ec-cfed-45d5-92e6-d0912ae13661 service neutron] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:16:28.495317 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1449/2916] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:16:28.908799 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25306ad3-038c-4a62-8f8e-0f5fb9655292 None None] Authenticating user token {{(pid=80274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:16:28.910422 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.fernet_utils [None req-25306ad3-038c-4a62-8f8e-0f5fb9655292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:16:28.925821 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25306ad3-038c-4a62-8f8e-0f5fb9655292 None None] Validating token access rules against request {{(pid=80274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:16:28.938160 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39070cd4-5c7a-42dc-be93-e2f2a8d51094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd0a21fa70d4ea3afe606ec912fd867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf0562aee55477696055292ce72d79e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:16:28.939082 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39070cd4-5c7a-42dc-be93-e2f2a8d51094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:16:28.939377 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39070cd4-5c7a-42dc-be93-e2f2a8d51094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:16:28.939663 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39070cd4-5c7a-42dc-be93-e2f2a8d51094 admin admin] PATH_INFO: `/v3/projects/2fbac8b3aa5e470883183887bea36a48` {{(pid=80274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:16:28.941278 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39070cd4-5c7a-42dc-be93-e2f2a8d51094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fbac8b3aa5e470883183887bea36a48)` {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:16:28.943206 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39070cd4-5c7a-42dc-be93-e2f2a8d51094 admin admin] RBAC: Authorization granted {{(pid=80274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:16:29.049183 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-39070cd4-5c7a-42dc-be93-e2f2a8d51094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fbac8b3aa5e470883183887bea36a48', 'request_id': 'req-39070cd4-5c7a-42dc-be93-e2f2a8d51094'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:29.055986 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-39070cd4-5c7a-42dc-be93-e2f2a8d51094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fbac8b3aa5e470883183887bea36a48', 'request_id': 'req-39070cd4-5c7a-42dc-be93-e2f2a8d51094'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:29.061877 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-39070cd4-5c7a-42dc-be93-e2f2a8d51094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fbac8b3aa5e470883183887bea36a48', 'request_id': 'req-39070cd4-5c7a-42dc-be93-e2f2a8d51094'} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:29.128044 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-39070cd4-5c7a-42dc-be93-e2f2a8d51094 admin admin] The token cache is being invalidate because project 2fbac8b3aa5e470883183887bea36a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 15:16:29.128341 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-39070cd4-5c7a-42dc-be93-e2f2a8d51094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:29.128987 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG keystone.notifications [None req-39070cd4-5c7a-42dc-be93-e2f2a8d51094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 15:16:29.130579 dv-cinder-837163-3-smb devstack@keystone.service[80274]: [pid: 80274|app: 0|req: 1468/2917] 10.222.0.23 () {58 vars in 1232 bytes} [Thu Jun 16 15:16:28 2022] DELETE /identity/v3/projects/2fbac8b3aa5e470883183887bea36a48 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 15:16:38.480836 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=47,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:16:39.124858 dv-cinder-837163-3-smb devstack@keystone.service[80274]: DEBUG dbcounter [-] [80274] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:17:28.311557 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ed0ec-cfed-45d5-92e6-d0912ae13661 service neutron] Authenticating user token {{(pid=80273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 15:17:28.313011 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-230ed0ec-cfed-45d5-92e6-d0912ae13661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:17:28.410494 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ed0ec-cfed-45d5-92e6-d0912ae13661 service neutron] Validating token access rules against request {{(pid=80273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 15:17:28.471218 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac2377-57d9-4b23-804d-e72a27dbdb5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '534035b2e8cf4f769e3dbbaabc0f6ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec9e5996685142bb94c83c5403fbf17d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 15:17:28.471963 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac2377-57d9-4b23-804d-e72a27dbdb5b service placement] REQUEST_METHOD: `GET` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 15:17:28.472250 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac2377-57d9-4b23-804d-e72a27dbdb5b service placement] SCRIPT_NAME: `/identity` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 15:17:28.472532 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac2377-57d9-4b23-804d-e72a27dbdb5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 15:17:28.474391 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.fernet_utils [None req-38ac2377-57d9-4b23-804d-e72a27dbdb5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 15:17:28.486284 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac2377-57d9-4b23-804d-e72a27dbdb5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 15:17:28.487969 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac2377-57d9-4b23-804d-e72a27dbdb5b service placement] RBAC: Authorization granted {{(pid=80273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 15:17:28.498809 dv-cinder-837163-3-smb devstack@keystone.service[80273]: [pid: 80273|app: 0|req: 1450/2918] 10.222.0.23 () {60 vars in 1365 bytes} [Thu Jun 16 15:17:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 15:17:38.494116 dv-cinder-837163-3-smb devstack@keystone.service[80273]: DEBUG dbcounter [-] [80273] Writing DB stats keystone:SELECT=67 {{(pid=80273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}